2024-09-11T00:04:24.116 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-11T00:04:24.161 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-11T00:04:24.264 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi/7899833 branch: wip-hemanth-testing-2024-09-10-0723 description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v2 tasks/xfstests-dev} email: hyelloji@redhat.com first_in_suite: false job_id: '7899833' kernel: client: sha1: distro flavor: default kdb: 1 sha1: 2ca44a2f35ca8f36983aaaa46d49312239ef519a ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-hemanth-testing-2024-09-10-0723 ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd cluster-conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 2 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mon: mon op complaint time: 120 mon warn on pool no app: false osd: osd op complaint time: 180 conf: client: pid file: '' global: ms die on skipped message: false mgr: client mount timeout: 30 debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - fs.*is degraded - filesystem is degraded - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - filesystem is offline - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - insufficient standby MDS daemons available - MDS_UP_LESS_THAN_MAX - online, but wants - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy sha1: 8f219c476cb4f26fc5719c661c0323719a45cb30 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 8f219c476cb4f26fc5719c661c0323719a45cb30 kclient: syntax: v1 subvolume_version: 2 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-hemanth-testing-2024-09-10-0723 sha1: 8f219c476cb4f26fc5719c661c0323719a45cb30 owner: scheduled_hyelloji@teuthology priority: 100 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 6190 sha1: 8f219c476cb4f26fc5719c661c0323719a45cb30 sleep_before_teardown: 0 subset: 479/1024 suite: fs suite_branch: wip-hemanth-testing-2024-09-10-0723 suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_8f219c476cb4f26fc5719c661c0323719a45cb30/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: 8f219c476cb4f26fc5719c661c0323719a45cb30 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi092.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAyec3NWnFfM97aJ2HY8FYEPRfUJBlEB2Sd7yjNNnekvP+y1HpqvkIfn1f4EUJz/VR+Is8Zryj/hqXtnYg3/aGY= smithi145.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLEbD1QYRqlpqyXt1BdtvkMS/R4UtuJHIFh7QaAyxYNg+QfZlN4VST9UbjD0vKJPS9jPIuHqA31+NY6bmgqH0g8= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - kclient: null - cephfs_test_runner: fail_on_skip: false modules: - tasks.cephfs.tests_from_xfstests_dev teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-10_16:59:47 tube: smithi user: hyelloji verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-11T00:04:24.265 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_8f219c476cb4f26fc5719c661c0323719a45cb30/qa; will attempt to use it 2024-09-11T00:04:24.265 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_8f219c476cb4f26fc5719c661c0323719a45cb30/qa/tasks 2024-09-11T00:04:24.266 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-11T00:04:24.267 INFO:teuthology.task.internal:Checking packages... 2024-09-11T00:04:24.292 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '8f219c476cb4f26fc5719c661c0323719a45cb30' 2024-09-11T00:04:24.293 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-11T00:04:24.293 INFO:teuthology.packaging:ref: None 2024-09-11T00:04:24.293 INFO:teuthology.packaging:tag: None 2024-09-11T00:04:24.293 INFO:teuthology.packaging:branch: wip-hemanth-testing-2024-09-10-0723 2024-09-11T00:04:24.293 INFO:teuthology.packaging:sha1: 8f219c476cb4f26fc5719c661c0323719a45cb30 2024-09-11T00:04:24.293 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-hemanth-testing-2024-09-10-0723 2024-09-11T00:04:24.446 INFO:teuthology.task.internal:Found packages for ceph version 19.3.0-4854.g8f219c47 2024-09-11T00:04:24.447 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-11T00:04:24.483 INFO:teuthology.task.internal:no buildpackages task found 2024-09-11T00:04:24.483 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-11T00:04:24.491 INFO:teuthology.task.internal:Saving configuration 2024-09-11T00:04:24.510 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-11T00:04:24.521 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-11T00:04:24.552 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi092.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi/7899833', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-10 23:59:25.504468', 'locked_by': 'scheduled_hyelloji@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAyec3NWnFfM97aJ2HY8FYEPRfUJBlEB2Sd7yjNNnekvP+y1HpqvkIfn1f4EUJz/VR+Is8Zryj/hqXtnYg3/aGY='} 2024-09-11T00:04:24.580 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi145.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi/7899833', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-10 23:59:25.505890', 'locked_by': 'scheduled_hyelloji@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLEbD1QYRqlpqyXt1BdtvkMS/R4UtuJHIFh7QaAyxYNg+QfZlN4VST9UbjD0vKJPS9jPIuHqA31+NY6bmgqH0g8='} 2024-09-11T00:04:24.580 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-11T00:04:24.612 INFO:teuthology.task.internal:roles: ubuntu@smithi092.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2024-09-11T00:04:24.612 INFO:teuthology.task.internal:roles: ubuntu@smithi145.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2024-09-11T00:04:24.613 INFO:teuthology.run_tasks:Running task console_log... 2024-09-11T00:04:24.715 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f76e3da7be0>, signals=[15]) 2024-09-11T00:04:24.715 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-11T00:04:24.721 INFO:teuthology.task.internal:Opening connections... 2024-09-11T00:04:24.721 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi092.front.sepia.ceph.com 2024-09-11T00:04:24.722 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T00:04:24.812 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi145.front.sepia.ceph.com 2024-09-11T00:04:24.813 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T00:04:24.895 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-11T00:04:24.925 DEBUG:teuthology.orchestra.run.smithi092:> uname -m 2024-09-11T00:04:24.943 INFO:teuthology.orchestra.run.smithi092.stdout:x86_64 2024-09-11T00:04:24.943 DEBUG:teuthology.orchestra.run.smithi092:> cat /etc/os-release 2024-09-11T00:04:25.002 INFO:teuthology.orchestra.run.smithi092.stdout:NAME="CentOS Stream" 2024-09-11T00:04:25.002 INFO:teuthology.orchestra.run.smithi092.stdout:VERSION="9" 2024-09-11T00:04:25.002 INFO:teuthology.orchestra.run.smithi092.stdout:ID="centos" 2024-09-11T00:04:25.002 INFO:teuthology.orchestra.run.smithi092.stdout:ID_LIKE="rhel fedora" 2024-09-11T00:04:25.003 INFO:teuthology.orchestra.run.smithi092.stdout:VERSION_ID="9" 2024-09-11T00:04:25.003 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM_ID="platform:el9" 2024-09-11T00:04:25.003 INFO:teuthology.orchestra.run.smithi092.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-11T00:04:25.003 INFO:teuthology.orchestra.run.smithi092.stdout:ANSI_COLOR="0;31" 2024-09-11T00:04:25.003 INFO:teuthology.orchestra.run.smithi092.stdout:LOGO="fedora-logo-icon" 2024-09-11T00:04:25.003 INFO:teuthology.orchestra.run.smithi092.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-11T00:04:25.003 INFO:teuthology.orchestra.run.smithi092.stdout:HOME_URL="https://centos.org/" 2024-09-11T00:04:25.003 INFO:teuthology.orchestra.run.smithi092.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-11T00:04:25.003 INFO:teuthology.orchestra.run.smithi092.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-11T00:04:25.003 INFO:teuthology.orchestra.run.smithi092.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-11T00:04:25.004 INFO:teuthology.lock.ops:Updating smithi092.front.sepia.ceph.com on lock server 2024-09-11T00:04:25.034 DEBUG:teuthology.orchestra.run.smithi145:> uname -m 2024-09-11T00:04:25.053 INFO:teuthology.orchestra.run.smithi145.stdout:x86_64 2024-09-11T00:04:25.054 DEBUG:teuthology.orchestra.run.smithi145:> cat /etc/os-release 2024-09-11T00:04:25.111 INFO:teuthology.orchestra.run.smithi145.stdout:NAME="CentOS Stream" 2024-09-11T00:04:25.111 INFO:teuthology.orchestra.run.smithi145.stdout:VERSION="9" 2024-09-11T00:04:25.111 INFO:teuthology.orchestra.run.smithi145.stdout:ID="centos" 2024-09-11T00:04:25.111 INFO:teuthology.orchestra.run.smithi145.stdout:ID_LIKE="rhel fedora" 2024-09-11T00:04:25.111 INFO:teuthology.orchestra.run.smithi145.stdout:VERSION_ID="9" 2024-09-11T00:04:25.111 INFO:teuthology.orchestra.run.smithi145.stdout:PLATFORM_ID="platform:el9" 2024-09-11T00:04:25.112 INFO:teuthology.orchestra.run.smithi145.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-11T00:04:25.112 INFO:teuthology.orchestra.run.smithi145.stdout:ANSI_COLOR="0;31" 2024-09-11T00:04:25.112 INFO:teuthology.orchestra.run.smithi145.stdout:LOGO="fedora-logo-icon" 2024-09-11T00:04:25.112 INFO:teuthology.orchestra.run.smithi145.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-11T00:04:25.112 INFO:teuthology.orchestra.run.smithi145.stdout:HOME_URL="https://centos.org/" 2024-09-11T00:04:25.112 INFO:teuthology.orchestra.run.smithi145.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-11T00:04:25.112 INFO:teuthology.orchestra.run.smithi145.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-11T00:04:25.112 INFO:teuthology.orchestra.run.smithi145.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-11T00:04:25.112 INFO:teuthology.lock.ops:Updating smithi145.front.sepia.ceph.com on lock server 2024-09-11T00:04:25.143 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-11T00:04:25.215 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-11T00:04:25.281 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-11T00:04:25.281 DEBUG:teuthology.orchestra.run.smithi092:> test '!' -e /home/ubuntu/cephtest 2024-09-11T00:04:25.284 DEBUG:teuthology.orchestra.run.smithi145:> test '!' -e /home/ubuntu/cephtest 2024-09-11T00:04:25.301 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-11T00:04:25.308 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-11T00:04:25.309 DEBUG:teuthology.orchestra.run.smithi092:> test -z $(ls -A /var/lib/ceph) 2024-09-11T00:04:25.341 DEBUG:teuthology.orchestra.run.smithi145:> test -z $(ls -A /var/lib/ceph) 2024-09-11T00:04:25.394 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-11T00:04:25.480 INFO:teuthology.run_tasks:Running task kernel... 2024-09-11T00:04:25.514 INFO:teuthology.task.kernel:normalize config orig: {'client': {'sha1': 'distro'}, 'flavor': 'default', 'kdb': 1, 'sha1': '2ca44a2f35ca8f36983aaaa46d49312239ef519a'} 2024-09-11T00:04:25.514 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'sha1': 'distro'}, 'client.2': {'sha1': 'distro'}, 'client.1': {'sha1': 'distro'}, 'client.3': {'sha1': 'distro'}} 2024-09-11T00:04:25.514 INFO:teuthology.task.kernel:config {'client.0': {'sha1': 'distro'}, 'client.1': {'sha1': 'distro'}}, timeout 300 2024-09-11T00:04:25.514 DEBUG:teuthology.orchestra.run.smithi092:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-11T00:04:25.515 DEBUG:teuthology.orchestra.run.smithi145:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-11T00:04:25.531 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T00:04:25.531 DEBUG:teuthology.orchestra.run.smithi092:> uname -r 2024-09-11T00:04:25.532 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T00:04:25.532 DEBUG:teuthology.orchestra.run.smithi145:> uname -r 2024-09-11T00:04:25.588 INFO:teuthology.orchestra.run.smithi092.stdout:5.14.0-503.el9.x86_64 2024-09-11T00:04:25.589 INFO:teuthology.task.kernel:Running kernel on smithi092: 5.14.0-503.el9.x86_64 2024-09-11T00:04:25.589 DEBUG:teuthology.orchestra.run.smithi092:> sudo yum install -y kernel 2024-09-11T00:04:25.590 INFO:teuthology.orchestra.run.smithi145.stdout:5.14.0-503.el9.x86_64 2024-09-11T00:04:25.590 INFO:teuthology.task.kernel:Running kernel on smithi145: 5.14.0-503.el9.x86_64 2024-09-11T00:04:25.590 DEBUG:teuthology.orchestra.run.smithi145:> sudo yum install -y kernel 2024-09-11T00:04:29.264 INFO:teuthology.orchestra.run.smithi145.stdout:CentOS Stream 9 - BaseOS 4.3 MB/s | 8.2 MB 00:01 2024-09-11T00:04:29.629 INFO:teuthology.orchestra.run.smithi092.stdout:CentOS Stream 9 - BaseOS 3.7 MB/s | 8.2 MB 00:02 2024-09-11T00:04:31.198 INFO:teuthology.orchestra.run.smithi145.stdout:CentOS Stream 9 - AppStream 25 MB/s | 20 MB 00:00 2024-09-11T00:04:33.355 INFO:teuthology.orchestra.run.smithi092.stdout:CentOS Stream 9 - AppStream 7.8 MB/s | 20 MB 00:02 2024-09-11T00:04:36.632 INFO:teuthology.orchestra.run.smithi145.stdout:CentOS Stream 9 - CRB 4.1 MB/s | 6.5 MB 00:01 2024-09-11T00:04:38.115 INFO:teuthology.orchestra.run.smithi145.stdout:CentOS Stream 9 - Extras packages 64 kB/s | 19 kB 00:00 2024-09-11T00:04:39.086 INFO:teuthology.orchestra.run.smithi145.stdout:Extra Packages for Enterprise Linux 27 MB/s | 23 MB 00:00 2024-09-11T00:04:39.155 INFO:teuthology.orchestra.run.smithi092.stdout:CentOS Stream 9 - CRB 3.2 MB/s | 6.5 MB 00:02 2024-09-11T00:04:40.797 INFO:teuthology.orchestra.run.smithi092.stdout:CentOS Stream 9 - Extras packages 43 kB/s | 19 kB 00:00 2024-09-11T00:04:41.685 INFO:teuthology.orchestra.run.smithi092.stdout:Extra Packages for Enterprise Linux 30 MB/s | 23 MB 00:00 2024-09-11T00:04:44.475 INFO:teuthology.orchestra.run.smithi145.stdout:lab-extras 27 kB/s | 1.7 kB 00:00 2024-09-11T00:04:46.515 INFO:teuthology.orchestra.run.smithi145.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-11T00:04:46.515 INFO:teuthology.orchestra.run.smithi145.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-11T00:04:46.626 INFO:teuthology.orchestra.run.smithi145.stdout:Dependencies resolved. 2024-09-11T00:04:46.632 INFO:teuthology.orchestra.run.smithi145.stdout:================================================================================ 2024-09-11T00:04:46.632 INFO:teuthology.orchestra.run.smithi145.stdout: Package Architecture Version Repository Size 2024-09-11T00:04:46.632 INFO:teuthology.orchestra.run.smithi145.stdout:================================================================================ 2024-09-11T00:04:46.632 INFO:teuthology.orchestra.run.smithi145.stdout:Installing: 2024-09-11T00:04:46.632 INFO:teuthology.orchestra.run.smithi145.stdout: kernel x86_64 5.14.0-505.el9 baseos 23 k 2024-09-11T00:04:46.633 INFO:teuthology.orchestra.run.smithi145.stdout:Installing dependencies: 2024-09-11T00:04:46.633 INFO:teuthology.orchestra.run.smithi145.stdout: kernel-core x86_64 5.14.0-505.el9 baseos 16 M 2024-09-11T00:04:46.633 INFO:teuthology.orchestra.run.smithi145.stdout: kernel-modules x86_64 5.14.0-505.el9 baseos 35 M 2024-09-11T00:04:46.633 INFO:teuthology.orchestra.run.smithi145.stdout: kernel-modules-core x86_64 5.14.0-505.el9 baseos 29 M 2024-09-11T00:04:46.633 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-11T00:04:46.633 INFO:teuthology.orchestra.run.smithi145.stdout:Transaction Summary 2024-09-11T00:04:46.633 INFO:teuthology.orchestra.run.smithi145.stdout:================================================================================ 2024-09-11T00:04:46.633 INFO:teuthology.orchestra.run.smithi145.stdout:Install 4 Packages 2024-09-11T00:04:46.633 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-11T00:04:46.634 INFO:teuthology.orchestra.run.smithi145.stdout:Total download size: 79 M 2024-09-11T00:04:46.634 INFO:teuthology.orchestra.run.smithi145.stdout:Installed size: 126 M 2024-09-11T00:04:46.634 INFO:teuthology.orchestra.run.smithi145.stdout:Downloading Packages: 2024-09-11T00:04:46.851 INFO:teuthology.orchestra.run.smithi145.stdout:(1/4): kernel-5.14.0-505.el9.x86_64.rpm 249 kB/s | 23 kB 00:00 2024-09-11T00:04:47.240 INFO:teuthology.orchestra.run.smithi092.stdout:lab-extras 41 kB/s | 1.7 kB 00:00 2024-09-11T00:04:47.302 INFO:teuthology.orchestra.run.smithi145.stdout:(2/4): kernel-core-5.14.0-505.el9.x86_64.rpm 29 MB/s | 16 MB 00:00 2024-09-11T00:04:47.735 INFO:teuthology.orchestra.run.smithi145.stdout:(3/4): kernel-modules-5.14.0-505.el9.x86_64.rpm 35 MB/s | 35 MB 00:00 2024-09-11T00:04:48.011 INFO:teuthology.orchestra.run.smithi145.stdout:(4/4): kernel-modules-core-5.14.0-505.el9.x86_6 25 MB/s | 29 MB 00:01 2024-09-11T00:04:48.011 INFO:teuthology.orchestra.run.smithi145.stdout:-------------------------------------------------------------------------------- 2024-09-11T00:04:48.011 INFO:teuthology.orchestra.run.smithi145.stdout:Total 57 MB/s | 79 MB 00:01 2024-09-11T00:04:48.698 INFO:teuthology.orchestra.run.smithi145.stdout:Running transaction check 2024-09-11T00:04:49.068 INFO:teuthology.orchestra.run.smithi145.stdout:Transaction check succeeded. 2024-09-11T00:04:49.068 INFO:teuthology.orchestra.run.smithi145.stdout:Running transaction test 2024-09-11T00:04:49.262 INFO:teuthology.orchestra.run.smithi092.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-11T00:04:49.263 INFO:teuthology.orchestra.run.smithi092.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-11T00:04:49.352 INFO:teuthology.orchestra.run.smithi092.stdout:Dependencies resolved. 2024-09-11T00:04:49.361 INFO:teuthology.orchestra.run.smithi092.stdout:================================================================================ 2024-09-11T00:04:49.361 INFO:teuthology.orchestra.run.smithi092.stdout: Package Architecture Version Repository Size 2024-09-11T00:04:49.361 INFO:teuthology.orchestra.run.smithi092.stdout:================================================================================ 2024-09-11T00:04:49.362 INFO:teuthology.orchestra.run.smithi092.stdout:Installing: 2024-09-11T00:04:49.362 INFO:teuthology.orchestra.run.smithi092.stdout: kernel x86_64 5.14.0-505.el9 baseos 23 k 2024-09-11T00:04:49.362 INFO:teuthology.orchestra.run.smithi092.stdout:Installing dependencies: 2024-09-11T00:04:49.362 INFO:teuthology.orchestra.run.smithi092.stdout: kernel-core x86_64 5.14.0-505.el9 baseos 16 M 2024-09-11T00:04:49.362 INFO:teuthology.orchestra.run.smithi092.stdout: kernel-modules x86_64 5.14.0-505.el9 baseos 35 M 2024-09-11T00:04:49.362 INFO:teuthology.orchestra.run.smithi092.stdout: kernel-modules-core x86_64 5.14.0-505.el9 baseos 29 M 2024-09-11T00:04:49.362 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:04:49.362 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction Summary 2024-09-11T00:04:49.362 INFO:teuthology.orchestra.run.smithi092.stdout:================================================================================ 2024-09-11T00:04:49.362 INFO:teuthology.orchestra.run.smithi092.stdout:Install 4 Packages 2024-09-11T00:04:49.362 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:04:49.363 INFO:teuthology.orchestra.run.smithi092.stdout:Total download size: 79 M 2024-09-11T00:04:49.363 INFO:teuthology.orchestra.run.smithi092.stdout:Installed size: 126 M 2024-09-11T00:04:49.363 INFO:teuthology.orchestra.run.smithi092.stdout:Downloading Packages: 2024-09-11T00:04:49.541 INFO:teuthology.orchestra.run.smithi092.stdout:(1/4): kernel-5.14.0-505.el9.x86_64.rpm 283 kB/s | 23 kB 00:00 2024-09-11T00:04:49.891 INFO:teuthology.orchestra.run.smithi092.stdout:(2/4): kernel-core-5.14.0-505.el9.x86_64.rpm 36 MB/s | 16 MB 00:00 2024-09-11T00:04:50.033 INFO:teuthology.orchestra.run.smithi145.stdout:Transaction test succeeded. 2024-09-11T00:04:50.033 INFO:teuthology.orchestra.run.smithi145.stdout:Running transaction 2024-09-11T00:04:50.302 INFO:teuthology.orchestra.run.smithi092.stdout:(3/4): kernel-modules-5.14.0-505.el9.x86_64.rpm 41 MB/s | 35 MB 00:00 2024-09-11T00:04:50.700 INFO:teuthology.orchestra.run.smithi092.stdout:(4/4): kernel-modules-core-5.14.0-505.el9.x86_6 25 MB/s | 29 MB 00:01 2024-09-11T00:04:50.700 INFO:teuthology.orchestra.run.smithi092.stdout:-------------------------------------------------------------------------------- 2024-09-11T00:04:50.701 INFO:teuthology.orchestra.run.smithi092.stdout:Total 59 MB/s | 79 MB 00:01 2024-09-11T00:04:51.386 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction check 2024-09-11T00:04:51.737 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction check succeeded. 2024-09-11T00:04:51.737 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction test 2024-09-11T00:04:52.466 INFO:teuthology.orchestra.run.smithi145.stdout: Preparing : 1/1 2024-09-11T00:04:52.681 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction test succeeded. 2024-09-11T00:04:52.681 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction 2024-09-11T00:04:53.118 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : kernel-modules-core-5.14.0-505.el9.x86_64 1/4 2024-09-11T00:04:53.203 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-11T00:04:55.138 INFO:teuthology.orchestra.run.smithi092.stdout: Preparing : 1/1 2024-09-11T00:04:55.883 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : kernel-modules-core-5.14.0-505.el9.x86_64 1/4 2024-09-11T00:04:55.971 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-11T00:04:55.975 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-11T00:04:56.098 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-11T00:04:58.769 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-11T00:04:58.896 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-11T00:05:00.917 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-11T00:05:01.006 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : kernel-5.14.0-505.el9.x86_64 4/4 2024-09-11T00:05:03.736 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-11T00:05:03.771 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : kernel-5.14.0-505.el9.x86_64 4/4 2024-09-11T00:05:05.822 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-11T00:05:08.600 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-11T00:05:44.162 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 4/4 2024-09-11T00:05:44.201 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 4/4 2024-09-11T00:05:44.526 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: kernel-5.14.0-505.el9.x86_64 4/4 2024-09-11T00:05:44.526 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : kernel-5.14.0-505.el9.x86_64 1/4 2024-09-11T00:05:44.526 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-11T00:05:44.526 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-11T00:05:45.361 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-11T00:05:45.362 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-11T00:05:45.362 INFO:teuthology.orchestra.run.smithi145.stdout:Installed: 2024-09-11T00:05:45.362 INFO:teuthology.orchestra.run.smithi145.stdout: kernel-5.14.0-505.el9.x86_64 2024-09-11T00:05:45.362 INFO:teuthology.orchestra.run.smithi145.stdout: kernel-core-5.14.0-505.el9.x86_64 2024-09-11T00:05:45.362 INFO:teuthology.orchestra.run.smithi145.stdout: kernel-modules-5.14.0-505.el9.x86_64 2024-09-11T00:05:45.362 INFO:teuthology.orchestra.run.smithi145.stdout: kernel-modules-core-5.14.0-505.el9.x86_64 2024-09-11T00:05:45.362 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-11T00:05:45.362 INFO:teuthology.orchestra.run.smithi145.stdout:Complete! 2024-09-11T00:05:45.720 DEBUG:teuthology.orchestra.run.smithi145:> rpm -q kernel | sort -rV | head -n 1 2024-09-11T00:05:45.802 INFO:teuthology.orchestra.run.smithi145.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-11T00:05:45.803 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-11T00:05:45.803 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-505.el9.x86_64 2024-09-11T00:05:45.803 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-11T00:05:45.803 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-11T00:05:45.803 INFO:teuthology.task.kernel:Installing distro kernel on client.1... 2024-09-11T00:05:45.803 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi145.front.sepia.ceph.com, path=None, version=distro) 2024-09-11T00:05:45.804 DEBUG:teuthology.orchestra.run.smithi145:> rpm -q kernel | sort -rV | head -n 1 2024-09-11T00:05:45.861 INFO:teuthology.orchestra.run.smithi145.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-11T00:05:45.862 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-11T00:05:45.862 DEBUG:teuthology.orchestra.run.smithi145:> sudo rpm -qi grub2-tools 2024-09-11T00:05:45.894 INFO:teuthology.orchestra.run.smithi145.stdout:Name : grub2-tools 2024-09-11T00:05:45.895 INFO:teuthology.orchestra.run.smithi145.stdout:Epoch : 1 2024-09-11T00:05:45.895 INFO:teuthology.orchestra.run.smithi145.stdout:Version : 2.06 2024-09-11T00:05:45.895 INFO:teuthology.orchestra.run.smithi145.stdout:Release : 82.el9 2024-09-11T00:05:45.895 INFO:teuthology.orchestra.run.smithi145.stdout:Architecture: x86_64 2024-09-11T00:05:45.895 INFO:teuthology.orchestra.run.smithi145.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-11T00:05:45.895 INFO:teuthology.orchestra.run.smithi145.stdout:Group : Unspecified 2024-09-11T00:05:45.895 INFO:teuthology.orchestra.run.smithi145.stdout:Size : 8274670 2024-09-11T00:05:45.895 INFO:teuthology.orchestra.run.smithi145.stdout:License : GPLv3+ 2024-09-11T00:05:45.895 INFO:teuthology.orchestra.run.smithi145.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-11T00:05:45.895 INFO:teuthology.orchestra.run.smithi145.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-11T00:05:45.895 INFO:teuthology.orchestra.run.smithi145.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-11T00:05:45.895 INFO:teuthology.orchestra.run.smithi145.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-11T00:05:45.896 INFO:teuthology.orchestra.run.smithi145.stdout:Packager : builder@centos.org 2024-09-11T00:05:45.896 INFO:teuthology.orchestra.run.smithi145.stdout:Vendor : CentOS 2024-09-11T00:05:45.896 INFO:teuthology.orchestra.run.smithi145.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-11T00:05:45.896 INFO:teuthology.orchestra.run.smithi145.stdout:Summary : Support tools for GRUB. 2024-09-11T00:05:45.896 INFO:teuthology.orchestra.run.smithi145.stdout:Description : 2024-09-11T00:05:45.896 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-11T00:05:45.896 INFO:teuthology.orchestra.run.smithi145.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-11T00:05:45.896 INFO:teuthology.orchestra.run.smithi145.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-11T00:05:45.896 INFO:teuthology.orchestra.run.smithi145.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-11T00:05:45.896 INFO:teuthology.orchestra.run.smithi145.stdout:hardware devices. 2024-09-11T00:05:45.896 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-11T00:05:45.896 INFO:teuthology.orchestra.run.smithi145.stdout:This subpackage provides tools for support of all platforms. 2024-09-11T00:05:45.897 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-11T00:05:45.897 INFO:teuthology.task.kernel:Updating grub on smithi145 to boot 5.14.0-505.el9.x86_64 2024-09-11T00:05:45.897 DEBUG:teuthology.orchestra.run.smithi145:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-11T00:05:46.599 INFO:teuthology.orchestra.run.smithi145.stderr:Generating grub configuration file ... 2024-09-11T00:05:46.820 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 4/4 2024-09-11T00:05:46.864 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 4/4 2024-09-11T00:05:47.214 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: kernel-5.14.0-505.el9.x86_64 4/4 2024-09-11T00:05:47.214 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : kernel-5.14.0-505.el9.x86_64 1/4 2024-09-11T00:05:47.214 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-11T00:05:47.214 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-11T00:05:47.862 INFO:teuthology.orchestra.run.smithi145.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-11T00:05:47.891 INFO:teuthology.orchestra.run.smithi145.stderr:done 2024-09-11T00:05:47.893 DEBUG:teuthology.orchestra.run.smithi145:> mktemp 2024-09-11T00:05:47.908 INFO:teuthology.orchestra.run.smithi145.stdout:/tmp/tmp.PXAuuaAmfC 2024-09-11T00:05:47.908 DEBUG:teuthology.orchestra.run.smithi145:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.PXAuuaAmfC 2024-09-11T00:05:47.980 DEBUG:teuthology.orchestra.run.smithi145:> sudo chmod 0666 /tmp/tmp.PXAuuaAmfC 2024-09-11T00:05:47.991 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-11T00:05:47.991 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:05:47.991 INFO:teuthology.orchestra.run.smithi092.stdout:Installed: 2024-09-11T00:05:47.991 INFO:teuthology.orchestra.run.smithi092.stdout: kernel-5.14.0-505.el9.x86_64 2024-09-11T00:05:47.991 INFO:teuthology.orchestra.run.smithi092.stdout: kernel-core-5.14.0-505.el9.x86_64 2024-09-11T00:05:47.991 INFO:teuthology.orchestra.run.smithi092.stdout: kernel-modules-5.14.0-505.el9.x86_64 2024-09-11T00:05:47.991 INFO:teuthology.orchestra.run.smithi092.stdout: kernel-modules-core-5.14.0-505.el9.x86_64 2024-09-11T00:05:47.991 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:05:47.991 INFO:teuthology.orchestra.run.smithi092.stdout:Complete! 2024-09-11T00:05:48.130 DEBUG:teuthology.orchestra.remote:smithi145:/tmp/tmp.PXAuuaAmfC is 6KB 2024-09-11T00:05:48.179 DEBUG:teuthology.orchestra.run.smithi145:> rm -fr /tmp/tmp.PXAuuaAmfC 2024-09-11T00:05:48.194 DEBUG:teuthology.orchestra.run.smithi145:> sudo /bin/ls /boot/loader/entries || true 2024-09-11T00:05:48.263 INFO:teuthology.orchestra.run.smithi145.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-11T00:05:48.263 INFO:teuthology.orchestra.run.smithi145.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-11T00:05:48.263 INFO:teuthology.orchestra.run.smithi145.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-11T00:05:48.263 INFO:teuthology.orchestra.run.smithi145.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64.conf 2024-09-11T00:05:48.265 DEBUG:teuthology.orchestra.run.smithi145:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64 2024-09-11T00:05:48.309 DEBUG:teuthology.orchestra.run.smithi092:> rpm -q kernel | sort -rV | head -n 1 2024-09-11T00:05:48.387 INFO:teuthology.orchestra.run.smithi092.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-11T00:05:48.387 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-11T00:05:48.387 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-505.el9.x86_64 2024-09-11T00:05:48.387 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-11T00:05:48.387 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-11T00:05:48.387 INFO:teuthology.task.kernel:Installing distro kernel on client.0... 2024-09-11T00:05:48.387 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi092.front.sepia.ceph.com, path=None, version=distro) 2024-09-11T00:05:48.388 DEBUG:teuthology.orchestra.run.smithi092:> rpm -q kernel | sort -rV | head -n 1 2024-09-11T00:05:48.415 DEBUG:teuthology.orchestra.run.smithi145:> sudo shutdown -r now 2024-09-11T00:05:48.445 INFO:teuthology.orchestra.run.smithi092.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-11T00:05:48.446 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-11T00:05:48.446 DEBUG:teuthology.orchestra.run.smithi092:> sudo rpm -qi grub2-tools 2024-09-11T00:05:48.477 INFO:teuthology.orchestra.run.smithi092.stdout:Name : grub2-tools 2024-09-11T00:05:48.477 INFO:teuthology.orchestra.run.smithi092.stdout:Epoch : 1 2024-09-11T00:05:48.477 INFO:teuthology.orchestra.run.smithi092.stdout:Version : 2.06 2024-09-11T00:05:48.478 INFO:teuthology.orchestra.run.smithi092.stdout:Release : 82.el9 2024-09-11T00:05:48.478 INFO:teuthology.orchestra.run.smithi092.stdout:Architecture: x86_64 2024-09-11T00:05:48.478 INFO:teuthology.orchestra.run.smithi092.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-11T00:05:48.478 INFO:teuthology.orchestra.run.smithi092.stdout:Group : Unspecified 2024-09-11T00:05:48.478 INFO:teuthology.orchestra.run.smithi092.stdout:Size : 8274670 2024-09-11T00:05:48.478 INFO:teuthology.orchestra.run.smithi092.stdout:License : GPLv3+ 2024-09-11T00:05:48.478 INFO:teuthology.orchestra.run.smithi092.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-11T00:05:48.478 INFO:teuthology.orchestra.run.smithi092.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-11T00:05:48.478 INFO:teuthology.orchestra.run.smithi092.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-11T00:05:48.478 INFO:teuthology.orchestra.run.smithi092.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-11T00:05:48.479 INFO:teuthology.orchestra.run.smithi092.stdout:Packager : builder@centos.org 2024-09-11T00:05:48.479 INFO:teuthology.orchestra.run.smithi092.stdout:Vendor : CentOS 2024-09-11T00:05:48.479 INFO:teuthology.orchestra.run.smithi092.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-11T00:05:48.479 INFO:teuthology.orchestra.run.smithi092.stdout:Summary : Support tools for GRUB. 2024-09-11T00:05:48.479 INFO:teuthology.orchestra.run.smithi092.stdout:Description : 2024-09-11T00:05:48.479 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:05:48.479 INFO:teuthology.orchestra.run.smithi092.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-11T00:05:48.479 INFO:teuthology.orchestra.run.smithi092.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-11T00:05:48.479 INFO:teuthology.orchestra.run.smithi092.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-11T00:05:48.479 INFO:teuthology.orchestra.run.smithi092.stdout:hardware devices. 2024-09-11T00:05:48.480 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:05:48.480 INFO:teuthology.orchestra.run.smithi092.stdout:This subpackage provides tools for support of all platforms. 2024-09-11T00:05:48.481 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-11T00:05:48.481 INFO:teuthology.task.kernel:Updating grub on smithi092 to boot 5.14.0-505.el9.x86_64 2024-09-11T00:05:48.481 DEBUG:teuthology.orchestra.run.smithi092:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-11T00:05:49.109 INFO:teuthology.orchestra.run.smithi092.stderr:Generating grub configuration file ... 2024-09-11T00:05:50.503 INFO:teuthology.orchestra.run.smithi092.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-11T00:05:50.543 INFO:teuthology.orchestra.run.smithi092.stderr:done 2024-09-11T00:05:50.545 DEBUG:teuthology.orchestra.run.smithi092:> mktemp 2024-09-11T00:05:50.560 INFO:teuthology.orchestra.run.smithi092.stdout:/tmp/tmp.KTIHAL9X15 2024-09-11T00:05:50.560 DEBUG:teuthology.orchestra.run.smithi092:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.KTIHAL9X15 2024-09-11T00:05:50.627 DEBUG:teuthology.orchestra.run.smithi092:> sudo chmod 0666 /tmp/tmp.KTIHAL9X15 2024-09-11T00:05:50.774 DEBUG:teuthology.orchestra.remote:smithi092:/tmp/tmp.KTIHAL9X15 is 6KB 2024-09-11T00:05:50.823 DEBUG:teuthology.orchestra.run.smithi092:> rm -fr /tmp/tmp.KTIHAL9X15 2024-09-11T00:05:50.838 DEBUG:teuthology.orchestra.run.smithi092:> sudo /bin/ls /boot/loader/entries || true 2024-09-11T00:05:50.900 INFO:teuthology.orchestra.run.smithi092.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-11T00:05:50.901 INFO:teuthology.orchestra.run.smithi092.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-11T00:05:50.901 INFO:teuthology.orchestra.run.smithi092.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-11T00:05:50.901 INFO:teuthology.orchestra.run.smithi092.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64.conf 2024-09-11T00:05:50.902 DEBUG:teuthology.orchestra.run.smithi092:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64 2024-09-11T00:05:51.062 DEBUG:teuthology.orchestra.run.smithi092:> sudo shutdown -r now 2024-09-11T00:06:18.441 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2024-09-11T00:06:18.442 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi145.front.sepia.ceph.com' 2024-09-11T00:06:18.443 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T00:06:21.067 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-09-11T00:06:21.067 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi092.front.sepia.ceph.com' 2024-09-11T00:06:21.067 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T00:06:36.861 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.145 2024-09-11T00:06:39.421 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.92 2024-09-11T00:06:45.869 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi145.front.sepia.ceph.com' 2024-09-11T00:06:45.870 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T00:06:48.424 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi092.front.sepia.ceph.com' 2024-09-11T00:06:48.425 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T00:06:48.961 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.145 2024-09-11T00:06:51.517 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.92 2024-09-11T00:07:00.969 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi145.front.sepia.ceph.com' 2024-09-11T00:07:00.970 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T00:07:03.520 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi092.front.sepia.ceph.com' 2024-09-11T00:07:03.521 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T00:07:32.810 DEBUG:teuthology.orchestra.run.smithi145:> true 2024-09-11T00:07:33.272 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi145.front.sepia.ceph.com' 2024-09-11T00:07:33.273 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "5.14.0-505.el9.x86_64"... 2024-09-11T00:07:33.273 DEBUG:teuthology.orchestra.run.smithi145:> uname -r 2024-09-11T00:07:33.288 INFO:teuthology.orchestra.run.smithi145.stdout:5.14.0-505.el9.x86_64 2024-09-11T00:07:33.288 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-505.el9.x86_64 vs 5.14.0-505.el9.x86_64 2024-09-11T00:07:33.288 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-11T00:07:33.288 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-11T00:07:34.289 DEBUG:teuthology.parallel:result is None 2024-09-11T00:07:35.283 DEBUG:teuthology.orchestra.run.smithi092:> true 2024-09-11T00:07:35.669 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi092.front.sepia.ceph.com' 2024-09-11T00:07:35.669 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "5.14.0-505.el9.x86_64"... 2024-09-11T00:07:35.670 DEBUG:teuthology.orchestra.run.smithi092:> uname -r 2024-09-11T00:07:35.684 INFO:teuthology.orchestra.run.smithi092.stdout:5.14.0-505.el9.x86_64 2024-09-11T00:07:35.684 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-505.el9.x86_64 vs 5.14.0-505.el9.x86_64 2024-09-11T00:07:35.684 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-11T00:07:35.684 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-11T00:07:36.686 DEBUG:teuthology.parallel:result is None 2024-09-11T00:07:36.686 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-11T00:07:36.695 INFO:teuthology.task.internal:Creating test directory... 2024-09-11T00:07:36.695 DEBUG:teuthology.orchestra.run.smithi092:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-11T00:07:36.698 DEBUG:teuthology.orchestra.run.smithi145:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-11T00:07:36.729 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-11T00:07:36.746 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-11T00:07:36.756 INFO:teuthology.task.internal:Creating archive directory... 2024-09-11T00:07:36.756 DEBUG:teuthology.orchestra.run.smithi092:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-11T00:07:36.773 DEBUG:teuthology.orchestra.run.smithi145:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-11T00:07:36.810 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-11T00:07:36.817 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-11T00:07:36.817 DEBUG:teuthology.orchestra.run.smithi092:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-11T00:07:36.848 DEBUG:teuthology.orchestra.run.smithi145:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-11T00:07:36.936 INFO:teuthology.orchestra.run.smithi145.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-11T00:07:36.970 INFO:teuthology.orchestra.run.smithi092.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-11T00:07:36.981 INFO:teuthology.orchestra.run.smithi145.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-11T00:07:37.012 INFO:teuthology.orchestra.run.smithi092.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-11T00:07:37.014 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-11T00:07:37.020 INFO:teuthology.task.internal:Configuring sudo... 2024-09-11T00:07:37.021 DEBUG:teuthology.orchestra.run.smithi092:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-11T00:07:37.024 DEBUG:teuthology.orchestra.run.smithi145:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-11T00:07:37.084 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-11T00:07:37.093 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-11T00:07:37.093 DEBUG:teuthology.orchestra.run.smithi092:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-11T00:07:37.096 DEBUG:teuthology.orchestra.run.smithi145:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-11T00:07:37.130 DEBUG:teuthology.orchestra.run.smithi092:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-11T00:07:37.245 DEBUG:teuthology.orchestra.run.smithi092:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-11T00:07:37.321 DEBUG:teuthology.orchestra.run.smithi092:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-11T00:07:37.370 DEBUG:teuthology.orchestra.run.smithi092:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-11T00:07:37.403 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2024-09-11T00:07:37.403 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-11T00:07:37.468 DEBUG:teuthology.orchestra.run.smithi145:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-11T00:07:37.521 DEBUG:teuthology.orchestra.run.smithi145:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-11T00:07:37.566 DEBUG:teuthology.orchestra.run.smithi145:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-11T00:07:37.660 DEBUG:teuthology.orchestra.run.smithi145:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-11T00:07:37.696 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2024-09-11T00:07:37.696 DEBUG:teuthology.orchestra.run.smithi145:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-11T00:07:37.763 DEBUG:teuthology.orchestra.run.smithi092:> sudo service rsyslog restart 2024-09-11T00:07:37.766 DEBUG:teuthology.orchestra.run.smithi145:> sudo service rsyslog restart 2024-09-11T00:07:37.851 INFO:teuthology.orchestra.run.smithi145.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-11T00:07:37.925 INFO:teuthology.orchestra.run.smithi092.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-11T00:07:38.367 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-11T00:07:38.374 INFO:teuthology.task.internal:Starting timer... 2024-09-11T00:07:38.374 INFO:teuthology.run_tasks:Running task pcp... 2024-09-11T00:07:38.386 INFO:teuthology.run_tasks:Running task selinux... 2024-09-11T00:07:38.396 DEBUG:teuthology.orchestra.run.smithi092:> sudo service auditd rotate 2024-09-11T00:07:38.453 INFO:teuthology.orchestra.run.smithi092.stdout:Rotating logs: 2024-09-11T00:07:38.455 DEBUG:teuthology.orchestra.run.smithi145:> sudo service auditd rotate 2024-09-11T00:07:38.500 INFO:teuthology.orchestra.run.smithi145.stdout:Rotating logs: 2024-09-11T00:07:38.502 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-11T00:07:38.502 DEBUG:teuthology.orchestra.run.smithi092:> /usr/sbin/getenforce 2024-09-11T00:07:38.523 INFO:teuthology.orchestra.run.smithi092.stdout:Permissive 2024-09-11T00:07:38.523 DEBUG:teuthology.orchestra.run.smithi145:> /usr/sbin/getenforce 2024-09-11T00:07:38.572 INFO:teuthology.orchestra.run.smithi145.stdout:Permissive 2024-09-11T00:07:38.572 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi092.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi145.front.sepia.ceph.com': 'permissive'} 2024-09-11T00:07:38.572 DEBUG:teuthology.orchestra.run.smithi092:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-11T00:07:38.597 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T00:07:38.598 DEBUG:teuthology.orchestra.run.smithi145:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-11T00:07:38.640 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T00:07:38.641 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-11T00:07:38.641 DEBUG:teuthology.orchestra.run.smithi092:> sudo /usr/sbin/setenforce permissive 2024-09-11T00:07:38.676 DEBUG:teuthology.orchestra.run.smithi145:> sudo /usr/sbin/setenforce permissive 2024-09-11T00:07:38.715 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-11T00:07:38.731 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-09-11T00:07:38.735 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-09-11T00:07:38.873 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-11T00:07:38.885 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-11T00:07:38.886 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi092.front.sepia.ceph.com,smithi145.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-11T00:11:19.309 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi092.front.sepia.ceph.com'), Remote(name='ubuntu@smithi145.front.sepia.ceph.com')] 2024-09-11T00:11:19.311 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi092.front.sepia.ceph.com' 2024-09-11T00:11:19.312 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T00:11:19.397 DEBUG:teuthology.orchestra.run.smithi092:> true 2024-09-11T00:11:19.476 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi092.front.sepia.ceph.com' 2024-09-11T00:11:19.476 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi145.front.sepia.ceph.com' 2024-09-11T00:11:19.477 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T00:11:19.560 DEBUG:teuthology.orchestra.run.smithi145:> true 2024-09-11T00:11:19.598 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi145.front.sepia.ceph.com' 2024-09-11T00:11:19.598 INFO:teuthology.run_tasks:Running task clock... 2024-09-11T00:11:19.607 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-11T00:11:19.607 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-11T00:11:19.608 DEBUG:teuthology.orchestra.run.smithi092:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-11T00:11:19.610 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-11T00:11:19.610 DEBUG:teuthology.orchestra.run.smithi145:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-11T00:11:19.637 INFO:teuthology.orchestra.run.smithi092.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-11T00:11:19.652 INFO:teuthology.orchestra.run.smithi092.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-11T00:11:19.668 INFO:teuthology.orchestra.run.smithi145.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-11T00:11:19.675 INFO:teuthology.orchestra.run.smithi092.stderr:sudo: ntpd: command not found 2024-09-11T00:11:19.683 INFO:teuthology.orchestra.run.smithi145.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-11T00:11:19.686 INFO:teuthology.orchestra.run.smithi092.stdout:506 Cannot talk to daemon 2024-09-11T00:11:19.701 INFO:teuthology.orchestra.run.smithi092.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-11T00:11:19.708 INFO:teuthology.orchestra.run.smithi145.stderr:sudo: ntpd: command not found 2024-09-11T00:11:19.715 INFO:teuthology.orchestra.run.smithi092.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-11T00:11:19.720 INFO:teuthology.orchestra.run.smithi145.stdout:506 Cannot talk to daemon 2024-09-11T00:11:19.734 INFO:teuthology.orchestra.run.smithi145.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-11T00:11:19.748 INFO:teuthology.orchestra.run.smithi145.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-11T00:11:19.776 INFO:teuthology.orchestra.run.smithi092.stderr:bash: line 1: ntpq: command not found 2024-09-11T00:11:19.780 INFO:teuthology.orchestra.run.smithi092.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-11T00:11:19.780 INFO:teuthology.orchestra.run.smithi092.stdout:=============================================================================== 2024-09-11T00:11:19.780 INFO:teuthology.orchestra.run.smithi092.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T00:11:19.780 INFO:teuthology.orchestra.run.smithi092.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T00:11:19.780 INFO:teuthology.orchestra.run.smithi092.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T00:11:19.780 INFO:teuthology.orchestra.run.smithi092.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T00:11:19.810 INFO:teuthology.orchestra.run.smithi145.stderr:bash: line 1: ntpq: command not found 2024-09-11T00:11:19.814 INFO:teuthology.orchestra.run.smithi145.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-11T00:11:19.814 INFO:teuthology.orchestra.run.smithi145.stdout:=============================================================================== 2024-09-11T00:11:19.814 INFO:teuthology.orchestra.run.smithi145.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T00:11:19.814 INFO:teuthology.orchestra.run.smithi145.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T00:11:19.815 INFO:teuthology.orchestra.run.smithi145.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T00:11:19.815 INFO:teuthology.orchestra.run.smithi145.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T00:11:19.815 INFO:teuthology.run_tasks:Running task install... 2024-09-11T00:11:19.822 DEBUG:teuthology.task.install:project ceph 2024-09-11T00:11:19.823 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '8f219c476cb4f26fc5719c661c0323719a45cb30'}} 2024-09-11T00:11:19.823 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '8f219c476cb4f26fc5719c661c0323719a45cb30'} 2024-09-11T00:11:19.823 INFO:teuthology.task.install:Using flavor: default 2024-09-11T00:11:19.828 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-11T00:11:19.828 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-09-11T00:11:19.829 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '8f219c476cb4f26fc5719c661c0323719a45cb30', 'tag': None, 'wait_for_package': False} 2024-09-11T00:11:19.829 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8f219c476cb4f26fc5719c661c0323719a45cb30 2024-09-11T00:11:19.832 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '8f219c476cb4f26fc5719c661c0323719a45cb30', 'tag': None, 'wait_for_package': False} 2024-09-11T00:11:19.832 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8f219c476cb4f26fc5719c661c0323719a45cb30 2024-09-11T00:11:19.979 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/flavors/default/ 2024-09-11T00:11:19.980 INFO:teuthology.task.install.rpm:Package version is 19.3.0-4854.g8f219c47 2024-09-11T00:11:19.991 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/flavors/default/ 2024-09-11T00:11:19.992 INFO:teuthology.task.install.rpm:Package version is 19.3.0-4854.g8f219c47 2024-09-11T00:11:20.098 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-11T00:11:20.098 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2024-09-11T00:11:20.098 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-11T00:11:20.108 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-11T00:11:20.108 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2024-09-11T00:11:20.108 DEBUG:teuthology.orchestra.run.smithi145:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-11T00:11:20.124 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-11T00:11:20.125 DEBUG:teuthology.orchestra.run.smithi092:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/8f219c476cb4f26fc5719c661c0323719a45cb30/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-11T00:11:20.134 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-11T00:11:20.134 DEBUG:teuthology.orchestra.run.smithi145:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/8f219c476cb4f26fc5719c661c0323719a45cb30/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-11T00:11:20.191 DEBUG:teuthology.orchestra.run.smithi092:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-11T00:11:20.200 DEBUG:teuthology.orchestra.run.smithi145:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-11T00:11:20.266 DEBUG:teuthology.orchestra.run.smithi092:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-11T00:11:20.274 DEBUG:teuthology.orchestra.run.smithi145:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-11T00:11:20.330 INFO:teuthology.orchestra.run.smithi092.stdout:check_obsoletes = 1 2024-09-11T00:11:20.332 DEBUG:teuthology.orchestra.run.smithi092:> sudo yum clean all 2024-09-11T00:11:20.338 INFO:teuthology.orchestra.run.smithi145.stdout:check_obsoletes = 1 2024-09-11T00:11:20.340 DEBUG:teuthology.orchestra.run.smithi145:> sudo yum clean all 2024-09-11T00:11:20.557 INFO:teuthology.orchestra.run.smithi092.stdout:45 files removed 2024-09-11T00:11:20.566 INFO:teuthology.orchestra.run.smithi145.stdout:45 files removed 2024-09-11T00:11:20.584 DEBUG:teuthology.orchestra.run.smithi092:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-11T00:11:20.593 DEBUG:teuthology.orchestra.run.smithi145:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-11T00:11:21.141 INFO:teuthology.orchestra.run.smithi092.stdout:ceph packages for x86_64 309 kB/s | 84 kB 00:00 2024-09-11T00:11:21.151 INFO:teuthology.orchestra.run.smithi145.stdout:ceph packages for x86_64 308 kB/s | 84 kB 00:00 2024-09-11T00:11:21.433 INFO:teuthology.orchestra.run.smithi092.stdout:ceph noarch packages 97 kB/s | 24 kB 00:00 2024-09-11T00:11:21.443 INFO:teuthology.orchestra.run.smithi145.stdout:ceph noarch packages 97 kB/s | 24 kB 00:00 2024-09-11T00:11:21.701 INFO:teuthology.orchestra.run.smithi092.stdout:ceph source packages 8.4 kB/s | 1.9 kB 00:00 2024-09-11T00:11:21.710 INFO:teuthology.orchestra.run.smithi145.stdout:ceph source packages 8.4 kB/s | 1.9 kB 00:00 2024-09-11T00:11:22.969 INFO:teuthology.orchestra.run.smithi145.stdout:CentOS Stream 9 - BaseOS 6.7 MB/s | 8.2 MB 00:01 2024-09-11T00:11:23.618 INFO:teuthology.orchestra.run.smithi092.stdout:CentOS Stream 9 - BaseOS 4.4 MB/s | 8.2 MB 00:01 2024-09-11T00:11:26.260 INFO:teuthology.orchestra.run.smithi092.stdout:CentOS Stream 9 - AppStream 13 MB/s | 20 MB 00:01 2024-09-11T00:11:26.454 INFO:teuthology.orchestra.run.smithi145.stdout:CentOS Stream 9 - AppStream 8.6 MB/s | 20 MB 00:02 2024-09-11T00:11:30.511 INFO:teuthology.orchestra.run.smithi092.stdout:CentOS Stream 9 - CRB 16 MB/s | 6.5 MB 00:00 2024-09-11T00:11:30.663 INFO:teuthology.orchestra.run.smithi145.stdout:CentOS Stream 9 - CRB 16 MB/s | 6.5 MB 00:00 2024-09-11T00:11:31.928 INFO:teuthology.orchestra.run.smithi092.stdout:CentOS Stream 9 - Extras packages 95 kB/s | 19 kB 00:00 2024-09-11T00:11:32.597 INFO:teuthology.orchestra.run.smithi145.stdout:CentOS Stream 9 - Extras packages 32 kB/s | 19 kB 00:00 2024-09-11T00:11:32.941 INFO:teuthology.orchestra.run.smithi092.stdout:Extra Packages for Enterprise Linux 25 MB/s | 23 MB 00:00 2024-09-11T00:11:33.401 INFO:teuthology.orchestra.run.smithi145.stdout:Extra Packages for Enterprise Linux 33 MB/s | 23 MB 00:00 2024-09-11T00:11:38.413 INFO:teuthology.orchestra.run.smithi092.stdout:lab-extras 41 kB/s | 1.7 kB 00:00 2024-09-11T00:11:38.873 INFO:teuthology.orchestra.run.smithi145.stdout:lab-extras 40 kB/s | 1.7 kB 00:00 2024-09-11T00:11:40.759 INFO:teuthology.orchestra.run.smithi092.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-11T00:11:40.760 INFO:teuthology.orchestra.run.smithi092.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-11T00:11:40.773 INFO:teuthology.orchestra.run.smithi092.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-11T00:11:40.774 INFO:teuthology.orchestra.run.smithi092.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-11T00:11:40.775 INFO:teuthology.orchestra.run.smithi092.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-11T00:11:40.776 INFO:teuthology.orchestra.run.smithi092.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-11T00:11:40.778 INFO:teuthology.orchestra.run.smithi092.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-11T00:11:40.781 INFO:teuthology.orchestra.run.smithi092.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-11T00:11:40.782 INFO:teuthology.orchestra.run.smithi092.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-11T00:11:40.846 INFO:teuthology.orchestra.run.smithi092.stdout:Dependencies resolved. 2024-09-11T00:11:40.864 INFO:teuthology.orchestra.run.smithi092.stdout:======================================================================================= 2024-09-11T00:11:40.864 INFO:teuthology.orchestra.run.smithi092.stdout: Package Arch Version Repository Size 2024-09-11T00:11:40.864 INFO:teuthology.orchestra.run.smithi092.stdout:======================================================================================= 2024-09-11T00:11:40.864 INFO:teuthology.orchestra.run.smithi092.stdout:Installing: 2024-09-11T00:11:40.865 INFO:teuthology.orchestra.run.smithi092.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-11T00:11:40.865 INFO:teuthology.orchestra.run.smithi092.stdout: ceph x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 6.6 k 2024-09-11T00:11:40.865 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-base x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 5.5 M 2024-09-11T00:11:40.865 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-fuse x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 900 k 2024-09-11T00:11:40.865 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 145 k 2024-09-11T00:11:40.865 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mgr x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 1.5 M 2024-09-11T00:11:40.865 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mgr-cephadm noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 154 k 2024-09-11T00:11:40.865 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mgr-dashboard noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 14 M 2024-09-11T00:11:40.865 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 7.4 M 2024-09-11T00:11:40.865 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mgr-rook noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 49 k 2024-09-11T00:11:40.865 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-radosgw x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 11 M 2024-09-11T00:11:40.865 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-test x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 50 M 2024-09-11T00:11:40.866 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-volume noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 285 k 2024-09-11T00:11:40.866 INFO:teuthology.orchestra.run.smithi092.stdout: cephadm noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 783 k 2024-09-11T00:11:40.866 INFO:teuthology.orchestra.run.smithi092.stdout: cephfs-mirror x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 225 k 2024-09-11T00:11:40.866 INFO:teuthology.orchestra.run.smithi092.stdout: cephfs-shell x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 27 k 2024-09-11T00:11:40.866 INFO:teuthology.orchestra.run.smithi092.stdout: cephfs-top noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 18 k 2024-09-11T00:11:40.866 INFO:teuthology.orchestra.run.smithi092.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-11T00:11:40.866 INFO:teuthology.orchestra.run.smithi092.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-11T00:11:40.866 INFO:teuthology.orchestra.run.smithi092.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-11T00:11:40.866 INFO:teuthology.orchestra.run.smithi092.stdout: libcephfs-devel x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 32 k 2024-09-11T00:11:40.866 INFO:teuthology.orchestra.run.smithi092.stdout: libcephfs2 x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 755 k 2024-09-11T00:11:40.866 INFO:teuthology.orchestra.run.smithi092.stdout: librados-devel x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 127 k 2024-09-11T00:11:40.866 INFO:teuthology.orchestra.run.smithi092.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-11T00:11:40.866 INFO:teuthology.orchestra.run.smithi092.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-11T00:11:40.867 INFO:teuthology.orchestra.run.smithi092.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-11T00:11:40.867 INFO:teuthology.orchestra.run.smithi092.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-11T00:11:40.867 INFO:teuthology.orchestra.run.smithi092.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-11T00:11:40.867 INFO:teuthology.orchestra.run.smithi092.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-11T00:11:40.867 INFO:teuthology.orchestra.run.smithi092.stdout: python3-cephfs x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 161 k 2024-09-11T00:11:40.867 INFO:teuthology.orchestra.run.smithi092.stdout: python3-rados x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 321 k 2024-09-11T00:11:40.867 INFO:teuthology.orchestra.run.smithi092.stdout: python3-rbd x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 306 k 2024-09-11T00:11:40.867 INFO:teuthology.orchestra.run.smithi092.stdout: python3-rgw x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 99 k 2024-09-11T00:11:40.867 INFO:teuthology.orchestra.run.smithi092.stdout: rbd-fuse x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 85 k 2024-09-11T00:11:40.867 INFO:teuthology.orchestra.run.smithi092.stdout: rbd-mirror x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 3.2 M 2024-09-11T00:11:40.867 INFO:teuthology.orchestra.run.smithi092.stdout: rbd-nbd x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 171 k 2024-09-11T00:11:40.867 INFO:teuthology.orchestra.run.smithi092.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-11T00:11:40.868 INFO:teuthology.orchestra.run.smithi092.stdout:Upgrading: 2024-09-11T00:11:40.868 INFO:teuthology.orchestra.run.smithi092.stdout: NetworkManager x86_64 1:1.49.90-1.el9 baseos 2.3 M 2024-09-11T00:11:40.868 INFO:teuthology.orchestra.run.smithi092.stdout: NetworkManager-libnm x86_64 1:1.49.90-1.el9 baseos 1.8 M 2024-09-11T00:11:40.868 INFO:teuthology.orchestra.run.smithi092.stdout: NetworkManager-team x86_64 1:1.49.90-1.el9 baseos 41 k 2024-09-11T00:11:40.868 INFO:teuthology.orchestra.run.smithi092.stdout: NetworkManager-tui x86_64 1:1.49.90-1.el9 baseos 249 k 2024-09-11T00:11:40.868 INFO:teuthology.orchestra.run.smithi092.stdout: librados2 x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 3.5 M 2024-09-11T00:11:40.868 INFO:teuthology.orchestra.run.smithi092.stdout: librbd1 x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 3.2 M 2024-09-11T00:11:40.868 INFO:teuthology.orchestra.run.smithi092.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-11T00:11:40.868 INFO:teuthology.orchestra.run.smithi092.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-11T00:11:40.868 INFO:teuthology.orchestra.run.smithi092.stdout:Installing dependencies: 2024-09-11T00:11:40.868 INFO:teuthology.orchestra.run.smithi092.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-11T00:11:40.868 INFO:teuthology.orchestra.run.smithi092.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-11T00:11:40.868 INFO:teuthology.orchestra.run.smithi092.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-11T00:11:40.869 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-common x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 22 M 2024-09-11T00:11:40.869 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-grafana-dashboards noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 34 k 2024-09-11T00:11:40.869 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mds x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 2.4 M 2024-09-11T00:11:40.869 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mgr-modules-core noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 291 k 2024-09-11T00:11:40.869 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mon x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 4.8 M 2024-09-11T00:11:40.869 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-osd x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 17 M 2024-09-11T00:11:40.869 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-prometheus-alerts noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 16 k 2024-09-11T00:11:40.869 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-selinux x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 25 k 2024-09-11T00:11:40.869 INFO:teuthology.orchestra.run.smithi092.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-11T00:11:40.869 INFO:teuthology.orchestra.run.smithi092.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-11T00:11:40.869 INFO:teuthology.orchestra.run.smithi092.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-11T00:11:40.869 INFO:teuthology.orchestra.run.smithi092.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-11T00:11:40.870 INFO:teuthology.orchestra.run.smithi092.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-09-11T00:11:40.870 INFO:teuthology.orchestra.run.smithi092.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-11T00:11:40.870 INFO:teuthology.orchestra.run.smithi092.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-11T00:11:40.870 INFO:teuthology.orchestra.run.smithi092.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-11T00:11:40.870 INFO:teuthology.orchestra.run.smithi092.stdout: libcephsqlite x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 162 k 2024-09-11T00:11:40.870 INFO:teuthology.orchestra.run.smithi092.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-11T00:11:40.870 INFO:teuthology.orchestra.run.smithi092.stdout: libnbd x86_64 1.20.2-2.el9 appstream 171 k 2024-09-11T00:11:40.870 INFO:teuthology.orchestra.run.smithi092.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-11T00:11:40.870 INFO:teuthology.orchestra.run.smithi092.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-11T00:11:40.870 INFO:teuthology.orchestra.run.smithi092.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-11T00:11:40.870 INFO:teuthology.orchestra.run.smithi092.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-11T00:11:40.870 INFO:teuthology.orchestra.run.smithi092.stdout: libradosstriper1 x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 507 k 2024-09-11T00:11:40.870 INFO:teuthology.orchestra.run.smithi092.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-11T00:11:40.871 INFO:teuthology.orchestra.run.smithi092.stdout: librgw2 x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 5.5 M 2024-09-11T00:11:40.871 INFO:teuthology.orchestra.run.smithi092.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-11T00:11:40.871 INFO:teuthology.orchestra.run.smithi092.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-11T00:11:40.871 INFO:teuthology.orchestra.run.smithi092.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-11T00:11:40.871 INFO:teuthology.orchestra.run.smithi092.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-11T00:11:40.871 INFO:teuthology.orchestra.run.smithi092.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-11T00:11:40.871 INFO:teuthology.orchestra.run.smithi092.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-11T00:11:40.871 INFO:teuthology.orchestra.run.smithi092.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-11T00:11:40.871 INFO:teuthology.orchestra.run.smithi092.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-11T00:11:40.871 INFO:teuthology.orchestra.run.smithi092.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-11T00:11:40.871 INFO:teuthology.orchestra.run.smithi092.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-11T00:11:40.871 INFO:teuthology.orchestra.run.smithi092.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-11T00:11:40.872 INFO:teuthology.orchestra.run.smithi092.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-11T00:11:40.872 INFO:teuthology.orchestra.run.smithi092.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-11T00:11:40.872 INFO:teuthology.orchestra.run.smithi092.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-11T00:11:40.872 INFO:teuthology.orchestra.run.smithi092.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-11T00:11:40.872 INFO:teuthology.orchestra.run.smithi092.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-11T00:11:40.872 INFO:teuthology.orchestra.run.smithi092.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-11T00:11:40.872 INFO:teuthology.orchestra.run.smithi092.stdout: python3-ceph-argparse x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 45 k 2024-09-11T00:11:40.872 INFO:teuthology.orchestra.run.smithi092.stdout: python3-ceph-common x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 143 k 2024-09-11T00:11:40.872 INFO:teuthology.orchestra.run.smithi092.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-11T00:11:40.872 INFO:teuthology.orchestra.run.smithi092.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-11T00:11:40.872 INFO:teuthology.orchestra.run.smithi092.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-11T00:11:40.872 INFO:teuthology.orchestra.run.smithi092.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-11T00:11:40.872 INFO:teuthology.orchestra.run.smithi092.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-11T00:11:40.872 INFO:teuthology.orchestra.run.smithi092.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-11T00:11:40.873 INFO:teuthology.orchestra.run.smithi092.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-11T00:11:40.873 INFO:teuthology.orchestra.run.smithi092.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-11T00:11:40.873 INFO:teuthology.orchestra.run.smithi092.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-11T00:11:40.873 INFO:teuthology.orchestra.run.smithi092.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-11T00:11:40.873 INFO:teuthology.orchestra.run.smithi092.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-11T00:11:40.873 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-11T00:11:40.873 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-11T00:11:40.873 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-11T00:11:40.873 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-11T00:11:40.873 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-11T00:11:40.873 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-11T00:11:40.874 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-11T00:11:40.874 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-11T00:11:40.874 INFO:teuthology.orchestra.run.smithi092.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-11T00:11:40.874 INFO:teuthology.orchestra.run.smithi092.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-11T00:11:40.874 INFO:teuthology.orchestra.run.smithi092.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-11T00:11:40.874 INFO:teuthology.orchestra.run.smithi092.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-11T00:11:40.874 INFO:teuthology.orchestra.run.smithi092.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-11T00:11:40.874 INFO:teuthology.orchestra.run.smithi092.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-11T00:11:40.874 INFO:teuthology.orchestra.run.smithi092.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-11T00:11:40.874 INFO:teuthology.orchestra.run.smithi092.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-11T00:11:40.874 INFO:teuthology.orchestra.run.smithi092.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-11T00:11:40.874 INFO:teuthology.orchestra.run.smithi092.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-11T00:11:40.874 INFO:teuthology.orchestra.run.smithi092.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-11T00:11:40.875 INFO:teuthology.orchestra.run.smithi092.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-11T00:11:40.875 INFO:teuthology.orchestra.run.smithi092.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-11T00:11:40.875 INFO:teuthology.orchestra.run.smithi092.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-11T00:11:40.875 INFO:teuthology.orchestra.run.smithi092.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-11T00:11:40.875 INFO:teuthology.orchestra.run.smithi092.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-11T00:11:40.875 INFO:teuthology.orchestra.run.smithi092.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-11T00:11:40.875 INFO:teuthology.orchestra.run.smithi092.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-11T00:11:40.875 INFO:teuthology.orchestra.run.smithi092.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-11T00:11:40.875 INFO:teuthology.orchestra.run.smithi092.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-11T00:11:40.875 INFO:teuthology.orchestra.run.smithi092.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-11T00:11:40.875 INFO:teuthology.orchestra.run.smithi092.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-11T00:11:40.875 INFO:teuthology.orchestra.run.smithi092.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-11T00:11:40.875 INFO:teuthology.orchestra.run.smithi092.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-11T00:11:40.876 INFO:teuthology.orchestra.run.smithi092.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-11T00:11:40.876 INFO:teuthology.orchestra.run.smithi092.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-11T00:11:40.876 INFO:teuthology.orchestra.run.smithi092.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-11T00:11:40.876 INFO:teuthology.orchestra.run.smithi092.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-11T00:11:40.876 INFO:teuthology.orchestra.run.smithi092.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-11T00:11:40.876 INFO:teuthology.orchestra.run.smithi092.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-11T00:11:40.876 INFO:teuthology.orchestra.run.smithi092.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-11T00:11:40.876 INFO:teuthology.orchestra.run.smithi092.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-11T00:11:40.876 INFO:teuthology.orchestra.run.smithi092.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-11T00:11:40.876 INFO:teuthology.orchestra.run.smithi092.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-11T00:11:40.876 INFO:teuthology.orchestra.run.smithi092.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-11T00:11:40.876 INFO:teuthology.orchestra.run.smithi092.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-11T00:11:40.876 INFO:teuthology.orchestra.run.smithi092.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-11T00:11:40.876 INFO:teuthology.orchestra.run.smithi092.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-11T00:11:40.877 INFO:teuthology.orchestra.run.smithi092.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-11T00:11:40.877 INFO:teuthology.orchestra.run.smithi092.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-11T00:11:40.877 INFO:teuthology.orchestra.run.smithi092.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-11T00:11:40.877 INFO:teuthology.orchestra.run.smithi092.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-11T00:11:40.877 INFO:teuthology.orchestra.run.smithi092.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-11T00:11:40.877 INFO:teuthology.orchestra.run.smithi092.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-11T00:11:40.877 INFO:teuthology.orchestra.run.smithi092.stdout:Installing weak dependencies: 2024-09-11T00:11:40.877 INFO:teuthology.orchestra.run.smithi092.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-11T00:11:40.877 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:11:40.877 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction Summary 2024-09-11T00:11:40.877 INFO:teuthology.orchestra.run.smithi092.stdout:======================================================================================= 2024-09-11T00:11:40.877 INFO:teuthology.orchestra.run.smithi092.stdout:Install 149 Packages 2024-09-11T00:11:40.877 INFO:teuthology.orchestra.run.smithi092.stdout:Upgrade 8 Packages 2024-09-11T00:11:40.878 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:11:40.878 INFO:teuthology.orchestra.run.smithi092.stdout:Total download size: 240 M 2024-09-11T00:11:40.878 INFO:teuthology.orchestra.run.smithi092.stdout:Downloading Packages: 2024-09-11T00:11:41.217 INFO:teuthology.orchestra.run.smithi145.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-11T00:11:41.217 INFO:teuthology.orchestra.run.smithi145.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-11T00:11:41.228 INFO:teuthology.orchestra.run.smithi145.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-11T00:11:41.229 INFO:teuthology.orchestra.run.smithi145.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-11T00:11:41.230 INFO:teuthology.orchestra.run.smithi145.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-11T00:11:41.231 INFO:teuthology.orchestra.run.smithi145.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-11T00:11:41.232 INFO:teuthology.orchestra.run.smithi145.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-11T00:11:41.235 INFO:teuthology.orchestra.run.smithi145.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-11T00:11:41.235 INFO:teuthology.orchestra.run.smithi145.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-11T00:11:41.297 INFO:teuthology.orchestra.run.smithi145.stdout:Dependencies resolved. 2024-09-11T00:11:41.317 INFO:teuthology.orchestra.run.smithi145.stdout:======================================================================================= 2024-09-11T00:11:41.317 INFO:teuthology.orchestra.run.smithi145.stdout: Package Arch Version Repository Size 2024-09-11T00:11:41.317 INFO:teuthology.orchestra.run.smithi145.stdout:======================================================================================= 2024-09-11T00:11:41.317 INFO:teuthology.orchestra.run.smithi145.stdout:Installing: 2024-09-11T00:11:41.317 INFO:teuthology.orchestra.run.smithi145.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-11T00:11:41.317 INFO:teuthology.orchestra.run.smithi145.stdout: ceph x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 6.6 k 2024-09-11T00:11:41.317 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-base x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 5.5 M 2024-09-11T00:11:41.317 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-fuse x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 900 k 2024-09-11T00:11:41.317 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 145 k 2024-09-11T00:11:41.317 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-mgr x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 1.5 M 2024-09-11T00:11:41.317 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-mgr-cephadm noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 154 k 2024-09-11T00:11:41.317 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-mgr-dashboard noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 14 M 2024-09-11T00:11:41.318 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 7.4 M 2024-09-11T00:11:41.318 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-mgr-rook noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 49 k 2024-09-11T00:11:41.318 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-radosgw x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 11 M 2024-09-11T00:11:41.318 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-test x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 50 M 2024-09-11T00:11:41.318 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-volume noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 285 k 2024-09-11T00:11:41.318 INFO:teuthology.orchestra.run.smithi145.stdout: cephadm noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 783 k 2024-09-11T00:11:41.318 INFO:teuthology.orchestra.run.smithi145.stdout: cephfs-mirror x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 225 k 2024-09-11T00:11:41.318 INFO:teuthology.orchestra.run.smithi145.stdout: cephfs-shell x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 27 k 2024-09-11T00:11:41.318 INFO:teuthology.orchestra.run.smithi145.stdout: cephfs-top noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 18 k 2024-09-11T00:11:41.318 INFO:teuthology.orchestra.run.smithi145.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-11T00:11:41.318 INFO:teuthology.orchestra.run.smithi145.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-11T00:11:41.318 INFO:teuthology.orchestra.run.smithi145.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-11T00:11:41.318 INFO:teuthology.orchestra.run.smithi145.stdout: libcephfs-devel x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 32 k 2024-09-11T00:11:41.318 INFO:teuthology.orchestra.run.smithi145.stdout: libcephfs2 x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 755 k 2024-09-11T00:11:41.319 INFO:teuthology.orchestra.run.smithi145.stdout: librados-devel x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 127 k 2024-09-11T00:11:41.319 INFO:teuthology.orchestra.run.smithi145.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-11T00:11:41.319 INFO:teuthology.orchestra.run.smithi145.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-11T00:11:41.319 INFO:teuthology.orchestra.run.smithi145.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-11T00:11:41.319 INFO:teuthology.orchestra.run.smithi145.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-11T00:11:41.319 INFO:teuthology.orchestra.run.smithi145.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-11T00:11:41.319 INFO:teuthology.orchestra.run.smithi145.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-11T00:11:41.319 INFO:teuthology.orchestra.run.smithi145.stdout: python3-cephfs x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 161 k 2024-09-11T00:11:41.319 INFO:teuthology.orchestra.run.smithi145.stdout: python3-rados x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 321 k 2024-09-11T00:11:41.319 INFO:teuthology.orchestra.run.smithi145.stdout: python3-rbd x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 306 k 2024-09-11T00:11:41.319 INFO:teuthology.orchestra.run.smithi145.stdout: python3-rgw x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 99 k 2024-09-11T00:11:41.319 INFO:teuthology.orchestra.run.smithi145.stdout: rbd-fuse x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 85 k 2024-09-11T00:11:41.319 INFO:teuthology.orchestra.run.smithi145.stdout: rbd-mirror x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 3.2 M 2024-09-11T00:11:41.320 INFO:teuthology.orchestra.run.smithi145.stdout: rbd-nbd x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 171 k 2024-09-11T00:11:41.320 INFO:teuthology.orchestra.run.smithi145.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-11T00:11:41.320 INFO:teuthology.orchestra.run.smithi145.stdout:Upgrading: 2024-09-11T00:11:41.320 INFO:teuthology.orchestra.run.smithi145.stdout: NetworkManager x86_64 1:1.49.90-1.el9 baseos 2.3 M 2024-09-11T00:11:41.320 INFO:teuthology.orchestra.run.smithi145.stdout: NetworkManager-libnm x86_64 1:1.49.90-1.el9 baseos 1.8 M 2024-09-11T00:11:41.320 INFO:teuthology.orchestra.run.smithi145.stdout: NetworkManager-team x86_64 1:1.49.90-1.el9 baseos 41 k 2024-09-11T00:11:41.320 INFO:teuthology.orchestra.run.smithi145.stdout: NetworkManager-tui x86_64 1:1.49.90-1.el9 baseos 249 k 2024-09-11T00:11:41.320 INFO:teuthology.orchestra.run.smithi145.stdout: librados2 x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 3.5 M 2024-09-11T00:11:41.320 INFO:teuthology.orchestra.run.smithi145.stdout: librbd1 x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 3.2 M 2024-09-11T00:11:41.320 INFO:teuthology.orchestra.run.smithi145.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-11T00:11:41.320 INFO:teuthology.orchestra.run.smithi145.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-11T00:11:41.320 INFO:teuthology.orchestra.run.smithi145.stdout:Installing dependencies: 2024-09-11T00:11:41.320 INFO:teuthology.orchestra.run.smithi145.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-11T00:11:41.321 INFO:teuthology.orchestra.run.smithi145.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-11T00:11:41.321 INFO:teuthology.orchestra.run.smithi145.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-11T00:11:41.321 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-common x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 22 M 2024-09-11T00:11:41.321 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-grafana-dashboards noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 34 k 2024-09-11T00:11:41.321 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-mds x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 2.4 M 2024-09-11T00:11:41.321 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-mgr-modules-core noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 291 k 2024-09-11T00:11:41.321 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-mon x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 4.8 M 2024-09-11T00:11:41.321 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-osd x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 17 M 2024-09-11T00:11:41.321 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-prometheus-alerts noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 16 k 2024-09-11T00:11:41.321 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-selinux x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 25 k 2024-09-11T00:11:41.321 INFO:teuthology.orchestra.run.smithi145.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-11T00:11:41.321 INFO:teuthology.orchestra.run.smithi145.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-11T00:11:41.322 INFO:teuthology.orchestra.run.smithi145.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-11T00:11:41.322 INFO:teuthology.orchestra.run.smithi145.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-11T00:11:41.322 INFO:teuthology.orchestra.run.smithi145.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-09-11T00:11:41.322 INFO:teuthology.orchestra.run.smithi145.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-11T00:11:41.322 INFO:teuthology.orchestra.run.smithi145.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-11T00:11:41.322 INFO:teuthology.orchestra.run.smithi145.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-11T00:11:41.322 INFO:teuthology.orchestra.run.smithi145.stdout: libcephsqlite x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 162 k 2024-09-11T00:11:41.322 INFO:teuthology.orchestra.run.smithi145.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-11T00:11:41.322 INFO:teuthology.orchestra.run.smithi145.stdout: libnbd x86_64 1.20.2-2.el9 appstream 171 k 2024-09-11T00:11:41.322 INFO:teuthology.orchestra.run.smithi145.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-11T00:11:41.322 INFO:teuthology.orchestra.run.smithi145.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-11T00:11:41.322 INFO:teuthology.orchestra.run.smithi145.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-11T00:11:41.322 INFO:teuthology.orchestra.run.smithi145.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-11T00:11:41.322 INFO:teuthology.orchestra.run.smithi145.stdout: libradosstriper1 x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 507 k 2024-09-11T00:11:41.323 INFO:teuthology.orchestra.run.smithi145.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-11T00:11:41.323 INFO:teuthology.orchestra.run.smithi145.stdout: librgw2 x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 5.5 M 2024-09-11T00:11:41.323 INFO:teuthology.orchestra.run.smithi145.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-11T00:11:41.323 INFO:teuthology.orchestra.run.smithi145.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-11T00:11:41.323 INFO:teuthology.orchestra.run.smithi145.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-11T00:11:41.323 INFO:teuthology.orchestra.run.smithi145.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-11T00:11:41.323 INFO:teuthology.orchestra.run.smithi145.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-11T00:11:41.323 INFO:teuthology.orchestra.run.smithi145.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-11T00:11:41.323 INFO:teuthology.orchestra.run.smithi145.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-11T00:11:41.324 INFO:teuthology.orchestra.run.smithi145.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-11T00:11:41.324 INFO:teuthology.orchestra.run.smithi145.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-11T00:11:41.324 INFO:teuthology.orchestra.run.smithi145.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-11T00:11:41.324 INFO:teuthology.orchestra.run.smithi145.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-11T00:11:41.324 INFO:teuthology.orchestra.run.smithi145.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-11T00:11:41.324 INFO:teuthology.orchestra.run.smithi145.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-11T00:11:41.324 INFO:teuthology.orchestra.run.smithi145.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-11T00:11:41.324 INFO:teuthology.orchestra.run.smithi145.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-11T00:11:41.324 INFO:teuthology.orchestra.run.smithi145.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-11T00:11:41.324 INFO:teuthology.orchestra.run.smithi145.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-11T00:11:41.324 INFO:teuthology.orchestra.run.smithi145.stdout: python3-ceph-argparse x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 45 k 2024-09-11T00:11:41.324 INFO:teuthology.orchestra.run.smithi145.stdout: python3-ceph-common x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 143 k 2024-09-11T00:11:41.324 INFO:teuthology.orchestra.run.smithi145.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-11T00:11:41.325 INFO:teuthology.orchestra.run.smithi145.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-11T00:11:41.325 INFO:teuthology.orchestra.run.smithi145.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-11T00:11:41.325 INFO:teuthology.orchestra.run.smithi145.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-11T00:11:41.325 INFO:teuthology.orchestra.run.smithi145.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-11T00:11:41.325 INFO:teuthology.orchestra.run.smithi145.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-11T00:11:41.325 INFO:teuthology.orchestra.run.smithi145.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-11T00:11:41.325 INFO:teuthology.orchestra.run.smithi145.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-11T00:11:41.325 INFO:teuthology.orchestra.run.smithi145.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-11T00:11:41.325 INFO:teuthology.orchestra.run.smithi145.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-11T00:11:41.325 INFO:teuthology.orchestra.run.smithi145.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-11T00:11:41.325 INFO:teuthology.orchestra.run.smithi145.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-11T00:11:41.325 INFO:teuthology.orchestra.run.smithi145.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-11T00:11:41.325 INFO:teuthology.orchestra.run.smithi145.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-11T00:11:41.326 INFO:teuthology.orchestra.run.smithi145.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-11T00:11:41.326 INFO:teuthology.orchestra.run.smithi145.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-11T00:11:41.326 INFO:teuthology.orchestra.run.smithi145.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-11T00:11:41.326 INFO:teuthology.orchestra.run.smithi145.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-11T00:11:41.326 INFO:teuthology.orchestra.run.smithi145.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-11T00:11:41.326 INFO:teuthology.orchestra.run.smithi145.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-11T00:11:41.326 INFO:teuthology.orchestra.run.smithi145.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-11T00:11:41.326 INFO:teuthology.orchestra.run.smithi145.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-11T00:11:41.326 INFO:teuthology.orchestra.run.smithi145.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-11T00:11:41.326 INFO:teuthology.orchestra.run.smithi145.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-11T00:11:41.326 INFO:teuthology.orchestra.run.smithi145.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-11T00:11:41.326 INFO:teuthology.orchestra.run.smithi145.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-11T00:11:41.326 INFO:teuthology.orchestra.run.smithi145.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-11T00:11:41.326 INFO:teuthology.orchestra.run.smithi145.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-11T00:11:41.327 INFO:teuthology.orchestra.run.smithi145.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-11T00:11:41.327 INFO:teuthology.orchestra.run.smithi145.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-11T00:11:41.327 INFO:teuthology.orchestra.run.smithi145.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-11T00:11:41.327 INFO:teuthology.orchestra.run.smithi145.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-11T00:11:41.327 INFO:teuthology.orchestra.run.smithi145.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-11T00:11:41.327 INFO:teuthology.orchestra.run.smithi145.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-11T00:11:41.327 INFO:teuthology.orchestra.run.smithi145.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-11T00:11:41.327 INFO:teuthology.orchestra.run.smithi145.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-11T00:11:41.327 INFO:teuthology.orchestra.run.smithi145.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-11T00:11:41.327 INFO:teuthology.orchestra.run.smithi145.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-11T00:11:41.327 INFO:teuthology.orchestra.run.smithi145.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-11T00:11:41.327 INFO:teuthology.orchestra.run.smithi145.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-11T00:11:41.327 INFO:teuthology.orchestra.run.smithi145.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-11T00:11:41.327 INFO:teuthology.orchestra.run.smithi145.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-11T00:11:41.328 INFO:teuthology.orchestra.run.smithi145.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-11T00:11:41.328 INFO:teuthology.orchestra.run.smithi145.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-11T00:11:41.328 INFO:teuthology.orchestra.run.smithi145.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-11T00:11:41.328 INFO:teuthology.orchestra.run.smithi145.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-11T00:11:41.328 INFO:teuthology.orchestra.run.smithi145.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-11T00:11:41.328 INFO:teuthology.orchestra.run.smithi145.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-11T00:11:41.328 INFO:teuthology.orchestra.run.smithi145.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-11T00:11:41.328 INFO:teuthology.orchestra.run.smithi145.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-11T00:11:41.328 INFO:teuthology.orchestra.run.smithi145.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-11T00:11:41.328 INFO:teuthology.orchestra.run.smithi145.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-11T00:11:41.328 INFO:teuthology.orchestra.run.smithi145.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-11T00:11:41.328 INFO:teuthology.orchestra.run.smithi145.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-11T00:11:41.328 INFO:teuthology.orchestra.run.smithi145.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-11T00:11:41.329 INFO:teuthology.orchestra.run.smithi145.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-11T00:11:41.329 INFO:teuthology.orchestra.run.smithi145.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-11T00:11:41.329 INFO:teuthology.orchestra.run.smithi145.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-11T00:11:41.329 INFO:teuthology.orchestra.run.smithi145.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-11T00:11:41.329 INFO:teuthology.orchestra.run.smithi145.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-11T00:11:41.329 INFO:teuthology.orchestra.run.smithi145.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-11T00:11:41.329 INFO:teuthology.orchestra.run.smithi145.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-11T00:11:41.329 INFO:teuthology.orchestra.run.smithi145.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-11T00:11:41.329 INFO:teuthology.orchestra.run.smithi145.stdout:Installing weak dependencies: 2024-09-11T00:11:41.329 INFO:teuthology.orchestra.run.smithi145.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-11T00:11:41.329 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-11T00:11:41.329 INFO:teuthology.orchestra.run.smithi145.stdout:Transaction Summary 2024-09-11T00:11:41.329 INFO:teuthology.orchestra.run.smithi145.stdout:======================================================================================= 2024-09-11T00:11:41.330 INFO:teuthology.orchestra.run.smithi145.stdout:Install 149 Packages 2024-09-11T00:11:41.330 INFO:teuthology.orchestra.run.smithi145.stdout:Upgrade 8 Packages 2024-09-11T00:11:41.330 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-11T00:11:41.330 INFO:teuthology.orchestra.run.smithi145.stdout:Total download size: 240 M 2024-09-11T00:11:41.330 INFO:teuthology.orchestra.run.smithi145.stdout:Downloading Packages: 2024-09-11T00:11:41.816 INFO:teuthology.orchestra.run.smithi145.stdout:(1/157): ceph-19.3.0-4854.g8f219c47.el9.x86_64. 35 kB/s | 6.6 kB 00:00 2024-09-11T00:11:41.847 INFO:teuthology.orchestra.run.smithi092.stdout:(1/157): ceph-19.3.0-4854.g8f219c47.el9.x86_64. 54 kB/s | 6.6 kB 00:00 2024-09-11T00:11:42.548 INFO:teuthology.orchestra.run.smithi092.stdout:(2/157): ceph-fuse-19.3.0-4854.g8f219c47.el9.x8 1.3 MB/s | 900 kB 00:00 2024-09-11T00:11:42.549 INFO:teuthology.orchestra.run.smithi145.stdout:(2/157): ceph-fuse-19.3.0-4854.g8f219c47.el9.x8 1.2 MB/s | 900 kB 00:00 2024-09-11T00:11:42.623 INFO:teuthology.orchestra.run.smithi092.stdout:(3/157): ceph-immutable-object-cache-19.3.0-485 1.9 MB/s | 145 kB 00:00 2024-09-11T00:11:42.625 INFO:teuthology.orchestra.run.smithi145.stdout:(3/157): ceph-immutable-object-cache-19.3.0-485 1.9 MB/s | 145 kB 00:00 2024-09-11T00:11:42.950 INFO:teuthology.orchestra.run.smithi145.stdout:(4/157): ceph-base-19.3.0-4854.g8f219c47.el9.x8 4.2 MB/s | 5.5 MB 00:01 2024-09-11T00:11:43.140 INFO:teuthology.orchestra.run.smithi092.stdout:(4/157): ceph-base-19.3.0-4854.g8f219c47.el9.x8 3.9 MB/s | 5.5 MB 00:01 2024-09-11T00:11:43.176 INFO:teuthology.orchestra.run.smithi145.stdout:(5/157): ceph-mgr-19.3.0-4854.g8f219c47.el9.x86 6.8 MB/s | 1.5 MB 00:00 2024-09-11T00:11:43.190 INFO:teuthology.orchestra.run.smithi092.stdout:(5/157): ceph-mds-19.3.0-4854.g8f219c47.el9.x86 4.2 MB/s | 2.4 MB 00:00 2024-09-11T00:11:43.226 INFO:teuthology.orchestra.run.smithi145.stdout:(6/157): ceph-mds-19.3.0-4854.g8f219c47.el9.x86 4.0 MB/s | 2.4 MB 00:00 2024-09-11T00:11:43.374 INFO:teuthology.orchestra.run.smithi092.stdout:(6/157): ceph-mgr-19.3.0-4854.g8f219c47.el9.x86 6.5 MB/s | 1.5 MB 00:00 2024-09-11T00:11:43.643 INFO:teuthology.orchestra.run.smithi145.stdout:(7/157): ceph-mon-19.3.0-4854.g8f219c47.el9.x86 10 MB/s | 4.8 MB 00:00 2024-09-11T00:11:44.066 INFO:teuthology.orchestra.run.smithi092.stdout:(7/157): ceph-mon-19.3.0-4854.g8f219c47.el9.x86 5.5 MB/s | 4.8 MB 00:00 2024-09-11T00:11:44.501 INFO:teuthology.orchestra.run.smithi145.stdout:(8/157): ceph-common-19.3.0-4854.g8f219c47.el9. 7.6 MB/s | 22 MB 00:02 2024-09-11T00:11:44.552 INFO:teuthology.orchestra.run.smithi145.stdout:(9/157): ceph-selinux-19.3.0-4854.g8f219c47.el9 504 kB/s | 25 kB 00:00 2024-09-11T00:11:44.649 INFO:teuthology.orchestra.run.smithi092.stdout:(8/157): ceph-common-19.3.0-4854.g8f219c47.el9. 7.4 MB/s | 22 MB 00:02 2024-09-11T00:11:44.668 INFO:teuthology.orchestra.run.smithi145.stdout:(10/157): ceph-radosgw-19.3.0-4854.g8f219c47.el 11 MB/s | 11 MB 00:01 2024-09-11T00:11:44.699 INFO:teuthology.orchestra.run.smithi092.stdout:(9/157): ceph-selinux-19.3.0-4854.g8f219c47.el9 507 kB/s | 25 kB 00:00 2024-09-11T00:11:44.744 INFO:teuthology.orchestra.run.smithi145.stdout:(11/157): cephfs-mirror-19.3.0-4854.g8f219c47.e 2.9 MB/s | 225 kB 00:00 2024-09-11T00:11:44.819 INFO:teuthology.orchestra.run.smithi145.stdout:(12/157): cephfs-shell-19.3.0-4854.g8f219c47.el 361 kB/s | 27 kB 00:00 2024-09-11T00:11:44.903 INFO:teuthology.orchestra.run.smithi145.stdout:(13/157): libcephfs-devel-19.3.0-4854.g8f219c47 381 kB/s | 32 kB 00:00 2024-09-11T00:11:45.028 INFO:teuthology.orchestra.run.smithi145.stdout:(14/157): libcephfs2-19.3.0-4854.g8f219c47.el9. 5.9 MB/s | 755 kB 00:00 2024-09-11T00:11:45.066 INFO:teuthology.orchestra.run.smithi092.stdout:(10/157): ceph-osd-19.3.0-4854.g8f219c47.el9.x8 10 MB/s | 17 MB 00:01 2024-09-11T00:11:45.097 INFO:teuthology.orchestra.run.smithi145.stdout:(15/157): libcephsqlite-19.3.0-4854.g8f219c47.e 2.7 MB/s | 162 kB 00:00 2024-09-11T00:11:45.158 INFO:teuthology.orchestra.run.smithi092.stdout:(11/157): cephfs-mirror-19.3.0-4854.g8f219c47.e 2.4 MB/s | 225 kB 00:00 2024-09-11T00:11:45.170 INFO:teuthology.orchestra.run.smithi145.stdout:(16/157): librados-devel-19.3.0-4854.g8f219c47. 1.5 MB/s | 127 kB 00:00 2024-09-11T00:11:45.217 INFO:teuthology.orchestra.run.smithi092.stdout:(12/157): cephfs-shell-19.3.0-4854.g8f219c47.el 463 kB/s | 27 kB 00:00 2024-09-11T00:11:45.253 INFO:teuthology.orchestra.run.smithi145.stdout:(17/157): libradosstriper1-19.3.0-4854.g8f219c4 6.0 MB/s | 507 kB 00:00 2024-09-11T00:11:45.292 INFO:teuthology.orchestra.run.smithi092.stdout:(13/157): libcephfs-devel-19.3.0-4854.g8f219c47 425 kB/s | 32 kB 00:00 2024-09-11T00:11:45.459 INFO:teuthology.orchestra.run.smithi092.stdout:(14/157): libcephfs2-19.3.0-4854.g8f219c47.el9. 4.4 MB/s | 755 kB 00:00 2024-09-11T00:11:45.551 INFO:teuthology.orchestra.run.smithi092.stdout:(15/157): libcephsqlite-19.3.0-4854.g8f219c47.e 1.7 MB/s | 162 kB 00:00 2024-09-11T00:11:45.651 INFO:teuthology.orchestra.run.smithi092.stdout:(16/157): librados-devel-19.3.0-4854.g8f219c47. 1.2 MB/s | 127 kB 00:00 2024-09-11T00:11:45.752 INFO:teuthology.orchestra.run.smithi092.stdout:(17/157): libradosstriper1-19.3.0-4854.g8f219c4 5.0 MB/s | 507 kB 00:00 2024-09-11T00:11:45.821 INFO:teuthology.orchestra.run.smithi145.stdout:(18/157): ceph-osd-19.3.0-4854.g8f219c47.el9.x8 6.6 MB/s | 17 MB 00:02 2024-09-11T00:11:45.896 INFO:teuthology.orchestra.run.smithi145.stdout:(19/157): librgw2-19.3.0-4854.g8f219c47.el9.x86 8.6 MB/s | 5.5 MB 00:00 2024-09-11T00:11:45.921 INFO:teuthology.orchestra.run.smithi145.stdout:(20/157): python3-ceph-argparse-19.3.0-4854.g8f 451 kB/s | 45 kB 00:00 2024-09-11T00:11:45.935 INFO:teuthology.orchestra.run.smithi092.stdout:(18/157): ceph-radosgw-19.3.0-4854.g8f219c47.el 5.9 MB/s | 11 MB 00:01 2024-09-11T00:11:45.979 INFO:teuthology.orchestra.run.smithi145.stdout:(21/157): python3-ceph-common-19.3.0-4854.g8f21 1.7 MB/s | 143 kB 00:00 2024-09-11T00:11:46.005 INFO:teuthology.orchestra.run.smithi145.stdout:(22/157): python3-cephfs-19.3.0-4854.g8f219c47. 1.9 MB/s | 161 kB 00:00 2024-09-11T00:11:46.019 INFO:teuthology.orchestra.run.smithi092.stdout:(19/157): python3-ceph-argparse-19.3.0-4854.g8f 543 kB/s | 45 kB 00:00 2024-09-11T00:11:46.063 INFO:teuthology.orchestra.run.smithi145.stdout:(23/157): python3-rados-19.3.0-4854.g8f219c47.e 3.8 MB/s | 321 kB 00:00 2024-09-11T00:11:46.097 INFO:teuthology.orchestra.run.smithi145.stdout:(24/157): python3-rbd-19.3.0-4854.g8f219c47.el9 3.3 MB/s | 306 kB 00:00 2024-09-11T00:11:46.110 INFO:teuthology.orchestra.run.smithi092.stdout:(20/157): python3-ceph-common-19.3.0-4854.g8f21 1.5 MB/s | 143 kB 00:00 2024-09-11T00:11:46.147 INFO:teuthology.orchestra.run.smithi145.stdout:(25/157): python3-rgw-19.3.0-4854.g8f219c47.el9 1.2 MB/s | 99 kB 00:00 2024-09-11T00:11:46.173 INFO:teuthology.orchestra.run.smithi145.stdout:(26/157): rbd-fuse-19.3.0-4854.g8f219c47.el9.x8 1.1 MB/s | 85 kB 00:00 2024-09-11T00:11:46.194 INFO:teuthology.orchestra.run.smithi092.stdout:(21/157): python3-cephfs-19.3.0-4854.g8f219c47. 1.9 MB/s | 161 kB 00:00 2024-09-11T00:11:46.265 INFO:teuthology.orchestra.run.smithi145.stdout:(27/157): rbd-nbd-19.3.0-4854.g8f219c47.el9.x86 1.8 MB/s | 171 kB 00:00 2024-09-11T00:11:46.286 INFO:teuthology.orchestra.run.smithi092.stdout:(22/157): python3-rados-19.3.0-4854.g8f219c47.e 3.4 MB/s | 321 kB 00:00 2024-09-11T00:11:46.332 INFO:teuthology.orchestra.run.smithi145.stdout:(28/157): ceph-grafana-dashboards-19.3.0-4854.g 514 kB/s | 34 kB 00:00 2024-09-11T00:11:46.370 INFO:teuthology.orchestra.run.smithi092.stdout:(23/157): librgw2-19.3.0-4854.g8f219c47.el9.x86 8.9 MB/s | 5.5 MB 00:00 2024-09-11T00:11:46.397 INFO:teuthology.orchestra.run.smithi092.stdout:(24/157): python3-rbd-19.3.0-4854.g8f219c47.el9 2.7 MB/s | 306 kB 00:00 2024-09-11T00:11:46.423 INFO:teuthology.orchestra.run.smithi145.stdout:(29/157): ceph-mgr-cephadm-19.3.0-4854.g8f219c4 1.6 MB/s | 154 kB 00:00 2024-09-11T00:11:46.474 INFO:teuthology.orchestra.run.smithi145.stdout:(30/157): rbd-mirror-19.3.0-4854.g8f219c47.el9. 9.8 MB/s | 3.2 MB 00:00 2024-09-11T00:11:46.523 INFO:teuthology.orchestra.run.smithi092.stdout:(25/157): python3-rgw-19.3.0-4854.g8f219c47.el9 651 kB/s | 99 kB 00:00 2024-09-11T00:11:46.548 INFO:teuthology.orchestra.run.smithi092.stdout:(26/157): rbd-fuse-19.3.0-4854.g8f219c47.el9.x8 566 kB/s | 85 kB 00:00 2024-09-11T00:11:46.956 INFO:teuthology.orchestra.run.smithi092.stdout:(27/157): rbd-mirror-19.3.0-4854.g8f219c47.el9. 7.3 MB/s | 3.2 MB 00:00 2024-09-11T00:11:47.057 INFO:teuthology.orchestra.run.smithi092.stdout:(28/157): ceph-grafana-dashboards-19.3.0-4854.g 342 kB/s | 34 kB 00:00 2024-09-11T00:11:47.140 INFO:teuthology.orchestra.run.smithi092.stdout:(29/157): rbd-nbd-19.3.0-4854.g8f219c47.el9.x86 288 kB/s | 171 kB 00:00 2024-09-11T00:11:47.166 INFO:teuthology.orchestra.run.smithi092.stdout:(30/157): ceph-mgr-cephadm-19.3.0-4854.g8f219c4 1.4 MB/s | 154 kB 00:00 2024-09-11T00:11:47.241 INFO:teuthology.orchestra.run.smithi145.stdout:(31/157): ceph-mgr-diskprediction-local-19.3.0- 9.6 MB/s | 7.4 MB 00:00 2024-09-11T00:11:47.341 INFO:teuthology.orchestra.run.smithi145.stdout:(32/157): ceph-mgr-modules-core-19.3.0-4854.g8f 2.8 MB/s | 291 kB 00:00 2024-09-11T00:11:47.433 INFO:teuthology.orchestra.run.smithi145.stdout:(33/157): ceph-mgr-rook-19.3.0-4854.g8f219c47.e 539 kB/s | 49 kB 00:00 2024-09-11T00:11:47.525 INFO:teuthology.orchestra.run.smithi145.stdout:(34/157): ceph-prometheus-alerts-19.3.0-4854.g8 179 kB/s | 16 kB 00:00 2024-09-11T00:11:47.625 INFO:teuthology.orchestra.run.smithi145.stdout:(35/157): ceph-volume-19.3.0-4854.g8f219c47.el9 2.8 MB/s | 285 kB 00:00 2024-09-11T00:11:47.742 INFO:teuthology.orchestra.run.smithi145.stdout:(36/157): cephadm-19.3.0-4854.g8f219c47.el9.noa 6.6 MB/s | 783 kB 00:00 2024-09-11T00:11:47.826 INFO:teuthology.orchestra.run.smithi145.stdout:(37/157): cephfs-top-19.3.0-4854.g8f219c47.el9. 219 kB/s | 18 kB 00:00 2024-09-11T00:11:47.974 INFO:teuthology.orchestra.run.smithi092.stdout:(31/157): ceph-mgr-diskprediction-local-19.3.0- 9.1 MB/s | 7.4 MB 00:00 2024-09-11T00:11:48.066 INFO:teuthology.orchestra.run.smithi092.stdout:(32/157): ceph-mgr-modules-core-19.3.0-4854.g8f 3.1 MB/s | 291 kB 00:00 2024-09-11T00:11:48.150 INFO:teuthology.orchestra.run.smithi092.stdout:(33/157): ceph-mgr-rook-19.3.0-4854.g8f219c47.e 591 kB/s | 49 kB 00:00 2024-09-11T00:11:48.225 INFO:teuthology.orchestra.run.smithi092.stdout:(34/157): ceph-prometheus-alerts-19.3.0-4854.g8 219 kB/s | 16 kB 00:00 2024-09-11T00:11:48.284 INFO:teuthology.orchestra.run.smithi092.stdout:(35/157): ceph-volume-19.3.0-4854.g8f219c47.el9 4.8 MB/s | 285 kB 00:00 2024-09-11T00:11:48.384 INFO:teuthology.orchestra.run.smithi092.stdout:(36/157): cephadm-19.3.0-4854.g8f219c47.el9.noa 7.6 MB/s | 783 kB 00:00 2024-09-11T00:11:48.651 INFO:teuthology.orchestra.run.smithi145.stdout:(38/157): ceph-test-19.3.0-4854.g8f219c47.el9.x 12 MB/s | 50 MB 00:04 2024-09-11T00:11:48.676 INFO:teuthology.orchestra.run.smithi145.stdout:(39/157): fuse-2.9.9-16.el9.x86_64.rpm 94 kB/s | 80 kB 00:00 2024-09-11T00:11:48.809 INFO:teuthology.orchestra.run.smithi092.stdout:(37/157): ceph-test-19.3.0-4854.g8f219c47.el9.x 12 MB/s | 50 MB 00:04 2024-09-11T00:11:48.827 INFO:teuthology.orchestra.run.smithi145.stdout:(40/157): ceph-mgr-dashboard-19.3.0-4854.g8f219 5.9 MB/s | 14 MB 00:02 2024-09-11T00:11:48.834 INFO:teuthology.orchestra.run.smithi092.stdout:(38/157): cephfs-top-19.3.0-4854.g8f219c47.el9. 40 kB/s | 18 kB 00:00 2024-09-11T00:11:48.969 INFO:teuthology.orchestra.run.smithi145.stdout:(41/157): libquadmath-11.5.0-2.el9.x86_64.rpm 655 kB/s | 191 kB 00:00 2024-09-11T00:11:48.976 INFO:teuthology.orchestra.run.smithi092.stdout:(39/157): fuse-2.9.9-16.el9.x86_64.rpm 479 kB/s | 80 kB 00:00 2024-09-11T00:11:49.060 INFO:teuthology.orchestra.run.smithi092.stdout:(40/157): libquadmath-11.5.0-2.el9.x86_64.rpm 2.2 MB/s | 191 kB 00:00 2024-09-11T00:11:49.144 INFO:teuthology.orchestra.run.smithi092.stdout:(41/157): python3-cffi-1.14.5-5.el9.x86_64.rpm 3.0 MB/s | 253 kB 00:00 2024-09-11T00:11:49.177 INFO:teuthology.orchestra.run.smithi092.stdout:(42/157): libgfortran-11.5.0-2.el9.x86_64.rpm 2.3 MB/s | 801 kB 00:00 2024-09-11T00:11:49.227 INFO:teuthology.orchestra.run.smithi092.stdout:(43/157): python3-ply-3.11-14.el9.noarch.rpm 2.1 MB/s | 106 kB 00:00 2024-09-11T00:11:49.360 INFO:teuthology.orchestra.run.smithi145.stdout:(42/157): python3-cryptography-36.0.1-4.el9.x86 3.1 MB/s | 1.2 MB 00:00 2024-09-11T00:11:49.419 INFO:teuthology.orchestra.run.smithi092.stdout:(44/157): ceph-mgr-dashboard-19.3.0-4854.g8f219 6.2 MB/s | 14 MB 00:02 2024-09-11T00:11:49.445 INFO:teuthology.orchestra.run.smithi092.stdout:(45/157): python3-pycparser-2.20-6.el9.noarch.r 623 kB/s | 135 kB 00:00 2024-09-11T00:11:49.452 INFO:teuthology.orchestra.run.smithi145.stdout:(43/157): python3-cffi-1.14.5-5.el9.x86_64.rpm 405 kB/s | 253 kB 00:00 2024-09-11T00:11:49.478 INFO:teuthology.orchestra.run.smithi145.stdout:(44/157): python3-ply-3.11-14.el9.noarch.rpm 911 kB/s | 106 kB 00:00 2024-09-11T00:11:49.478 INFO:teuthology.orchestra.run.smithi092.stdout:(46/157): python3-cryptography-36.0.1-4.el9.x86 3.7 MB/s | 1.2 MB 00:00 2024-09-11T00:11:49.503 INFO:teuthology.orchestra.run.smithi092.stdout:(47/157): python3-urllib3-1.26.5-6.el9.noarch.r 3.6 MB/s | 215 kB 00:00 2024-09-11T00:11:49.586 INFO:teuthology.orchestra.run.smithi145.stdout:(45/157): python3-pycparser-2.20-6.el9.noarch.r 1.0 MB/s | 135 kB 00:00 2024-09-11T00:11:49.611 INFO:teuthology.orchestra.run.smithi145.stdout:(46/157): python3-requests-2.25.1-8.el9.noarch. 936 kB/s | 125 kB 00:00 2024-09-11T00:11:49.620 INFO:teuthology.orchestra.run.smithi092.stdout:(48/157): python3-requests-2.25.1-8.el9.noarch. 623 kB/s | 125 kB 00:00 2024-09-11T00:11:49.654 INFO:teuthology.orchestra.run.smithi145.stdout:(47/157): libgfortran-11.5.0-2.el9.x86_64.rpm 800 kB/s | 801 kB 00:01 2024-09-11T00:11:49.704 INFO:teuthology.orchestra.run.smithi145.stdout:(48/157): python3-urllib3-1.26.5-6.el9.noarch.r 1.8 MB/s | 215 kB 00:00 2024-09-11T00:11:49.738 INFO:teuthology.orchestra.run.smithi145.stdout:(49/157): automake-1.16.2-8.el9.noarch.rpm 5.4 MB/s | 689 kB 00:00 2024-09-11T00:11:49.813 INFO:teuthology.orchestra.run.smithi145.stdout:(50/157): boost-program-options-1.75.0-8.el9.x8 985 kB/s | 107 kB 00:00 2024-09-11T00:11:49.846 INFO:teuthology.orchestra.run.smithi145.stdout:(51/157): elfutils-libelf-devel-0.191-4.el9.x86 200 kB/s | 22 kB 00:00 2024-09-11T00:11:49.922 INFO:teuthology.orchestra.run.smithi145.stdout:(52/157): flex-2.6.4-9.el9.x86_64.rpm 2.8 MB/s | 313 kB 00:00 2024-09-11T00:11:49.963 INFO:teuthology.orchestra.run.smithi145.stdout:(53/157): flexiblas-3.0.4-8.el9.x86_64.rpm 280 kB/s | 33 kB 00:00 2024-09-11T00:11:50.064 INFO:teuthology.orchestra.run.smithi145.stdout:(54/157): bison-3.7.4-5.el9.x86_64.rpm 2.2 MB/s | 943 kB 00:00 2024-09-11T00:11:50.089 INFO:teuthology.orchestra.run.smithi145.stdout:(55/157): flexiblas-openblas-openmp-3.0.4-8.el9 145 kB/s | 18 kB 00:00 2024-09-11T00:11:50.173 INFO:teuthology.orchestra.run.smithi145.stdout:(56/157): libaio-devel-0.3.111-13.el9.x86_64.rp 102 kB/s | 11 kB 00:00 2024-09-11T00:11:50.198 INFO:teuthology.orchestra.run.smithi145.stdout:(57/157): libnbd-1.20.2-2.el9.x86_64.rpm 1.5 MB/s | 171 kB 00:00 2024-09-11T00:11:50.281 INFO:teuthology.orchestra.run.smithi145.stdout:(58/157): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.4 MB/s | 160 kB 00:00 2024-09-11T00:11:50.304 INFO:teuthology.orchestra.run.smithi092.stdout:(49/157): boost-program-options-1.75.0-8.el9.x8 156 kB/s | 107 kB 00:00 2024-09-11T00:11:50.315 INFO:teuthology.orchestra.run.smithi145.stdout:(59/157): librabbitmq-0.11.0-7.el9.x86_64.rpm 387 kB/s | 45 kB 00:00 2024-09-11T00:11:50.400 INFO:teuthology.orchestra.run.smithi145.stdout:(60/157): librdkafka-1.6.1-102.el9.x86_64.rpm 5.5 MB/s | 662 kB 00:00 2024-09-11T00:11:50.459 INFO:teuthology.orchestra.run.smithi145.stdout:(61/157): flexiblas-netlib-3.0.4-8.el9.x86_64.r 5.6 MB/s | 3.0 MB 00:00 2024-09-11T00:11:50.485 INFO:teuthology.orchestra.run.smithi145.stdout:(62/157): libtool-2.4.6-46.el9.x86_64.rpm 3.4 MB/s | 581 kB 00:00 2024-09-11T00:11:50.502 INFO:teuthology.orchestra.run.smithi145.stdout:(63/157): libuuid-devel-2.37.4-20.el9.x86_64.rp 238 kB/s | 24 kB 00:00 2024-09-11T00:11:50.569 INFO:teuthology.orchestra.run.smithi145.stdout:(64/157): libzstd-devel-1.5.1-2.el9.x86_64.rpm 435 kB/s | 47 kB 00:00 2024-09-11T00:11:50.602 INFO:teuthology.orchestra.run.smithi145.stdout:(65/157): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.4 MB/s | 292 kB 00:00 2024-09-11T00:11:50.627 INFO:teuthology.orchestra.run.smithi145.stdout:(66/157): lua-5.4.4-4.el9.x86_64.rpm 1.5 MB/s | 188 kB 00:00 2024-09-11T00:11:50.678 INFO:teuthology.orchestra.run.smithi145.stdout:(67/157): openblas-0.3.26-2.el9.x86_64.rpm 354 kB/s | 38 kB 00:00 2024-09-11T00:11:50.804 INFO:teuthology.orchestra.run.smithi092.stdout:(50/157): automake-1.16.2-8.el9.noarch.rpm 520 kB/s | 689 kB 00:01 2024-09-11T00:11:50.821 INFO:teuthology.orchestra.run.smithi092.stdout:(51/157): elfutils-libelf-devel-0.191-4.el9.x86 42 kB/s | 22 kB 00:00 2024-09-11T00:11:51.061 INFO:teuthology.orchestra.run.smithi145.stdout:(68/157): openblas-openmp-0.3.26-2.el9.x86_64.r 11 MB/s | 4.9 MB 00:00 2024-09-11T00:11:51.120 INFO:teuthology.orchestra.run.smithi145.stdout:(69/157): openssl-devel-3.2.2-6.el9.x86_64.rpm 9.0 MB/s | 4.4 MB 00:00 2024-09-11T00:11:51.204 INFO:teuthology.orchestra.run.smithi145.stdout:(70/157): postgresql-contrib-13.16-1.el9.x86_64 6.3 MB/s | 910 kB 00:00 2024-09-11T00:11:51.245 INFO:teuthology.orchestra.run.smithi145.stdout:(71/157): postgresql-13.16-1.el9.x86_64.rpm 2.8 MB/s | 1.6 MB 00:00 2024-09-11T00:11:51.270 INFO:teuthology.orchestra.run.smithi145.stdout:(72/157): postgresql-private-libs-13.16-1.el9.x 913 kB/s | 137 kB 00:00 2024-09-11T00:11:51.321 INFO:teuthology.orchestra.run.smithi092.stdout:(52/157): bison-3.7.4-5.el9.x86_64.rpm 519 kB/s | 943 kB 00:01 2024-09-11T00:11:51.363 INFO:teuthology.orchestra.run.smithi092.stdout:(53/157): flexiblas-3.0.4-8.el9.x86_64.rpm 60 kB/s | 33 kB 00:00 2024-09-11T00:11:51.379 INFO:teuthology.orchestra.run.smithi145.stdout:(73/157): protobuf-3.14.0-13.el9.x86_64.rpm 7.6 MB/s | 1.0 MB 00:00 2024-09-11T00:11:51.405 INFO:teuthology.orchestra.run.smithi145.stdout:(74/157): python3-attrs-20.3.0-7.el9.noarch.rpm 654 kB/s | 87 kB 00:00 2024-09-11T00:11:51.513 INFO:teuthology.orchestra.run.smithi145.stdout:(75/157): python3-colorama-0.4.6-3.el9.noarch.r 566 kB/s | 61 kB 00:00 2024-09-11T00:11:51.714 INFO:teuthology.orchestra.run.smithi092.stdout:(54/157): flex-2.6.4-9.el9.x86_64.rpm 345 kB/s | 313 kB 00:00 2024-09-11T00:11:51.839 INFO:teuthology.orchestra.run.smithi092.stdout:(55/157): flexiblas-openblas-openmp-3.0.4-8.el9 38 kB/s | 18 kB 00:00 2024-09-11T00:11:51.888 INFO:teuthology.orchestra.run.smithi145.stdout:(76/157): python3-devel-3.9.19-8.el9.x86_64.rpm 653 kB/s | 245 kB 00:00 2024-09-11T00:11:52.197 INFO:teuthology.orchestra.run.smithi092.stdout:(56/157): libaio-devel-0.3.111-13.el9.x86_64.rp 23 kB/s | 11 kB 00:00 2024-09-11T00:11:52.263 INFO:teuthology.orchestra.run.smithi145.stdout:(77/157): python3-jinja2-2.11.3-6.el9.noarch.rp 662 kB/s | 248 kB 00:00 2024-09-11T00:11:52.381 INFO:teuthology.orchestra.run.smithi145.stdout:(78/157): python3-jsonpatch-1.21-16.el9.noarch. 219 kB/s | 26 kB 00:00 2024-09-11T00:11:52.497 INFO:teuthology.orchestra.run.smithi145.stdout:(79/157): python3-jsonpointer-2.0-4.el9.noarch. 164 kB/s | 19 kB 00:00 2024-09-11T00:11:52.614 INFO:teuthology.orchestra.run.smithi092.stdout:(57/157): libnbd-1.20.2-2.el9.x86_64.rpm 220 kB/s | 171 kB 00:00 2024-09-11T00:11:52.781 INFO:teuthology.orchestra.run.smithi145.stdout:(80/157): python3-mako-1.1.4-6.el9.noarch.rpm 608 kB/s | 172 kB 00:00 2024-09-11T00:11:52.900 INFO:teuthology.orchestra.run.smithi145.stdout:(81/157): python3-markupsafe-1.1.1-12.el9.x86_6 298 kB/s | 35 kB 00:00 2024-09-11T00:11:52.922 INFO:teuthology.orchestra.run.smithi092.stdout:(58/157): libpmemobj-1.12.1-1.el9.x86_64.rpm 221 kB/s | 160 kB 00:00 2024-09-11T00:11:53.215 INFO:teuthology.orchestra.run.smithi092.stdout:(59/157): librabbitmq-0.11.0-7.el9.x86_64.rpm 75 kB/s | 45 kB 00:00 2024-09-11T00:11:54.290 INFO:teuthology.orchestra.run.smithi092.stdout:(60/157): librdkafka-1.6.1-102.el9.x86_64.rpm 485 kB/s | 662 kB 00:01 2024-09-11T00:11:54.473 INFO:teuthology.orchestra.run.smithi092.stdout:(61/157): libtool-2.4.6-46.el9.x86_64.rpm 462 kB/s | 581 kB 00:01 2024-09-11T00:11:54.824 INFO:teuthology.orchestra.run.smithi092.stdout:(62/157): libuuid-devel-2.37.4-20.el9.x86_64.rp 46 kB/s | 24 kB 00:00 2024-09-11T00:11:55.049 INFO:teuthology.orchestra.run.smithi092.stdout:(63/157): libzstd-devel-1.5.1-2.el9.x86_64.rpm 82 kB/s | 47 kB 00:00 2024-09-11T00:11:55.189 INFO:teuthology.orchestra.run.smithi145.stdout:(82/157): postgresql-server-13.16-1.el9.x86_64. 1.4 MB/s | 5.8 MB 00:03 2024-09-11T00:11:55.449 INFO:teuthology.orchestra.run.smithi092.stdout:(64/157): flexiblas-netlib-3.0.4-8.el9.x86_64.r 742 kB/s | 3.0 MB 00:04 2024-09-11T00:11:55.565 INFO:teuthology.orchestra.run.smithi145.stdout:(83/157): python3-numpy-f2py-1.20.1-5.el9.x86_6 668 kB/s | 250 kB 00:00 2024-09-11T00:11:55.791 INFO:teuthology.orchestra.run.smithi092.stdout:(65/157): lttng-ust-2.12.0-6.el9.x86_64.rpm 302 kB/s | 292 kB 00:00 2024-09-11T00:11:55.924 INFO:teuthology.orchestra.run.smithi092.stdout:(66/157): lua-5.4.4-4.el9.x86_64.rpm 217 kB/s | 188 kB 00:00 2024-09-11T00:11:55.940 INFO:teuthology.orchestra.run.smithi145.stdout:(84/157): python3-oauthlib-3.1.1-5.el9.noarch.r 593 kB/s | 222 kB 00:00 2024-09-11T00:11:56.000 INFO:teuthology.orchestra.run.smithi092.stdout:(67/157): openblas-0.3.26-2.el9.x86_64.rpm 70 kB/s | 38 kB 00:00 2024-09-11T00:11:56.140 INFO:teuthology.orchestra.run.smithi145.stdout:(85/157): python3-packaging-20.9-5.el9.noarch.r 386 kB/s | 77 kB 00:00 2024-09-11T00:11:56.257 INFO:teuthology.orchestra.run.smithi145.stdout:(86/157): python3-prettytable-0.7.2-27.el9.noar 362 kB/s | 42 kB 00:00 2024-09-11T00:11:56.716 INFO:teuthology.orchestra.run.smithi145.stdout:(87/157): python3-protobuf-3.14.0-13.el9.noarch 587 kB/s | 269 kB 00:00 2024-09-11T00:11:57.007 INFO:teuthology.orchestra.run.smithi145.stdout:(88/157): python3-pyasn1-0.4.8-6.el9.noarch.rpm 544 kB/s | 159 kB 00:00 2024-09-11T00:11:57.424 INFO:teuthology.orchestra.run.smithi145.stdout:(89/157): python3-babel-2.9.1-2.el9.noarch.rpm 1.0 MB/s | 6.0 MB 00:06 2024-09-11T00:11:57.508 INFO:teuthology.orchestra.run.smithi145.stdout:(90/157): python3-pyasn1-modules-0.4.8-6.el9.no 557 kB/s | 279 kB 00:00 2024-09-11T00:11:57.533 INFO:teuthology.orchestra.run.smithi145.stdout:(91/157): python3-pytz-2021.1-5.el9.noarch.rpm 468 kB/s | 51 kB 00:00 2024-09-11T00:11:57.684 INFO:teuthology.orchestra.run.smithi145.stdout:(92/157): python3-numpy-1.20.1-5.el9.x86_64.rpm 1.1 MB/s | 5.1 MB 00:04 2024-09-11T00:11:57.709 INFO:teuthology.orchestra.run.smithi145.stdout:(93/157): python3-requests-oauthlib-1.3.0-12.el 267 kB/s | 54 kB 00:00 2024-09-11T00:11:57.793 INFO:teuthology.orchestra.run.smithi145.stdout:(94/157): python3-toml-0.10.2-6.el9.noarch.rpm 384 kB/s | 42 kB 00:00 2024-09-11T00:11:57.818 INFO:teuthology.orchestra.run.smithi145.stdout:(95/157): python3-wcwidth-0.2.5-8.el9.noarch.rp 406 kB/s | 44 kB 00:00 2024-09-11T00:11:57.910 INFO:teuthology.orchestra.run.smithi145.stdout:(96/157): qatlib-24.02.0-1.el9.x86_64.rpm 1.8 MB/s | 221 kB 00:00 2024-09-11T00:11:57.935 INFO:teuthology.orchestra.run.smithi145.stdout:(97/157): qatlib-service-24.02.0-1.el9.x86_64.r 307 kB/s | 36 kB 00:00 2024-09-11T00:11:58.020 INFO:teuthology.orchestra.run.smithi145.stdout:(98/157): qatzip-libs-1.2.0-1.el9.x86_64.rpm 437 kB/s | 47 kB 00:00 2024-09-11T00:11:58.127 INFO:teuthology.orchestra.run.smithi145.stdout:(99/157): uuid-1.6.2-55.el9.x86_64.rpm 533 kB/s | 58 kB 00:00 2024-09-11T00:11:58.235 INFO:teuthology.orchestra.run.smithi145.stdout:(100/157): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 886 kB/s | 96 kB 00:00 2024-09-11T00:11:58.344 INFO:teuthology.orchestra.run.smithi145.stdout:(101/157): xmlstarlet-1.6.1-20.el9.x86_64.rpm 587 kB/s | 64 kB 00:00 2024-09-11T00:11:58.400 INFO:teuthology.orchestra.run.smithi092.stdout:(68/157): postgresql-13.16-1.el9.x86_64.rpm 677 kB/s | 1.6 MB 00:02 2024-09-11T00:11:58.419 INFO:teuthology.orchestra.run.smithi145.stdout:(102/157): socat-1.7.4.1-6.el9.x86_64.rpm 628 kB/s | 304 kB 00:00 2024-09-11T00:11:58.453 INFO:teuthology.orchestra.run.smithi145.stdout:(103/157): zlib-devel-1.2.11-41.el9.x86_64.rpm 413 kB/s | 45 kB 00:00 2024-09-11T00:11:58.528 INFO:teuthology.orchestra.run.smithi145.stdout:(104/157): lua-devel-5.4.4-4.el9.x86_64.rpm 205 kB/s | 22 kB 00:00 2024-09-11T00:11:58.575 INFO:teuthology.orchestra.run.smithi092.stdout:(69/157): openssl-devel-3.2.2-6.el9.x86_64.rpm 1.7 MB/s | 4.4 MB 00:02 2024-09-11T00:11:58.587 INFO:teuthology.orchestra.run.smithi145.stdout:(105/157): abseil-cpp-20211102.0-3.el9.x86_64.r 9.2 MB/s | 548 kB 00:00 2024-09-11T00:11:58.621 INFO:teuthology.orchestra.run.smithi145.stdout:(106/157): gperftools-libs-2.9.1-2.el9.x86_64.r 9.0 MB/s | 309 kB 00:00 2024-09-11T00:11:58.650 INFO:teuthology.orchestra.run.smithi092.stdout:(70/157): openblas-openmp-0.3.26-2.el9.x86_64.r 1.7 MB/s | 4.9 MB 00:02 2024-09-11T00:11:58.654 INFO:teuthology.orchestra.run.smithi145.stdout:(107/157): protobuf-compiler-3.14.0-13.el9.x86_ 4.2 MB/s | 863 kB 00:00 2024-09-11T00:11:58.679 INFO:teuthology.orchestra.run.smithi145.stdout:(108/157): grpc-data-1.46.7-10.el9.noarch.rpm 333 kB/s | 19 kB 00:00 2024-09-11T00:11:58.713 INFO:teuthology.orchestra.run.smithi145.stdout:(109/157): libarrow-doc-9.0.0-11.el9.noarch.rpm 996 kB/s | 26 kB 00:00 2024-09-11T00:11:58.738 INFO:teuthology.orchestra.run.smithi145.stdout:(110/157): liboath-2.6.7-2.el9.x86_64.rpm 2.0 MB/s | 49 kB 00:00 2024-09-11T00:11:58.763 INFO:teuthology.orchestra.run.smithi145.stdout:(111/157): libunwind-1.6.2-1.el9.x86_64.rpm 2.6 MB/s | 67 kB 00:00 2024-09-11T00:11:58.789 INFO:teuthology.orchestra.run.smithi145.stdout:(112/157): luarocks-3.9.2-5.el9.noarch.rpm 5.9 MB/s | 151 kB 00:00 2024-09-11T00:11:58.847 INFO:teuthology.orchestra.run.smithi145.stdout:(113/157): parquet-libs-9.0.0-11.el9.x86_64.rpm 14 MB/s | 839 kB 00:00 2024-09-11T00:11:58.898 INFO:teuthology.orchestra.run.smithi145.stdout:(114/157): python3-asyncssh-2.13.2-5.el9.noarch 11 MB/s | 548 kB 00:00 2024-09-11T00:11:58.914 INFO:teuthology.orchestra.run.smithi145.stdout:(115/157): python3-bcrypt-3.2.2-1.el9.x86_64.rp 2.6 MB/s | 43 kB 00:00 2024-09-11T00:11:58.931 INFO:teuthology.orchestra.run.smithi145.stdout:(116/157): python3-cachetools-4.2.4-1.el9.noarc 1.9 MB/s | 32 kB 00:00 2024-09-11T00:11:58.948 INFO:teuthology.orchestra.run.smithi145.stdout:(117/157): python3-certifi-2023.05.07-4.el9.noa 850 kB/s | 14 kB 00:00 2024-09-11T00:11:58.982 INFO:teuthology.orchestra.run.smithi145.stdout:(118/157): python3-cheroot-8.6.0-4.el9.noarch.r 5.0 MB/s | 172 kB 00:00 2024-09-11T00:11:59.016 INFO:teuthology.orchestra.run.smithi145.stdout:(119/157): python3-cherrypy-18.6.1-2.el9.noarch 11 MB/s | 358 kB 00:00 2024-09-11T00:11:59.074 INFO:teuthology.orchestra.run.smithi145.stdout:(120/157): libarrow-9.0.0-11.el9.x86_64.rpm 11 MB/s | 4.4 MB 00:00 2024-09-11T00:11:59.099 INFO:teuthology.orchestra.run.smithi145.stdout:(121/157): python3-google-auth-2.34.0-1.el9.noa 8.6 MB/s | 220 kB 00:00 2024-09-11T00:11:59.125 INFO:teuthology.orchestra.run.smithi145.stdout:(122/157): python3-cmd2-2.4.2-2.el9.noarch.rpm 2.7 MB/s | 303 kB 00:00 2024-09-11T00:11:59.159 INFO:teuthology.orchestra.run.smithi145.stdout:(123/157): python3-grpcio-tools-1.46.7-10.el9.x 4.2 MB/s | 144 kB 00:00 2024-09-11T00:11:59.184 INFO:teuthology.orchestra.run.smithi145.stdout:(124/157): python3-jaraco-8.2.1-3.el9.noarch.rp 432 kB/s | 11 kB 00:00 2024-09-11T00:11:59.209 INFO:teuthology.orchestra.run.smithi145.stdout:(125/157): python3-jaraco-classes-3.2.1-5.el9.n 705 kB/s | 18 kB 00:00 2024-09-11T00:11:59.234 INFO:teuthology.orchestra.run.smithi145.stdout:(126/157): python3-jaraco-collections-3.0.0-8.e 929 kB/s | 23 kB 00:00 2024-09-11T00:11:59.259 INFO:teuthology.orchestra.run.smithi145.stdout:(127/157): python3-jaraco-functools-3.5.0-2.el9 782 kB/s | 19 kB 00:00 2024-09-11T00:11:59.275 INFO:teuthology.orchestra.run.smithi092.stdout:(71/157): postgresql-private-libs-13.16-1.el9.x 196 kB/s | 137 kB 00:00 2024-09-11T00:11:59.285 INFO:teuthology.orchestra.run.smithi145.stdout:(128/157): python3-jaraco-text-3.2.0-6.el9.noar 787 kB/s | 20 kB 00:00 2024-09-11T00:11:59.334 INFO:teuthology.orchestra.run.smithi092.stdout:(72/157): postgresql-contrib-13.16-1.el9.x86_64 975 kB/s | 910 kB 00:00 2024-09-11T00:11:59.344 INFO:teuthology.orchestra.run.smithi145.stdout:(129/157): python3-grpcio-1.46.7-10.el9.x86_64. 8.4 MB/s | 2.0 MB 00:00 2024-09-11T00:11:59.377 INFO:teuthology.orchestra.run.smithi145.stdout:(130/157): python3-kubernetes-26.1.0-2.el9.noar 11 MB/s | 1.0 MB 00:00 2024-09-11T00:11:59.402 INFO:teuthology.orchestra.run.smithi145.stdout:(131/157): python3-logutils-0.3.5-21.el9.noarch 794 kB/s | 46 kB 00:00 2024-09-11T00:11:59.427 INFO:teuthology.orchestra.run.smithi145.stdout:(132/157): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-09-11T00:11:59.453 INFO:teuthology.orchestra.run.smithi145.stdout:(133/157): python3-more-itertools-8.12.0-2.el9. 1.5 MB/s | 79 kB 00:00 2024-09-11T00:11:59.478 INFO:teuthology.orchestra.run.smithi145.stdout:(134/157): python3-portend-3.1.0-2.el9.noarch.r 655 kB/s | 16 kB 00:00 2024-09-11T00:11:59.504 INFO:teuthology.orchestra.run.smithi145.stdout:(135/157): python3-pyOpenSSL-21.0.0-1.el9.noarc 3.5 MB/s | 90 kB 00:00 2024-09-11T00:11:59.529 INFO:teuthology.orchestra.run.smithi145.stdout:(136/157): python3-pecan-1.4.2-3.el9.noarch.rpm 2.6 MB/s | 272 kB 00:00 2024-09-11T00:11:59.546 INFO:teuthology.orchestra.run.smithi145.stdout:(137/157): python3-pyperclip-1.8.2-2.el9.noarch 674 kB/s | 28 kB 00:00 2024-09-11T00:11:59.563 INFO:teuthology.orchestra.run.smithi145.stdout:(138/157): python3-repoze-lru-0.7-16.el9.noarch 919 kB/s | 31 kB 00:00 2024-09-11T00:11:59.579 INFO:teuthology.orchestra.run.smithi145.stdout:(139/157): python3-rsa-4.9-2.el9.noarch.rpm 3.5 MB/s | 59 kB 00:00 2024-09-11T00:11:59.605 INFO:teuthology.orchestra.run.smithi145.stdout:(140/157): python3-routes-2.5.1-5.el9.noarch.rp 3.1 MB/s | 188 kB 00:00 2024-09-11T00:11:59.622 INFO:teuthology.orchestra.run.smithi145.stdout:(141/157): python3-tempora-5.0.0-2.el9.noarch.r 852 kB/s | 36 kB 00:00 2024-09-11T00:11:59.647 INFO:teuthology.orchestra.run.smithi145.stdout:(142/157): python3-typing-extensions-4.12.2-2.e 1.7 MB/s | 74 kB 00:00 2024-09-11T00:11:59.673 INFO:teuthology.orchestra.run.smithi145.stdout:(143/157): python3-websocket-client-1.2.3-2.el9 3.5 MB/s | 90 kB 00:00 2024-09-11T00:11:59.697 INFO:teuthology.orchestra.run.smithi145.stdout:(144/157): python3-webob-1.8.8-2.el9.noarch.rpm 3.0 MB/s | 230 kB 00:00 2024-09-11T00:11:59.723 INFO:teuthology.orchestra.run.smithi145.stdout:(145/157): python3-zc-lockfile-2.0-10.el9.noarc 800 kB/s | 20 kB 00:00 2024-09-11T00:11:59.748 INFO:teuthology.orchestra.run.smithi145.stdout:(146/157): python3-werkzeug-2.0.3-3.el9.1.noarc 5.5 MB/s | 427 kB 00:00 2024-09-11T00:11:59.773 INFO:teuthology.orchestra.run.smithi145.stdout:(147/157): re2-20211101-20.el9.x86_64.rpm 3.7 MB/s | 191 kB 00:00 2024-09-11T00:11:59.832 INFO:teuthology.orchestra.run.smithi145.stdout:(148/157): thrift-0.15.0-2.el9.x86_64.rpm 19 MB/s | 1.6 MB 00:00 2024-09-11T00:11:59.959 INFO:teuthology.orchestra.run.smithi092.stdout:(73/157): postgresql-server-13.16-1.el9.x86_64. 4.4 MB/s | 5.8 MB 00:01 2024-09-11T00:11:59.984 INFO:teuthology.orchestra.run.smithi092.stdout:(74/157): python3-attrs-20.3.0-7.el9.noarch.rpm 134 kB/s | 87 kB 00:00 2024-09-11T00:12:00.099 INFO:teuthology.orchestra.run.smithi145.stdout:(149/157): python3-scipy-1.6.2-8.el9.x86_64.rpm 6.3 MB/s | 16 MB 00:02 2024-09-11T00:12:00.216 INFO:teuthology.orchestra.run.smithi145.stdout:(150/157): librbd1-19.3.0-4854.g8f219c47.el9.x8 8.5 MB/s | 3.2 MB 00:00 2024-09-11T00:12:00.259 INFO:teuthology.orchestra.run.smithi092.stdout:(75/157): protobuf-3.14.0-13.el9.x86_64.rpm 1.0 MB/s | 1.0 MB 00:00 2024-09-11T00:12:00.276 INFO:teuthology.orchestra.run.smithi145.stdout:(151/157): librados2-19.3.0-4854.g8f219c47.el9. 6.9 MB/s | 3.5 MB 00:00 2024-09-11T00:12:00.392 INFO:teuthology.orchestra.run.smithi145.stdout:(152/157): NetworkManager-team-1.49.90-1.el9.x8 349 kB/s | 41 kB 00:00 2024-09-11T00:12:00.509 INFO:teuthology.orchestra.run.smithi145.stdout:(153/157): NetworkManager-tui-1.49.90-1.el9.x86 2.1 MB/s | 249 kB 00:00 2024-09-11T00:12:00.593 INFO:teuthology.orchestra.run.smithi092.stdout:(76/157): python3-colorama-0.4.6-3.el9.noarch.r 101 kB/s | 61 kB 00:00 2024-09-11T00:12:00.642 INFO:teuthology.orchestra.run.smithi145.stdout:(154/157): openssl-3.2.2-6.el9.x86_64.rpm 10 MB/s | 1.4 MB 00:00 2024-09-11T00:12:00.717 INFO:teuthology.orchestra.run.smithi145.stdout:(155/157): NetworkManager-libnm-1.49.90-1.el9.x 3.6 MB/s | 1.8 MB 00:00 2024-09-11T00:12:00.793 INFO:teuthology.orchestra.run.smithi145.stdout:(156/157): openssl-libs-3.2.2-6.el9.x86_64.rpm 16 MB/s | 2.4 MB 00:00 2024-09-11T00:12:01.018 INFO:teuthology.orchestra.run.smithi145.stdout:(157/157): NetworkManager-1.49.90-1.el9.x86_64. 2.5 MB/s | 2.3 MB 00:00 2024-09-11T00:12:01.023 INFO:teuthology.orchestra.run.smithi145.stdout:-------------------------------------------------------------------------------- 2024-09-11T00:12:01.023 INFO:teuthology.orchestra.run.smithi145.stdout:Total 12 MB/s | 240 MB 00:19 2024-09-11T00:12:01.026 INFO:teuthology.orchestra.run.smithi092.stdout:(77/157): python3-devel-3.9.19-8.el9.x86_64.rpm 319 kB/s | 245 kB 00:00 2024-09-11T00:12:01.210 INFO:teuthology.orchestra.run.smithi092.stdout:(78/157): python3-babel-2.9.1-2.el9.noarch.rpm 4.8 MB/s | 6.0 MB 00:01 2024-09-11T00:12:01.460 INFO:teuthology.orchestra.run.smithi092.stdout:(79/157): python3-jinja2-2.11.3-6.el9.noarch.rp 286 kB/s | 248 kB 00:00 2024-09-11T00:12:01.635 INFO:teuthology.orchestra.run.smithi092.stdout:(80/157): python3-jsonpatch-1.21-16.el9.noarch. 42 kB/s | 26 kB 00:00 2024-09-11T00:12:01.753 INFO:teuthology.orchestra.run.smithi092.stdout:(81/157): python3-jsonpointer-2.0-4.el9.noarch. 35 kB/s | 19 kB 00:00 2024-09-11T00:12:02.194 INFO:teuthology.orchestra.run.smithi092.stdout:(82/157): python3-markupsafe-1.1.1-12.el9.x86_6 62 kB/s | 35 kB 00:00 2024-09-11T00:12:02.224 INFO:teuthology.orchestra.run.smithi145.stdout:Running transaction check 2024-09-11T00:12:02.278 INFO:teuthology.orchestra.run.smithi092.stdout:(83/157): python3-mako-1.1.4-6.el9.noarch.rpm 213 kB/s | 172 kB 00:00 2024-09-11T00:12:02.379 INFO:teuthology.orchestra.run.smithi145.stdout:Transaction check succeeded. 2024-09-11T00:12:02.379 INFO:teuthology.orchestra.run.smithi145.stdout:Running transaction test 2024-09-11T00:12:03.078 INFO:teuthology.orchestra.run.smithi092.stdout:(84/157): python3-numpy-f2py-1.20.1-5.el9.x86_6 284 kB/s | 250 kB 00:00 2024-09-11T00:12:03.154 INFO:teuthology.orchestra.run.smithi092.stdout:(85/157): python3-oauthlib-3.1.1-5.el9.noarch.r 254 kB/s | 222 kB 00:00 2024-09-11T00:12:03.704 INFO:teuthology.orchestra.run.smithi092.stdout:(86/157): python3-numpy-1.20.1-5.el9.x86_64.rpm 2.6 MB/s | 5.1 MB 00:01 2024-09-11T00:12:03.737 INFO:teuthology.orchestra.run.smithi092.stdout:(87/157): python3-prettytable-0.7.2-27.el9.noar 72 kB/s | 42 kB 00:00 2024-09-11T00:12:03.771 INFO:teuthology.orchestra.run.smithi092.stdout:(88/157): python3-packaging-20.9-5.el9.noarch.r 111 kB/s | 77 kB 00:00 2024-09-11T00:12:04.463 INFO:teuthology.orchestra.run.smithi092.stdout:(89/157): python3-pyasn1-0.4.8-6.el9.noarch.rpm 219 kB/s | 159 kB 00:00 2024-09-11T00:12:04.496 INFO:teuthology.orchestra.run.smithi092.stdout:(90/157): python3-protobuf-3.14.0-13.el9.noarch 340 kB/s | 269 kB 00:00 2024-09-11T00:12:04.621 INFO:teuthology.orchestra.run.smithi092.stdout:(91/157): python3-pyasn1-modules-0.4.8-6.el9.no 328 kB/s | 279 kB 00:00 2024-09-11T00:12:04.657 INFO:teuthology.orchestra.run.smithi145.stdout:Transaction test succeeded. 2024-09-11T00:12:04.658 INFO:teuthology.orchestra.run.smithi145.stdout:Running transaction 2024-09-11T00:12:05.072 INFO:teuthology.orchestra.run.smithi092.stdout:(92/157): python3-pytz-2021.1-5.el9.noarch.rpm 84 kB/s | 51 kB 00:00 2024-09-11T00:12:05.097 INFO:teuthology.orchestra.run.smithi092.stdout:(93/157): python3-requests-oauthlib-1.3.0-12.el 89 kB/s | 54 kB 00:00 2024-09-11T00:12:05.639 INFO:teuthology.orchestra.run.smithi092.stdout:(94/157): python3-toml-0.10.2-6.el9.noarch.rpm 74 kB/s | 42 kB 00:00 2024-09-11T00:12:05.664 INFO:teuthology.orchestra.run.smithi092.stdout:(95/157): python3-wcwidth-0.2.5-8.el9.noarch.rp 78 kB/s | 44 kB 00:00 2024-09-11T00:12:06.264 INFO:teuthology.orchestra.run.smithi092.stdout:(96/157): qatlib-service-24.02.0-1.el9.x86_64.r 60 kB/s | 36 kB 00:00 2024-09-11T00:12:06.389 INFO:teuthology.orchestra.run.smithi092.stdout:(97/157): qatlib-24.02.0-1.el9.x86_64.rpm 294 kB/s | 221 kB 00:00 2024-09-11T00:12:06.698 INFO:teuthology.orchestra.run.smithi092.stdout:(98/157): python3-scipy-1.6.2-8.el9.x86_64.rpm 7.8 MB/s | 16 MB 00:02 2024-09-11T00:12:07.140 INFO:teuthology.orchestra.run.smithi092.stdout:(99/157): qatzip-libs-1.2.0-1.el9.x86_64.rpm 54 kB/s | 47 kB 00:00 2024-09-11T00:12:07.440 INFO:teuthology.orchestra.run.smithi092.stdout:(100/157): socat-1.7.4.1-6.el9.x86_64.rpm 290 kB/s | 304 kB 00:01 2024-09-11T00:12:07.465 INFO:teuthology.orchestra.run.smithi092.stdout:(101/157): uuid-1.6.2-55.el9.x86_64.rpm 76 kB/s | 58 kB 00:00 2024-09-11T00:12:07.807 INFO:teuthology.orchestra.run.smithi092.stdout:(102/157): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 144 kB/s | 96 kB 00:00 2024-09-11T00:12:07.891 INFO:teuthology.orchestra.run.smithi092.stdout:(103/157): lua-devel-5.4.4-4.el9.x86_64.rpm 269 kB/s | 22 kB 00:00 2024-09-11T00:12:08.041 INFO:teuthology.orchestra.run.smithi092.stdout:(104/157): zlib-devel-1.2.11-41.el9.x86_64.rpm 78 kB/s | 45 kB 00:00 2024-09-11T00:12:08.091 INFO:teuthology.orchestra.run.smithi092.stdout:(105/157): abseil-cpp-20211102.0-3.el9.x86_64.r 11 MB/s | 548 kB 00:00 2024-09-11T00:12:08.125 INFO:teuthology.orchestra.run.smithi092.stdout:(106/157): gperftools-libs-2.9.1-2.el9.x86_64.r 9.1 MB/s | 309 kB 00:00 2024-09-11T00:12:08.150 INFO:teuthology.orchestra.run.smithi092.stdout:(107/157): xmlstarlet-1.6.1-20.el9.x86_64.rpm 90 kB/s | 64 kB 00:00 2024-09-11T00:12:08.184 INFO:teuthology.orchestra.run.smithi092.stdout:(108/157): protobuf-compiler-3.14.0-13.el9.x86_ 2.9 MB/s | 863 kB 00:00 2024-09-11T00:12:08.209 INFO:teuthology.orchestra.run.smithi092.stdout:(109/157): grpc-data-1.46.7-10.el9.noarch.rpm 235 kB/s | 19 kB 00:00 2024-09-11T00:12:08.251 INFO:teuthology.orchestra.run.smithi092.stdout:(110/157): libarrow-doc-9.0.0-11.el9.noarch.rpm 761 kB/s | 26 kB 00:00 2024-09-11T00:12:08.276 INFO:teuthology.orchestra.run.smithi092.stdout:(111/157): libunwind-1.6.2-1.el9.x86_64.rpm 2.8 MB/s | 67 kB 00:00 2024-09-11T00:12:08.302 INFO:teuthology.orchestra.run.smithi092.stdout:(112/157): liboath-2.6.7-2.el9.x86_64.rpm 572 kB/s | 49 kB 00:00 2024-09-11T00:12:08.327 INFO:teuthology.orchestra.run.smithi092.stdout:(113/157): luarocks-3.9.2-5.el9.noarch.rpm 2.9 MB/s | 151 kB 00:00 2024-09-11T00:12:08.369 INFO:teuthology.orchestra.run.smithi092.stdout:(114/157): python3-asyncssh-2.13.2-5.el9.noarch 13 MB/s | 548 kB 00:00 2024-09-11T00:12:08.394 INFO:teuthology.orchestra.run.smithi092.stdout:(115/157): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-09-11T00:12:08.419 INFO:teuthology.orchestra.run.smithi092.stdout:(116/157): python3-cachetools-4.2.4-1.el9.noarc 1.3 MB/s | 32 kB 00:00 2024-09-11T00:12:08.461 INFO:teuthology.orchestra.run.smithi092.stdout:(117/157): parquet-libs-9.0.0-11.el9.x86_64.rpm 5.1 MB/s | 839 kB 00:00 2024-09-11T00:12:08.486 INFO:teuthology.orchestra.run.smithi092.stdout:(118/157): python3-certifi-2023.05.07-4.el9.noa 211 kB/s | 14 kB 00:00 2024-09-11T00:12:08.520 INFO:teuthology.orchestra.run.smithi092.stdout:(119/157): python3-cheroot-8.6.0-4.el9.noarch.r 2.9 MB/s | 172 kB 00:00 2024-09-11T00:12:08.545 INFO:teuthology.orchestra.run.smithi092.stdout:(120/157): python3-cherrypy-18.6.1-2.el9.noarch 6.0 MB/s | 358 kB 00:00 2024-09-11T00:12:08.571 INFO:teuthology.orchestra.run.smithi092.stdout:(121/157): python3-cmd2-2.4.2-2.el9.noarch.rpm 5.9 MB/s | 303 kB 00:00 2024-09-11T00:12:08.596 INFO:teuthology.orchestra.run.smithi092.stdout:(122/157): python3-google-auth-2.34.0-1.el9.noa 4.3 MB/s | 220 kB 00:00 2024-09-11T00:12:08.621 INFO:teuthology.orchestra.run.smithi092.stdout:(123/157): python3-grpcio-tools-1.46.7-10.el9.x 5.7 MB/s | 144 kB 00:00 2024-09-11T00:12:08.646 INFO:teuthology.orchestra.run.smithi092.stdout:(124/157): python3-jaraco-8.2.1-3.el9.noarch.rp 431 kB/s | 11 kB 00:00 2024-09-11T00:12:08.672 INFO:teuthology.orchestra.run.smithi092.stdout:(125/157): python3-jaraco-classes-3.2.1-5.el9.n 711 kB/s | 18 kB 00:00 2024-09-11T00:12:08.697 INFO:teuthology.orchestra.run.smithi092.stdout:(126/157): python3-jaraco-collections-3.0.0-8.e 927 kB/s | 23 kB 00:00 2024-09-11T00:12:08.722 INFO:teuthology.orchestra.run.smithi092.stdout:(127/157): python3-jaraco-functools-3.5.0-2.el9 786 kB/s | 19 kB 00:00 2024-09-11T00:12:08.748 INFO:teuthology.orchestra.run.smithi092.stdout:(128/157): python3-jaraco-text-3.2.0-6.el9.noar 788 kB/s | 20 kB 00:00 2024-09-11T00:12:08.806 INFO:teuthology.orchestra.run.smithi092.stdout:(129/157): libarrow-9.0.0-11.el9.x86_64.rpm 6.7 MB/s | 4.4 MB 00:00 2024-09-11T00:12:08.831 INFO:teuthology.orchestra.run.smithi092.stdout:(130/157): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-11T00:12:08.865 INFO:teuthology.orchestra.run.smithi092.stdout:(131/157): python3-more-itertools-8.12.0-2.el9. 2.3 MB/s | 79 kB 00:00 2024-09-11T00:12:08.890 INFO:teuthology.orchestra.run.smithi092.stdout:(132/157): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-09-11T00:12:08.932 INFO:teuthology.orchestra.run.smithi092.stdout:(133/157): python3-grpcio-1.46.7-10.el9.x86_64. 5.6 MB/s | 2.0 MB 00:00 2024-09-11T00:12:08.958 INFO:teuthology.orchestra.run.smithi092.stdout:(134/157): python3-portend-3.1.0-2.el9.noarch.r 657 kB/s | 16 kB 00:00 2024-09-11T00:12:08.983 INFO:teuthology.orchestra.run.smithi092.stdout:(135/157): python3-pyOpenSSL-21.0.0-1.el9.noarc 3.5 MB/s | 90 kB 00:00 2024-09-11T00:12:09.008 INFO:teuthology.orchestra.run.smithi092.stdout:(136/157): python3-pecan-1.4.2-3.el9.noarch.rpm 2.3 MB/s | 272 kB 00:00 2024-09-11T00:12:09.033 INFO:teuthology.orchestra.run.smithi092.stdout:(137/157): python3-pyperclip-1.8.2-2.el9.noarch 562 kB/s | 28 kB 00:00 2024-09-11T00:12:09.067 INFO:teuthology.orchestra.run.smithi092.stdout:(138/157): python3-kubernetes-26.1.0-2.el9.noar 3.2 MB/s | 1.0 MB 00:00 2024-09-11T00:12:09.092 INFO:teuthology.orchestra.run.smithi092.stdout:(139/157): python3-repoze-lru-0.7-16.el9.noarch 367 kB/s | 31 kB 00:00 2024-09-11T00:12:09.117 INFO:teuthology.orchestra.run.smithi092.stdout:(140/157): python3-tempora-5.0.0-2.el9.noarch.r 1.4 MB/s | 36 kB 00:00 2024-09-11T00:12:09.142 INFO:teuthology.orchestra.run.smithi092.stdout:(141/157): python3-rsa-4.9-2.el9.noarch.rpm 1.2 MB/s | 59 kB 00:00 2024-09-11T00:12:09.168 INFO:teuthology.orchestra.run.smithi092.stdout:(142/157): python3-routes-2.5.1-5.el9.noarch.rp 1.4 MB/s | 188 kB 00:00 2024-09-11T00:12:09.193 INFO:teuthology.orchestra.run.smithi092.stdout:(143/157): python3-typing-extensions-4.12.2-2.e 984 kB/s | 74 kB 00:00 2024-09-11T00:12:09.219 INFO:teuthology.orchestra.run.smithi092.stdout:(144/157): python3-websocket-client-1.2.3-2.el9 1.7 MB/s | 90 kB 00:00 2024-09-11T00:12:09.252 INFO:teuthology.orchestra.run.smithi092.stdout:(145/157): python3-webob-1.8.8-2.el9.noarch.rpm 2.1 MB/s | 230 kB 00:00 2024-09-11T00:12:09.278 INFO:teuthology.orchestra.run.smithi092.stdout:(146/157): python3-zc-lockfile-2.0-10.el9.noarc 342 kB/s | 20 kB 00:00 2024-09-11T00:12:09.311 INFO:teuthology.orchestra.run.smithi092.stdout:(147/157): re2-20211101-20.el9.x86_64.rpm 3.2 MB/s | 191 kB 00:00 2024-09-11T00:12:09.336 INFO:teuthology.orchestra.run.smithi092.stdout:(148/157): python3-werkzeug-2.0.3-3.el9.1.noarc 2.9 MB/s | 427 kB 00:00 2024-09-11T00:12:09.395 INFO:teuthology.orchestra.run.smithi092.stdout:(149/157): thrift-0.15.0-2.el9.x86_64.rpm 14 MB/s | 1.6 MB 00:00 2024-09-11T00:12:09.595 INFO:teuthology.orchestra.run.smithi092.stdout:(150/157): librbd1-19.3.0-4854.g8f219c47.el9.x8 13 MB/s | 3.2 MB 00:00 2024-09-11T00:12:09.714 INFO:teuthology.orchestra.run.smithi092.stdout:(151/157): librados2-19.3.0-4854.g8f219c47.el9. 8.6 MB/s | 3.5 MB 00:00 2024-09-11T00:12:09.754 INFO:teuthology.orchestra.run.smithi092.stdout:(152/157): NetworkManager-1.49.90-1.el9.x86_64. 6.5 MB/s | 2.3 MB 00:00 2024-09-11T00:12:09.813 INFO:teuthology.orchestra.run.smithi092.stdout:(153/157): NetworkManager-tui-1.49.90-1.el9.x86 4.2 MB/s | 249 kB 00:00 2024-09-11T00:12:09.838 INFO:teuthology.orchestra.run.smithi092.stdout:(154/157): NetworkManager-team-1.49.90-1.el9.x8 325 kB/s | 41 kB 00:00 2024-09-11T00:12:09.888 INFO:teuthology.orchestra.run.smithi092.stdout:(155/157): openssl-3.2.2-6.el9.x86_64.rpm 18 MB/s | 1.4 MB 00:00 2024-09-11T00:12:09.988 INFO:teuthology.orchestra.run.smithi092.stdout:(156/157): NetworkManager-libnm-1.49.90-1.el9.x 4.6 MB/s | 1.8 MB 00:00 2024-09-11T00:12:10.088 INFO:teuthology.orchestra.run.smithi092.stdout:(157/157): openssl-libs-3.2.2-6.el9.x86_64.rpm 9.6 MB/s | 2.4 MB 00:00 2024-09-11T00:12:10.094 INFO:teuthology.orchestra.run.smithi092.stdout:-------------------------------------------------------------------------------- 2024-09-11T00:12:10.095 INFO:teuthology.orchestra.run.smithi092.stdout:Total 8.2 MB/s | 240 MB 00:29 2024-09-11T00:12:11.292 INFO:teuthology.orchestra.run.smithi145.stdout: Preparing : 1/1 2024-09-11T00:12:11.356 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction check 2024-09-11T00:12:11.422 INFO:teuthology.orchestra.run.smithi145.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/165 2024-09-11T00:12:11.460 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/165 2024-09-11T00:12:11.512 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction check succeeded. 2024-09-11T00:12:11.512 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction test 2024-09-11T00:12:11.513 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/165 2024-09-11T00:12:11.547 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/165 2024-09-11T00:12:11.572 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/165 2024-09-11T00:12:11.627 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/165 2024-09-11T00:12:11.959 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/165 2024-09-11T00:12:12.064 INFO:teuthology.orchestra.run.smithi145.stdout: Upgrading : librados2-2:19.3.0-4854.g8f219c47.el9.x86_64 8/165 2024-09-11T00:12:12.186 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: librados2-2:19.3.0-4854.g8f219c47.el9.x86_64 8/165 2024-09-11T00:12:12.207 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : libcephfs2-2:19.3.0-4854.g8f219c47.el9.x86_64 9/165 2024-09-11T00:12:12.299 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: libcephfs2-2:19.3.0-4854.g8f219c47.el9.x86_64 9/165 2024-09-11T00:12:12.337 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-rados-2:19.3.0-4854.g8f219c47.el9.x86_64 10/165 2024-09-11T00:12:12.392 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/165 2024-09-11T00:12:12.580 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : libnbd-1.20.2-2.el9.x86_64 12/165 2024-09-11T00:12:12.642 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : postgresql-13.16-1.el9.x86_64 13/165 2024-09-11T00:12:12.670 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : libcephsqlite-2:19.3.0-4854.g8f219c47.el9.x86_64 14/165 2024-09-11T00:12:12.774 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: libcephsqlite-2:19.3.0-4854.g8f219c47.el9.x86_64 14/165 2024-09-11T00:12:12.805 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : libradosstriper1-2:19.3.0-4854.g8f219c47.el9.x86 15/165 2024-09-11T00:12:12.867 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: libradosstriper1-2:19.3.0-4854.g8f219c47.el9.x86 15/165 2024-09-11T00:12:12.897 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-11T00:12:12.916 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-11T00:12:13.117 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-11T00:12:13.293 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-11T00:12:13.396 INFO:teuthology.orchestra.run.smithi145.stdout: Upgrading : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 18/165 2024-09-11T00:12:13.512 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 19/165 2024-09-11T00:12:13.597 INFO:teuthology.orchestra.run.smithi145.stdout: Upgrading : NetworkManager-1:1.49.90-1.el9.x86_64 19/165 2024-09-11T00:12:13.814 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction test succeeded. 2024-09-11T00:12:13.814 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction 2024-09-11T00:12:13.829 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 19/165 2024-09-11T00:12:13.938 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : re2-1:20211101-20.el9.x86_64 20/165 2024-09-11T00:12:13.968 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 21/165 2024-09-11T00:12:14.003 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/165 2024-09-11T00:12:14.077 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/165 2024-09-11T00:12:14.129 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/165 2024-09-11T00:12:14.169 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/165 2024-09-11T00:12:14.212 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/165 2024-09-11T00:12:14.246 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/165 2024-09-11T00:12:14.273 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/165 2024-09-11T00:12:14.341 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/165 2024-09-11T00:12:14.395 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/165 2024-09-11T00:12:14.435 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/165 2024-09-11T00:12:14.478 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/165 2024-09-11T00:12:14.556 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/165 2024-09-11T00:12:14.588 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-ceph-common-2:19.3.0-4854.g8f219c47.el9. 34/165 2024-09-11T00:12:14.631 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-ceph-argparse-2:19.3.0-4854.g8f219c47.el 35/165 2024-09-11T00:12:14.660 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-cephfs-2:19.3.0-4854.g8f219c47.el9.x86_6 36/165 2024-09-11T00:12:14.730 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/165 2024-09-11T00:12:14.775 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/165 2024-09-11T00:12:14.850 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/165 2024-09-11T00:12:14.993 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/165 2024-09-11T00:12:15.053 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/165 2024-09-11T00:12:15.584 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/165 2024-09-11T00:12:15.665 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/165 2024-09-11T00:12:15.694 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/165 2024-09-11T00:12:15.737 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/165 2024-09-11T00:12:15.774 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : librados-devel-2:19.3.0-4854.g8f219c47.el9.x86_6 46/165 2024-09-11T00:12:15.817 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/165 2024-09-11T00:12:15.986 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/165 2024-09-11T00:12:16.044 INFO:teuthology.orchestra.run.smithi145.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/165 2024-09-11T00:12:16.137 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/165 2024-09-11T00:12:16.215 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 51/165 2024-09-11T00:12:16.289 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 52/165 2024-09-11T00:12:16.321 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 53/165 2024-09-11T00:12:16.357 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 54/165 2024-09-11T00:12:16.403 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 55/165 2024-09-11T00:12:16.448 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 56/165 2024-09-11T00:12:16.491 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 57/165 2024-09-11T00:12:16.533 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 58/165 2024-09-11T00:12:16.669 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 59/165 2024-09-11T00:12:16.711 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 60/165 2024-09-11T00:12:16.751 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 61/165 2024-09-11T00:12:16.856 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 62/165 2024-09-11T00:12:16.886 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 63/165 2024-09-11T00:12:16.926 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 64/165 2024-09-11T00:12:16.959 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 65/165 2024-09-11T00:12:16.984 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 66/165 2024-09-11T00:12:17.083 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 67/165 2024-09-11T00:12:17.286 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 68/165 2024-09-11T00:12:17.333 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 69/165 2024-09-11T00:12:17.361 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 70/165 2024-09-11T00:12:17.408 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 71/165 2024-09-11T00:12:17.442 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : uuid-1.6.2-55.el9.x86_64 72/165 2024-09-11T00:12:17.474 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 73/165 2024-09-11T00:12:17.504 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 74/165 2024-09-11T00:12:17.529 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 75/165 2024-09-11T00:12:17.563 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 76/165 2024-09-11T00:12:17.605 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 77/165 2024-09-11T00:12:17.639 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 78/165 2024-09-11T00:12:17.727 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 79/165 2024-09-11T00:12:17.770 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 80/165 2024-09-11T00:12:17.801 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 81/165 2024-09-11T00:12:17.905 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 82/165 2024-09-11T00:12:17.968 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 83/165 2024-09-11T00:12:18.702 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 84/165 2024-09-11T00:12:18.748 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 85/165 2024-09-11T00:12:18.791 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 86/165 2024-09-11T00:12:18.891 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 87/165 2024-09-11T00:12:18.946 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 88/165 2024-09-11T00:12:18.994 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 89/165 2024-09-11T00:12:19.083 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 90/165 2024-09-11T00:12:19.122 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 91/165 2024-09-11T00:12:19.305 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : openblas-0.3.26-2.el9.x86_64 92/165 2024-09-11T00:12:19.335 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 93/165 2024-09-11T00:12:19.421 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 94/165 2024-09-11T00:12:20.065 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 95/165 2024-09-11T00:12:20.183 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 96/165 2024-09-11T00:12:20.298 INFO:teuthology.orchestra.run.smithi092.stdout: Preparing : 1/1 2024-09-11T00:12:20.408 INFO:teuthology.orchestra.run.smithi092.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/165 2024-09-11T00:12:20.455 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/165 2024-09-11T00:12:20.509 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/165 2024-09-11T00:12:20.542 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/165 2024-09-11T00:12:20.568 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/165 2024-09-11T00:12:20.618 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/165 2024-09-11T00:12:20.953 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/165 2024-09-11T00:12:21.060 INFO:teuthology.orchestra.run.smithi092.stdout: Upgrading : librados2-2:19.3.0-4854.g8f219c47.el9.x86_64 8/165 2024-09-11T00:12:21.182 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: librados2-2:19.3.0-4854.g8f219c47.el9.x86_64 8/165 2024-09-11T00:12:21.211 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libcephfs2-2:19.3.0-4854.g8f219c47.el9.x86_64 9/165 2024-09-11T00:12:21.312 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: libcephfs2-2:19.3.0-4854.g8f219c47.el9.x86_64 9/165 2024-09-11T00:12:21.341 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-rados-2:19.3.0-4854.g8f219c47.el9.x86_64 10/165 2024-09-11T00:12:21.387 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/165 2024-09-11T00:12:21.442 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 97/165 2024-09-11T00:12:21.531 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 98/165 2024-09-11T00:12:21.559 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 99/165 2024-09-11T00:12:21.585 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libnbd-1.20.2-2.el9.x86_64 12/165 2024-09-11T00:12:21.592 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 100/165 2024-09-11T00:12:21.646 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : postgresql-13.16-1.el9.x86_64 13/165 2024-09-11T00:12:21.674 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libcephsqlite-2:19.3.0-4854.g8f219c47.el9.x86_64 14/165 2024-09-11T00:12:21.779 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: libcephsqlite-2:19.3.0-4854.g8f219c47.el9.x86_64 14/165 2024-09-11T00:12:21.809 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libradosstriper1-2:19.3.0-4854.g8f219c47.el9.x86 15/165 2024-09-11T00:12:21.872 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: libradosstriper1-2:19.3.0-4854.g8f219c47.el9.x86 15/165 2024-09-11T00:12:21.901 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-11T00:12:21.915 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 101/165 2024-09-11T00:12:21.930 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-11T00:12:21.963 INFO:teuthology.orchestra.run.smithi145.stdout: Upgrading : librbd1-2:19.3.0-4854.g8f219c47.el9.x86_64 102/165 2024-09-11T00:12:22.053 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: librbd1-2:19.3.0-4854.g8f219c47.el9.x86_64 102/165 2024-09-11T00:12:22.085 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-rbd-2:19.3.0-4854.g8f219c47.el9.x86_64 103/165 2024-09-11T00:12:22.103 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-11T00:12:22.121 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 104/165 2024-09-11T00:12:22.275 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-11T00:12:22.383 INFO:teuthology.orchestra.run.smithi092.stdout: Upgrading : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 18/165 2024-09-11T00:12:22.489 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 19/165 2024-09-11T00:12:22.567 INFO:teuthology.orchestra.run.smithi092.stdout: Upgrading : NetworkManager-1:1.49.90-1.el9.x86_64 19/165 2024-09-11T00:12:22.613 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 105/165 2024-09-11T00:12:22.641 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : librgw2-2:19.3.0-4854.g8f219c47.el9.x86_64 106/165 2024-09-11T00:12:22.711 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: librgw2-2:19.3.0-4854.g8f219c47.el9.x86_64 106/165 2024-09-11T00:12:22.734 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-rgw-2:19.3.0-4854.g8f219c47.el9.x86_64 107/165 2024-09-11T00:12:22.790 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 19/165 2024-09-11T00:12:22.896 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : re2-1:20211101-20.el9.x86_64 20/165 2024-09-11T00:12:22.930 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 21/165 2024-09-11T00:12:22.972 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/165 2024-09-11T00:12:23.045 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/165 2024-09-11T00:12:23.089 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/165 2024-09-11T00:12:23.122 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/165 2024-09-11T00:12:23.165 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/165 2024-09-11T00:12:23.198 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/165 2024-09-11T00:12:23.226 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/165 2024-09-11T00:12:23.293 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/165 2024-09-11T00:12:23.348 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/165 2024-09-11T00:12:23.388 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/165 2024-09-11T00:12:23.431 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/165 2024-09-11T00:12:23.506 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/165 2024-09-11T00:12:23.541 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-ceph-common-2:19.3.0-4854.g8f219c47.el9. 34/165 2024-09-11T00:12:23.584 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-ceph-argparse-2:19.3.0-4854.g8f219c47.el 35/165 2024-09-11T00:12:23.613 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-cephfs-2:19.3.0-4854.g8f219c47.el9.x86_6 36/165 2024-09-11T00:12:23.683 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/165 2024-09-11T00:12:23.728 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/165 2024-09-11T00:12:23.802 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/165 2024-09-11T00:12:23.941 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/165 2024-09-11T00:12:23.996 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/165 2024-09-11T00:12:24.511 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/165 2024-09-11T00:12:24.600 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/165 2024-09-11T00:12:24.638 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/165 2024-09-11T00:12:24.673 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/165 2024-09-11T00:12:24.710 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : librados-devel-2:19.3.0-4854.g8f219c47.el9.x86_6 46/165 2024-09-11T00:12:24.779 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/165 2024-09-11T00:12:24.932 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/165 2024-09-11T00:12:24.997 INFO:teuthology.orchestra.run.smithi092.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/165 2024-09-11T00:12:25.044 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 108/165 2024-09-11T00:12:25.072 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 108/165 2024-09-11T00:12:25.087 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/165 2024-09-11T00:12:25.152 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 51/165 2024-09-11T00:12:25.233 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 52/165 2024-09-11T00:12:25.265 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 53/165 2024-09-11T00:12:25.301 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 54/165 2024-09-11T00:12:25.348 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 55/165 2024-09-11T00:12:25.384 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 56/165 2024-09-11T00:12:25.427 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 57/165 2024-09-11T00:12:25.469 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 58/165 2024-09-11T00:12:25.612 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 59/165 2024-09-11T00:12:25.662 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 108/165 2024-09-11T00:12:25.663 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 60/165 2024-09-11T00:12:25.701 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : ceph-base-2:19.3.0-4854.g8f219c47.el9.x86_64 109/165 2024-09-11T00:12:25.704 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 61/165 2024-09-11T00:12:25.781 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: ceph-base-2:19.3.0-4854.g8f219c47.el9.x86_64 109/165 2024-09-11T00:12:25.782 INFO:teuthology.orchestra.run.smithi145.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-11T00:12:25.782 INFO:teuthology.orchestra.run.smithi145.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-11T00:12:25.782 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-11T00:12:25.805 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 62/165 2024-09-11T00:12:25.818 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : ceph-selinux-2:19.3.0-4854.g8f219c47.el9.x86_64 110/165 2024-09-11T00:12:25.846 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 63/165 2024-09-11T00:12:25.886 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 64/165 2024-09-11T00:12:25.919 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 65/165 2024-09-11T00:12:25.953 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 66/165 2024-09-11T00:12:26.080 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 67/165 2024-09-11T00:12:26.211 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 68/165 2024-09-11T00:12:26.243 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 69/165 2024-09-11T00:12:26.271 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 70/165 2024-09-11T00:12:26.309 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 71/165 2024-09-11T00:12:26.352 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : uuid-1.6.2-55.el9.x86_64 72/165 2024-09-11T00:12:26.384 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 73/165 2024-09-11T00:12:26.414 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 74/165 2024-09-11T00:12:26.448 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 75/165 2024-09-11T00:12:26.501 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 76/165 2024-09-11T00:12:26.540 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 77/165 2024-09-11T00:12:26.574 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 78/165 2024-09-11T00:12:26.661 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 79/165 2024-09-11T00:12:26.704 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 80/165 2024-09-11T00:12:26.736 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 81/165 2024-09-11T00:12:26.838 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 82/165 2024-09-11T00:12:26.890 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 83/165 2024-09-11T00:12:27.601 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 84/165 2024-09-11T00:12:27.645 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 85/165 2024-09-11T00:12:27.679 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 86/165 2024-09-11T00:12:27.778 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 87/165 2024-09-11T00:12:27.825 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 88/165 2024-09-11T00:12:27.870 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 89/165 2024-09-11T00:12:27.957 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 90/165 2024-09-11T00:12:27.998 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 91/165 2024-09-11T00:12:28.190 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : openblas-0.3.26-2.el9.x86_64 92/165 2024-09-11T00:12:28.221 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 93/165 2024-09-11T00:12:28.298 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 94/165 2024-09-11T00:12:28.939 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 95/165 2024-09-11T00:12:29.049 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 96/165 2024-09-11T00:12:30.290 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 97/165 2024-09-11T00:12:30.382 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 98/165 2024-09-11T00:12:30.409 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 99/165 2024-09-11T00:12:30.443 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 100/165 2024-09-11T00:12:30.765 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 101/165 2024-09-11T00:12:30.814 INFO:teuthology.orchestra.run.smithi092.stdout: Upgrading : librbd1-2:19.3.0-4854.g8f219c47.el9.x86_64 102/165 2024-09-11T00:12:30.904 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: librbd1-2:19.3.0-4854.g8f219c47.el9.x86_64 102/165 2024-09-11T00:12:30.935 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-rbd-2:19.3.0-4854.g8f219c47.el9.x86_64 103/165 2024-09-11T00:12:30.971 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 104/165 2024-09-11T00:12:31.462 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 105/165 2024-09-11T00:12:31.491 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : librgw2-2:19.3.0-4854.g8f219c47.el9.x86_64 106/165 2024-09-11T00:12:31.562 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: librgw2-2:19.3.0-4854.g8f219c47.el9.x86_64 106/165 2024-09-11T00:12:31.585 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-rgw-2:19.3.0-4854.g8f219c47.el9.x86_64 107/165 2024-09-11T00:12:33.917 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 108/165 2024-09-11T00:12:33.956 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 108/165 2024-09-11T00:12:34.513 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 108/165 2024-09-11T00:12:34.551 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-base-2:19.3.0-4854.g8f219c47.el9.x86_64 109/165 2024-09-11T00:12:34.654 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-base-2:19.3.0-4854.g8f219c47.el9.x86_64 109/165 2024-09-11T00:12:34.655 INFO:teuthology.orchestra.run.smithi092.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-11T00:12:34.655 INFO:teuthology.orchestra.run.smithi092.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-11T00:12:34.655 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:12:34.696 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-selinux-2:19.3.0-4854.g8f219c47.el9.x86_64 110/165 2024-09-11T00:12:37.505 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: ceph-selinux-2:19.3.0-4854.g8f219c47.el9.x86_64 110/165 2024-09-11T00:12:37.505 INFO:teuthology.orchestra.run.smithi145.stdout:skipping the directory /sys 2024-09-11T00:12:37.505 INFO:teuthology.orchestra.run.smithi145.stdout:skipping the directory /proc 2024-09-11T00:12:37.505 INFO:teuthology.orchestra.run.smithi145.stdout:skipping the directory /mnt 2024-09-11T00:12:37.505 INFO:teuthology.orchestra.run.smithi145.stdout:skipping the directory /var/tmp 2024-09-11T00:12:37.506 INFO:teuthology.orchestra.run.smithi145.stdout:skipping the directory /home 2024-09-11T00:12:37.506 INFO:teuthology.orchestra.run.smithi145.stdout:skipping the directory /root 2024-09-11T00:12:37.506 INFO:teuthology.orchestra.run.smithi145.stdout:skipping the directory /tmp 2024-09-11T00:12:37.506 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-11T00:12:37.681 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : ceph-volume-2:19.3.0-4854.g8f219c47.el9.noarch 111/165 2024-09-11T00:12:37.699 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: ceph-volume-2:19.3.0-4854.g8f219c47.el9.noarch 111/165 2024-09-11T00:12:37.699 INFO:teuthology.orchestra.run.smithi145.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T00:12:37.699 INFO:teuthology.orchestra.run.smithi145.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-11T00:12:37.699 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-11T00:12:39.201 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : ceph-osd-2:19.3.0-4854.g8f219c47.el9.x86_64 112/165 2024-09-11T00:12:39.228 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: ceph-osd-2:19.3.0-4854.g8f219c47.el9.x86_64 112/165 2024-09-11T00:12:39.228 INFO:teuthology.orchestra.run.smithi145.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T00:12:39.228 INFO:teuthology.orchestra.run.smithi145.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-11T00:12:39.228 INFO:teuthology.orchestra.run.smithi145.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-11T00:12:39.228 INFO:teuthology.orchestra.run.smithi145.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-11T00:12:39.228 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-11T00:12:39.459 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : ceph-mds-2:19.3.0-4854.g8f219c47.el9.x86_64 113/165 2024-09-11T00:12:39.483 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: ceph-mds-2:19.3.0-4854.g8f219c47.el9.x86_64 113/165 2024-09-11T00:12:39.483 INFO:teuthology.orchestra.run.smithi145.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T00:12:39.483 INFO:teuthology.orchestra.run.smithi145.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-11T00:12:39.483 INFO:teuthology.orchestra.run.smithi145.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-11T00:12:39.483 INFO:teuthology.orchestra.run.smithi145.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-11T00:12:39.483 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-11T00:12:39.935 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : ceph-mon-2:19.3.0-4854.g8f219c47.el9.x86_64 114/165 2024-09-11T00:12:39.958 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: ceph-mon-2:19.3.0-4854.g8f219c47.el9.x86_64 114/165 2024-09-11T00:12:39.958 INFO:teuthology.orchestra.run.smithi145.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T00:12:39.959 INFO:teuthology.orchestra.run.smithi145.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-11T00:12:39.959 INFO:teuthology.orchestra.run.smithi145.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-11T00:12:39.959 INFO:teuthology.orchestra.run.smithi145.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-11T00:12:39.959 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-11T00:12:40.066 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : automake-1.16.2-8.el9.noarch 115/165 2024-09-11T00:12:40.123 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-ply-3.11-14.el9.noarch 116/165 2024-09-11T00:12:40.177 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 117/165 2024-09-11T00:12:40.364 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 118/165 2024-09-11T00:12:40.410 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 119/165 2024-09-11T00:12:40.480 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 120/165 2024-09-11T00:12:40.569 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 121/165 2024-09-11T00:12:40.718 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 122/165 2024-09-11T00:12:40.761 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 123/165 2024-09-11T00:12:40.793 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 124/165 2024-09-11T00:12:40.829 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : fuse-2.9.9-16.el9.x86_64 125/165 2024-09-11T00:12:41.192 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: cephadm-2:19.3.0-4854.g8f219c47.el9.noarch 126/165 2024-09-11T00:12:41.219 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : cephadm-2:19.3.0-4854.g8f219c47.el9.noarch 126/165 2024-09-11T00:12:41.251 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-4854.g8f219c47.e 127/165 2024-09-11T00:12:41.317 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-4854.g8f219c47. 128/165 2024-09-11T00:12:41.342 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-4854.g8f219c47.el9.noa 129/165 2024-09-11T00:12:44.524 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-4854.g8f219c47.el9.noa 129/165 2024-09-11T00:12:44.590 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-4854.g8f219c47.el9.n 130/165 2024-09-11T00:12:45.556 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-4854.g8f219c47.el9.n 130/165 2024-09-11T00:12:45.581 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-4854.g8f2 131/165 2024-09-11T00:12:45.695 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-4854.g8f2 131/165 2024-09-11T00:12:45.851 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-4854.g8f219c47.el 132/165 2024-09-11T00:12:45.875 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : ceph-mgr-2:19.3.0-4854.g8f219c47.el9.x86_64 133/165 2024-09-11T00:12:45.899 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: ceph-mgr-2:19.3.0-4854.g8f219c47.el9.x86_64 133/165 2024-09-11T00:12:45.899 INFO:teuthology.orchestra.run.smithi145.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T00:12:45.899 INFO:teuthology.orchestra.run.smithi145.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-11T00:12:45.899 INFO:teuthology.orchestra.run.smithi145.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-11T00:12:45.899 INFO:teuthology.orchestra.run.smithi145.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-11T00:12:45.899 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-11T00:12:45.950 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : ceph-mgr-rook-2:19.3.0-4854.g8f219c47.el9.noarch 134/165 2024-09-11T00:12:45.962 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-4854.g8f219c47.el9.noarch 134/165 2024-09-11T00:12:46.059 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : ceph-2:19.3.0-4854.g8f219c47.el9.x86_64 135/165 2024-09-11T00:12:46.109 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : ceph-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 136/165 2024-09-11T00:12:46.702 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-selinux-2:19.3.0-4854.g8f219c47.el9.x86_64 110/165 2024-09-11T00:12:46.702 INFO:teuthology.orchestra.run.smithi092.stdout:skipping the directory /sys 2024-09-11T00:12:46.702 INFO:teuthology.orchestra.run.smithi092.stdout:skipping the directory /proc 2024-09-11T00:12:46.702 INFO:teuthology.orchestra.run.smithi092.stdout:skipping the directory /mnt 2024-09-11T00:12:46.702 INFO:teuthology.orchestra.run.smithi092.stdout:skipping the directory /var/tmp 2024-09-11T00:12:46.702 INFO:teuthology.orchestra.run.smithi092.stdout:skipping the directory /home 2024-09-11T00:12:46.702 INFO:teuthology.orchestra.run.smithi092.stdout:skipping the directory /root 2024-09-11T00:12:46.702 INFO:teuthology.orchestra.run.smithi092.stdout:skipping the directory /tmp 2024-09-11T00:12:46.702 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:12:46.871 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-volume-2:19.3.0-4854.g8f219c47.el9.noarch 111/165 2024-09-11T00:12:46.891 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-volume-2:19.3.0-4854.g8f219c47.el9.noarch 111/165 2024-09-11T00:12:46.891 INFO:teuthology.orchestra.run.smithi092.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T00:12:46.891 INFO:teuthology.orchestra.run.smithi092.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-11T00:12:46.891 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:12:47.056 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : libtool-2.4.6-46.el9.x86_64 137/165 2024-09-11T00:12:47.086 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : ceph-radosgw-2:19.3.0-4854.g8f219c47.el9.x86_64 138/165 2024-09-11T00:12:47.109 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-4854.g8f219c47.el9.x86_64 138/165 2024-09-11T00:12:47.110 INFO:teuthology.orchestra.run.smithi145.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T00:12:47.110 INFO:teuthology.orchestra.run.smithi145.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-11T00:12:47.110 INFO:teuthology.orchestra.run.smithi145.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-11T00:12:47.110 INFO:teuthology.orchestra.run.smithi145.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-11T00:12:47.110 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-11T00:12:47.154 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-4854.g8f219 139/165 2024-09-11T00:12:47.176 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-4854.g8f219 139/165 2024-09-11T00:12:47.177 INFO:teuthology.orchestra.run.smithi145.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T00:12:47.177 INFO:teuthology.orchestra.run.smithi145.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-11T00:12:47.177 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-11T00:12:47.221 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : cephfs-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 140/165 2024-09-11T00:12:47.244 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: cephfs-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 140/165 2024-09-11T00:12:47.244 INFO:teuthology.orchestra.run.smithi145.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T00:12:47.244 INFO:teuthology.orchestra.run.smithi145.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-11T00:12:47.244 INFO:teuthology.orchestra.run.smithi145.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-11T00:12:47.244 INFO:teuthology.orchestra.run.smithi145.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-11T00:12:47.244 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-11T00:12:47.555 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : rbd-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 141/165 2024-09-11T00:12:47.578 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: rbd-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 141/165 2024-09-11T00:12:47.578 INFO:teuthology.orchestra.run.smithi145.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T00:12:47.578 INFO:teuthology.orchestra.run.smithi145.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-11T00:12:47.579 INFO:teuthology.orchestra.run.smithi145.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-11T00:12:47.579 INFO:teuthology.orchestra.run.smithi145.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-11T00:12:47.579 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-11T00:12:48.425 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-osd-2:19.3.0-4854.g8f219c47.el9.x86_64 112/165 2024-09-11T00:12:48.452 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-osd-2:19.3.0-4854.g8f219c47.el9.x86_64 112/165 2024-09-11T00:12:48.452 INFO:teuthology.orchestra.run.smithi092.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T00:12:48.452 INFO:teuthology.orchestra.run.smithi092.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-11T00:12:48.452 INFO:teuthology.orchestra.run.smithi092.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-11T00:12:48.452 INFO:teuthology.orchestra.run.smithi092.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-11T00:12:48.452 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:12:48.675 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-mds-2:19.3.0-4854.g8f219c47.el9.x86_64 113/165 2024-09-11T00:12:48.699 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-mds-2:19.3.0-4854.g8f219c47.el9.x86_64 113/165 2024-09-11T00:12:48.699 INFO:teuthology.orchestra.run.smithi092.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T00:12:48.699 INFO:teuthology.orchestra.run.smithi092.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-11T00:12:48.699 INFO:teuthology.orchestra.run.smithi092.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-11T00:12:48.699 INFO:teuthology.orchestra.run.smithi092.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-11T00:12:48.699 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:12:49.142 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-mon-2:19.3.0-4854.g8f219c47.el9.x86_64 114/165 2024-09-11T00:12:49.166 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-mon-2:19.3.0-4854.g8f219c47.el9.x86_64 114/165 2024-09-11T00:12:49.166 INFO:teuthology.orchestra.run.smithi092.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T00:12:49.166 INFO:teuthology.orchestra.run.smithi092.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-11T00:12:49.166 INFO:teuthology.orchestra.run.smithi092.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-11T00:12:49.166 INFO:teuthology.orchestra.run.smithi092.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-11T00:12:49.167 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:12:49.264 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : automake-1.16.2-8.el9.noarch 115/165 2024-09-11T00:12:49.312 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-ply-3.11-14.el9.noarch 116/165 2024-09-11T00:12:49.367 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 117/165 2024-09-11T00:12:49.557 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 118/165 2024-09-11T00:12:49.601 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 119/165 2024-09-11T00:12:49.670 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 120/165 2024-09-11T00:12:49.758 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 121/165 2024-09-11T00:12:49.897 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 122/165 2024-09-11T00:12:49.950 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 123/165 2024-09-11T00:12:49.983 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 124/165 2024-09-11T00:12:50.011 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : fuse-2.9.9-16.el9.x86_64 125/165 2024-09-11T00:12:50.499 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: cephadm-2:19.3.0-4854.g8f219c47.el9.noarch 126/165 2024-09-11T00:12:50.535 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : cephadm-2:19.3.0-4854.g8f219c47.el9.noarch 126/165 2024-09-11T00:12:50.575 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-4854.g8f219c47.e 127/165 2024-09-11T00:12:50.640 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-4854.g8f219c47. 128/165 2024-09-11T00:12:50.666 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-4854.g8f219c47.el9.noa 129/165 2024-09-11T00:12:52.409 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : ceph-test-2:19.3.0-4854.g8f219c47.el9.x86_64 142/165 2024-09-11T00:12:52.450 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : rbd-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 143/165 2024-09-11T00:12:52.499 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : rbd-nbd-2:19.3.0-4854.g8f219c47.el9.x86_64 144/165 2024-09-11T00:12:52.531 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 145/165 2024-09-11T00:12:52.558 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 146/165 2024-09-11T00:12:52.756 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : cephfs-shell-2:19.3.0-4854.g8f219c47.el9.x86_64 147/165 2024-09-11T00:12:52.805 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 148/165 2024-09-11T00:12:52.836 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : libcephfs-devel-2:19.3.0-4854.g8f219c47.el9.x86_ 149/165 2024-09-11T00:12:52.864 INFO:teuthology.orchestra.run.smithi145.stdout: Upgrading : NetworkManager-team-1:1.49.90-1.el9.x86_64 150/165 2024-09-11T00:12:52.903 INFO:teuthology.orchestra.run.smithi145.stdout: Upgrading : NetworkManager-tui-1:1.49.90-1.el9.x86_64 151/165 2024-09-11T00:12:53.528 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-11T00:12:53.567 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-11T00:12:53.587 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-11T00:12:53.806 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-4854.g8f219c47.el9.noa 129/165 2024-09-11T00:12:53.863 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-4854.g8f219c47.el9.n 130/165 2024-09-11T00:12:54.420 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : cephfs-top-2:19.3.0-4854.g8f219c47.el9.noarch 153/165 2024-09-11T00:12:54.513 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 154/165 2024-09-11T00:12:54.564 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 155/165 2024-09-11T00:12:54.661 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : flex-2.6.4-9.el9.x86_64 156/165 2024-09-11T00:12:54.691 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : bison-3.7.4-5.el9.x86_64 157/165 2024-09-11T00:12:54.733 INFO:teuthology.orchestra.run.smithi145.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 158/165 2024-09-11T00:12:54.767 INFO:teuthology.orchestra.run.smithi145.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 159/165 2024-09-11T00:12:54.767 INFO:teuthology.orchestra.run.smithi145.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-11T00:12:54.820 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-4854.g8f219c47.el9.n 130/165 2024-09-11T00:12:54.855 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-4854.g8f2 131/165 2024-09-11T00:12:54.859 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-11T00:12:54.859 INFO:teuthology.orchestra.run.smithi145.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-11T00:12:54.943 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-11T00:12:54.967 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-4854.g8f2 131/165 2024-09-11T00:12:54.968 INFO:teuthology.orchestra.run.smithi145.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 162/165 2024-09-11T00:12:54.974 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-11T00:12:54.974 INFO:teuthology.orchestra.run.smithi145.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-11T00:12:55.125 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-4854.g8f219c47.el 132/165 2024-09-11T00:12:55.157 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-mgr-2:19.3.0-4854.g8f219c47.el9.x86_64 133/165 2024-09-11T00:12:55.162 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-11T00:12:55.163 INFO:teuthology.orchestra.run.smithi145.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-11T00:12:55.181 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-mgr-2:19.3.0-4854.g8f219c47.el9.x86_64 133/165 2024-09-11T00:12:55.182 INFO:teuthology.orchestra.run.smithi092.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T00:12:55.182 INFO:teuthology.orchestra.run.smithi092.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-11T00:12:55.182 INFO:teuthology.orchestra.run.smithi092.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-11T00:12:55.182 INFO:teuthology.orchestra.run.smithi092.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-11T00:12:55.182 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:12:55.233 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-mgr-rook-2:19.3.0-4854.g8f219c47.el9.noarch 134/165 2024-09-11T00:12:55.245 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-4854.g8f219c47.el9.noarch 134/165 2024-09-11T00:12:55.246 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-11T00:12:55.320 INFO:teuthology.orchestra.run.smithi145.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-11T00:12:55.353 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-2:19.3.0-4854.g8f219c47.el9.x86_64 135/165 2024-09-11T00:12:55.416 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 136/165 2024-09-11T00:12:56.364 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libtool-2.4.6-46.el9.x86_64 137/165 2024-09-11T00:12:56.394 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-radosgw-2:19.3.0-4854.g8f219c47.el9.x86_64 138/165 2024-09-11T00:12:56.418 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-4854.g8f219c47.el9.x86_64 138/165 2024-09-11T00:12:56.418 INFO:teuthology.orchestra.run.smithi092.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T00:12:56.418 INFO:teuthology.orchestra.run.smithi092.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-11T00:12:56.418 INFO:teuthology.orchestra.run.smithi092.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-11T00:12:56.418 INFO:teuthology.orchestra.run.smithi092.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-11T00:12:56.418 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:12:56.461 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-4854.g8f219 139/165 2024-09-11T00:12:56.484 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-4854.g8f219 139/165 2024-09-11T00:12:56.484 INFO:teuthology.orchestra.run.smithi092.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T00:12:56.484 INFO:teuthology.orchestra.run.smithi092.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-11T00:12:56.484 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:12:56.528 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : cephfs-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 140/165 2024-09-11T00:12:56.552 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: cephfs-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 140/165 2024-09-11T00:12:56.552 INFO:teuthology.orchestra.run.smithi092.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T00:12:56.552 INFO:teuthology.orchestra.run.smithi092.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-11T00:12:56.552 INFO:teuthology.orchestra.run.smithi092.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-11T00:12:56.552 INFO:teuthology.orchestra.run.smithi092.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-11T00:12:56.552 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:12:56.871 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : rbd-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 141/165 2024-09-11T00:12:56.894 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: rbd-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 141/165 2024-09-11T00:12:56.894 INFO:teuthology.orchestra.run.smithi092.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T00:12:56.894 INFO:teuthology.orchestra.run.smithi092.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-11T00:12:56.894 INFO:teuthology.orchestra.run.smithi092.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-11T00:12:56.894 INFO:teuthology.orchestra.run.smithi092.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-11T00:12:56.895 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:13:01.608 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-test-2:19.3.0-4854.g8f219c47.el9.x86_64 142/165 2024-09-11T00:13:01.617 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-11T00:13:01.617 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : ceph-2:19.3.0-4854.g8f219c47.el9.x86_64 1/165 2024-09-11T00:13:01.617 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : ceph-base-2:19.3.0-4854.g8f219c47.el9.x86_64 2/165 2024-09-11T00:13:01.617 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 3/165 2024-09-11T00:13:01.617 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : ceph-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 4/165 2024-09-11T00:13:01.618 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-4854.g8f219 5/165 2024-09-11T00:13:01.618 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : ceph-mds-2:19.3.0-4854.g8f219c47.el9.x86_64 6/165 2024-09-11T00:13:01.618 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : ceph-mgr-2:19.3.0-4854.g8f219c47.el9.x86_64 7/165 2024-09-11T00:13:01.618 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : ceph-mon-2:19.3.0-4854.g8f219c47.el9.x86_64 8/165 2024-09-11T00:13:01.618 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : ceph-osd-2:19.3.0-4854.g8f219c47.el9.x86_64 9/165 2024-09-11T00:13:01.618 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : ceph-radosgw-2:19.3.0-4854.g8f219c47.el9.x86_64 10/165 2024-09-11T00:13:01.618 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : ceph-selinux-2:19.3.0-4854.g8f219c47.el9.x86_64 11/165 2024-09-11T00:13:01.618 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : ceph-test-2:19.3.0-4854.g8f219c47.el9.x86_64 12/165 2024-09-11T00:13:01.618 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : cephfs-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 13/165 2024-09-11T00:13:01.618 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : cephfs-shell-2:19.3.0-4854.g8f219c47.el9.x86_64 14/165 2024-09-11T00:13:01.618 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : libcephfs-devel-2:19.3.0-4854.g8f219c47.el9.x86_ 15/165 2024-09-11T00:13:01.618 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : libcephfs2-2:19.3.0-4854.g8f219c47.el9.x86_64 16/165 2024-09-11T00:13:01.618 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : libcephsqlite-2:19.3.0-4854.g8f219c47.el9.x86_64 17/165 2024-09-11T00:13:01.619 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : librados-devel-2:19.3.0-4854.g8f219c47.el9.x86_6 18/165 2024-09-11T00:13:01.619 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : libradosstriper1-2:19.3.0-4854.g8f219c47.el9.x86 19/165 2024-09-11T00:13:01.619 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : librgw2-2:19.3.0-4854.g8f219c47.el9.x86_64 20/165 2024-09-11T00:13:01.619 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-ceph-argparse-2:19.3.0-4854.g8f219c47.el 21/165 2024-09-11T00:13:01.619 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-ceph-common-2:19.3.0-4854.g8f219c47.el9. 22/165 2024-09-11T00:13:01.619 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-cephfs-2:19.3.0-4854.g8f219c47.el9.x86_6 23/165 2024-09-11T00:13:01.619 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-rados-2:19.3.0-4854.g8f219c47.el9.x86_64 24/165 2024-09-11T00:13:01.619 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-rbd-2:19.3.0-4854.g8f219c47.el9.x86_64 25/165 2024-09-11T00:13:01.619 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-rgw-2:19.3.0-4854.g8f219c47.el9.x86_64 26/165 2024-09-11T00:13:01.619 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : rbd-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 27/165 2024-09-11T00:13:01.632 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : rbd-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 28/165 2024-09-11T00:13:01.632 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : rbd-nbd-2:19.3.0-4854.g8f219c47.el9.x86_64 29/165 2024-09-11T00:13:01.632 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-4854.g8f219c47. 30/165 2024-09-11T00:13:01.633 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-4854.g8f219c47.el9.noa 31/165 2024-09-11T00:13:01.633 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-4854.g8f219c47.el9.n 32/165 2024-09-11T00:13:01.633 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-4854.g8f2 33/165 2024-09-11T00:13:01.633 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-4854.g8f219c47.el 34/165 2024-09-11T00:13:01.633 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : ceph-mgr-rook-2:19.3.0-4854.g8f219c47.el9.noarch 35/165 2024-09-11T00:13:01.633 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-4854.g8f219c47.e 36/165 2024-09-11T00:13:01.633 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : ceph-volume-2:19.3.0-4854.g8f219c47.el9.noarch 37/165 2024-09-11T00:13:01.634 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : cephadm-2:19.3.0-4854.g8f219c47.el9.noarch 38/165 2024-09-11T00:13:01.634 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : cephfs-top-2:19.3.0-4854.g8f219c47.el9.noarch 39/165 2024-09-11T00:13:01.634 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/165 2024-09-11T00:13:01.634 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/165 2024-09-11T00:13:01.634 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/165 2024-09-11T00:13:01.634 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/165 2024-09-11T00:13:01.634 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/165 2024-09-11T00:13:01.634 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/165 2024-09-11T00:13:01.634 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/165 2024-09-11T00:13:01.634 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/165 2024-09-11T00:13:01.634 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/165 2024-09-11T00:13:01.634 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/165 2024-09-11T00:13:01.634 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/165 2024-09-11T00:13:01.635 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/165 2024-09-11T00:13:01.635 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/165 2024-09-11T00:13:01.635 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/165 2024-09-11T00:13:01.635 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/165 2024-09-11T00:13:01.635 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/165 2024-09-11T00:13:01.635 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/165 2024-09-11T00:13:01.635 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/165 2024-09-11T00:13:01.635 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : libnbd-1.20.2-2.el9.x86_64 58/165 2024-09-11T00:13:01.636 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 59/165 2024-09-11T00:13:01.636 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 60/165 2024-09-11T00:13:01.636 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 61/165 2024-09-11T00:13:01.636 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 62/165 2024-09-11T00:13:01.636 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 63/165 2024-09-11T00:13:01.636 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 64/165 2024-09-11T00:13:01.636 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 65/165 2024-09-11T00:13:01.636 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : lua-5.4.4-4.el9.x86_64 66/165 2024-09-11T00:13:01.637 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 67/165 2024-09-11T00:13:01.637 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 68/165 2024-09-11T00:13:01.637 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 69/165 2024-09-11T00:13:01.637 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : postgresql-13.16-1.el9.x86_64 70/165 2024-09-11T00:13:01.637 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 71/165 2024-09-11T00:13:01.637 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 72/165 2024-09-11T00:13:01.637 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 73/165 2024-09-11T00:13:01.637 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 74/165 2024-09-11T00:13:01.637 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 75/165 2024-09-11T00:13:01.637 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 76/165 2024-09-11T00:13:01.637 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 77/165 2024-09-11T00:13:01.638 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 78/165 2024-09-11T00:13:01.638 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 79/165 2024-09-11T00:13:01.638 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 80/165 2024-09-11T00:13:01.638 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 81/165 2024-09-11T00:13:01.638 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 82/165 2024-09-11T00:13:01.638 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 83/165 2024-09-11T00:13:01.638 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 84/165 2024-09-11T00:13:01.638 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 85/165 2024-09-11T00:13:01.638 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 86/165 2024-09-11T00:13:01.638 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 87/165 2024-09-11T00:13:01.638 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 88/165 2024-09-11T00:13:01.639 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 89/165 2024-09-11T00:13:01.639 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 90/165 2024-09-11T00:13:01.639 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 91/165 2024-09-11T00:13:01.639 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 92/165 2024-09-11T00:13:01.639 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 93/165 2024-09-11T00:13:01.639 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 94/165 2024-09-11T00:13:01.639 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 95/165 2024-09-11T00:13:01.639 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 96/165 2024-09-11T00:13:01.639 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 97/165 2024-09-11T00:13:01.639 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 98/165 2024-09-11T00:13:01.639 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 99/165 2024-09-11T00:13:01.639 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 100/165 2024-09-11T00:13:01.639 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 101/165 2024-09-11T00:13:01.640 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 102/165 2024-09-11T00:13:01.640 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 103/165 2024-09-11T00:13:01.640 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 104/165 2024-09-11T00:13:01.640 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 105/165 2024-09-11T00:13:01.640 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 106/165 2024-09-11T00:13:01.640 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 107/165 2024-09-11T00:13:01.640 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 108/165 2024-09-11T00:13:01.640 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 109/165 2024-09-11T00:13:01.640 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 110/165 2024-09-11T00:13:01.640 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 111/165 2024-09-11T00:13:01.640 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 112/165 2024-09-11T00:13:01.641 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 113/165 2024-09-11T00:13:01.641 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 114/165 2024-09-11T00:13:01.641 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 115/165 2024-09-11T00:13:01.641 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 116/165 2024-09-11T00:13:01.641 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/165 2024-09-11T00:13:01.641 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/165 2024-09-11T00:13:01.641 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 119/165 2024-09-11T00:13:01.641 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/165 2024-09-11T00:13:01.641 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/165 2024-09-11T00:13:01.641 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/165 2024-09-11T00:13:01.641 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 123/165 2024-09-11T00:13:01.641 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 124/165 2024-09-11T00:13:01.642 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 125/165 2024-09-11T00:13:01.642 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 126/165 2024-09-11T00:13:01.642 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 127/165 2024-09-11T00:13:01.642 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 128/165 2024-09-11T00:13:01.642 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 129/165 2024-09-11T00:13:01.642 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 130/165 2024-09-11T00:13:01.642 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 131/165 2024-09-11T00:13:01.642 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 132/165 2024-09-11T00:13:01.642 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 133/165 2024-09-11T00:13:01.642 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 134/165 2024-09-11T00:13:01.643 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 135/165 2024-09-11T00:13:01.643 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 136/165 2024-09-11T00:13:01.643 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 137/165 2024-09-11T00:13:01.643 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 138/165 2024-09-11T00:13:01.643 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 139/165 2024-09-11T00:13:01.643 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 140/165 2024-09-11T00:13:01.643 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 141/165 2024-09-11T00:13:01.643 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 142/165 2024-09-11T00:13:01.643 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 143/165 2024-09-11T00:13:01.643 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 144/165 2024-09-11T00:13:01.643 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 145/165 2024-09-11T00:13:01.643 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 146/165 2024-09-11T00:13:01.643 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 147/165 2024-09-11T00:13:01.643 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : re2-1:20211101-20.el9.x86_64 148/165 2024-09-11T00:13:01.644 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 149/165 2024-09-11T00:13:01.644 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : librados2-2:19.3.0-4854.g8f219c47.el9.x86_64 150/165 2024-09-11T00:13:01.644 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 151/165 2024-09-11T00:13:01.644 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : librbd1-2:19.3.0-4854.g8f219c47.el9.x86_64 152/165 2024-09-11T00:13:01.644 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 153/165 2024-09-11T00:13:01.644 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : NetworkManager-1:1.49.90-1.el9.x86_64 154/165 2024-09-11T00:13:01.644 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 155/165 2024-09-11T00:13:01.644 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 156/165 2024-09-11T00:13:01.644 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 157/165 2024-09-11T00:13:01.644 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : NetworkManager-team-1:1.49.90-1.el9.x86_64 158/165 2024-09-11T00:13:01.644 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 159/165 2024-09-11T00:13:01.644 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : NetworkManager-tui-1:1.49.90-1.el9.x86_64 160/165 2024-09-11T00:13:01.644 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 161/165 2024-09-11T00:13:01.645 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 162/165 2024-09-11T00:13:01.645 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 163/165 2024-09-11T00:13:01.645 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 164/165 2024-09-11T00:13:01.648 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : rbd-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 143/165 2024-09-11T00:13:01.689 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : rbd-nbd-2:19.3.0-4854.g8f219c47.el9.x86_64 144/165 2024-09-11T00:13:01.722 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 145/165 2024-09-11T00:13:01.749 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 146/165 2024-09-11T00:13:01.936 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : cephfs-shell-2:19.3.0-4854.g8f219c47.el9.x86_64 147/165 2024-09-11T00:13:01.987 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 148/165 2024-09-11T00:13:02.018 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libcephfs-devel-2:19.3.0-4854.g8f219c47.el9.x86_ 149/165 2024-09-11T00:13:02.047 INFO:teuthology.orchestra.run.smithi092.stdout: Upgrading : NetworkManager-team-1:1.49.90-1.el9.x86_64 150/165 2024-09-11T00:13:02.093 INFO:teuthology.orchestra.run.smithi092.stdout: Upgrading : NetworkManager-tui-1:1.49.90-1.el9.x86_64 151/165 2024-09-11T00:13:02.720 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-11T00:13:02.774 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-11T00:13:02.795 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-11T00:13:03.630 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : cephfs-top-2:19.3.0-4854.g8f219c47.el9.noarch 153/165 2024-09-11T00:13:03.720 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 154/165 2024-09-11T00:13:03.773 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 155/165 2024-09-11T00:13:03.864 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : flex-2.6.4-9.el9.x86_64 156/165 2024-09-11T00:13:03.906 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : bison-3.7.4-5.el9.x86_64 157/165 2024-09-11T00:13:03.931 INFO:teuthology.orchestra.run.smithi092.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 158/165 2024-09-11T00:13:03.957 INFO:teuthology.orchestra.run.smithi092.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 159/165 2024-09-11T00:13:03.958 INFO:teuthology.orchestra.run.smithi092.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-11T00:13:04.050 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-11T00:13:04.050 INFO:teuthology.orchestra.run.smithi092.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-11T00:13:04.134 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-11T00:13:04.159 INFO:teuthology.orchestra.run.smithi092.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 162/165 2024-09-11T00:13:04.165 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-11T00:13:04.165 INFO:teuthology.orchestra.run.smithi092.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-11T00:13:04.197 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-11T00:13:04.197 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-11T00:13:04.197 INFO:teuthology.orchestra.run.smithi145.stdout:Upgraded: 2024-09-11T00:13:04.197 INFO:teuthology.orchestra.run.smithi145.stdout: NetworkManager-1:1.49.90-1.el9.x86_64 2024-09-11T00:13:04.197 INFO:teuthology.orchestra.run.smithi145.stdout: NetworkManager-libnm-1:1.49.90-1.el9.x86_64 2024-09-11T00:13:04.197 INFO:teuthology.orchestra.run.smithi145.stdout: NetworkManager-team-1:1.49.90-1.el9.x86_64 2024-09-11T00:13:04.197 INFO:teuthology.orchestra.run.smithi145.stdout: NetworkManager-tui-1:1.49.90-1.el9.x86_64 2024-09-11T00:13:04.197 INFO:teuthology.orchestra.run.smithi145.stdout: librados2-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:13:04.197 INFO:teuthology.orchestra.run.smithi145.stdout: librbd1-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:13:04.197 INFO:teuthology.orchestra.run.smithi145.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-11T00:13:04.198 INFO:teuthology.orchestra.run.smithi145.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-11T00:13:04.198 INFO:teuthology.orchestra.run.smithi145.stdout:Installed: 2024-09-11T00:13:04.198 INFO:teuthology.orchestra.run.smithi145.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-11T00:13:04.198 INFO:teuthology.orchestra.run.smithi145.stdout: automake-1.16.2-8.el9.noarch 2024-09-11T00:13:04.198 INFO:teuthology.orchestra.run.smithi145.stdout: bison-3.7.4-5.el9.x86_64 2024-09-11T00:13:04.198 INFO:teuthology.orchestra.run.smithi145.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-11T00:13:04.198 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:13:04.198 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-base-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:13:04.198 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:13:04.198 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:13:04.198 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-grafana-dashboards-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-11T00:13:04.198 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-immutable-object-cache-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:13:04.198 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-mds-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:13:04.199 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-mgr-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:13:04.199 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-mgr-cephadm-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-11T00:13:04.199 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-mgr-dashboard-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-11T00:13:04.199 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-mgr-diskprediction-local-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-11T00:13:04.199 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-mgr-modules-core-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-11T00:13:04.199 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-mgr-rook-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-11T00:13:04.199 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-mon-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:13:04.199 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-osd-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:13:04.199 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-prometheus-alerts-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-11T00:13:04.200 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-radosgw-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:13:04.200 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-selinux-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:13:04.200 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-test-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:13:04.200 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-volume-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-11T00:13:04.200 INFO:teuthology.orchestra.run.smithi145.stdout: cephadm-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-11T00:13:04.200 INFO:teuthology.orchestra.run.smithi145.stdout: cephfs-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:13:04.200 INFO:teuthology.orchestra.run.smithi145.stdout: cephfs-shell-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:13:04.200 INFO:teuthology.orchestra.run.smithi145.stdout: cephfs-top-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-11T00:13:04.200 INFO:teuthology.orchestra.run.smithi145.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-11T00:13:04.200 INFO:teuthology.orchestra.run.smithi145.stdout: flex-2.6.4-9.el9.x86_64 2024-09-11T00:13:04.200 INFO:teuthology.orchestra.run.smithi145.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-11T00:13:04.200 INFO:teuthology.orchestra.run.smithi145.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-11T00:13:04.201 INFO:teuthology.orchestra.run.smithi145.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-11T00:13:04.201 INFO:teuthology.orchestra.run.smithi145.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-11T00:13:04.201 INFO:teuthology.orchestra.run.smithi145.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-09-11T00:13:04.201 INFO:teuthology.orchestra.run.smithi145.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-11T00:13:04.201 INFO:teuthology.orchestra.run.smithi145.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-11T00:13:04.201 INFO:teuthology.orchestra.run.smithi145.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-11T00:13:04.201 INFO:teuthology.orchestra.run.smithi145.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-11T00:13:04.201 INFO:teuthology.orchestra.run.smithi145.stdout: libcephfs-devel-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:13:04.201 INFO:teuthology.orchestra.run.smithi145.stdout: libcephfs2-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:13:04.201 INFO:teuthology.orchestra.run.smithi145.stdout: libcephsqlite-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:13:04.201 INFO:teuthology.orchestra.run.smithi145.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-11T00:13:04.201 INFO:teuthology.orchestra.run.smithi145.stdout: libnbd-1.20.2-2.el9.x86_64 2024-09-11T00:13:04.201 INFO:teuthology.orchestra.run.smithi145.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-11T00:13:04.202 INFO:teuthology.orchestra.run.smithi145.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-11T00:13:04.202 INFO:teuthology.orchestra.run.smithi145.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-11T00:13:04.202 INFO:teuthology.orchestra.run.smithi145.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-11T00:13:04.202 INFO:teuthology.orchestra.run.smithi145.stdout: librados-devel-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:13:04.202 INFO:teuthology.orchestra.run.smithi145.stdout: libradosstriper1-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:13:04.202 INFO:teuthology.orchestra.run.smithi145.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-11T00:13:04.202 INFO:teuthology.orchestra.run.smithi145.stdout: librgw2-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:13:04.202 INFO:teuthology.orchestra.run.smithi145.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-11T00:13:04.202 INFO:teuthology.orchestra.run.smithi145.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-11T00:13:04.203 INFO:teuthology.orchestra.run.smithi145.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-11T00:13:04.203 INFO:teuthology.orchestra.run.smithi145.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-11T00:13:04.203 INFO:teuthology.orchestra.run.smithi145.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-11T00:13:04.203 INFO:teuthology.orchestra.run.smithi145.stdout: lua-5.4.4-4.el9.x86_64 2024-09-11T00:13:04.203 INFO:teuthology.orchestra.run.smithi145.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-11T00:13:04.203 INFO:teuthology.orchestra.run.smithi145.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-11T00:13:04.203 INFO:teuthology.orchestra.run.smithi145.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-11T00:13:04.203 INFO:teuthology.orchestra.run.smithi145.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-11T00:13:04.203 INFO:teuthology.orchestra.run.smithi145.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-11T00:13:04.203 INFO:teuthology.orchestra.run.smithi145.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-11T00:13:04.203 INFO:teuthology.orchestra.run.smithi145.stdout: postgresql-13.16-1.el9.x86_64 2024-09-11T00:13:04.203 INFO:teuthology.orchestra.run.smithi145.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-11T00:13:04.204 INFO:teuthology.orchestra.run.smithi145.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-11T00:13:04.204 INFO:teuthology.orchestra.run.smithi145.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-11T00:13:04.204 INFO:teuthology.orchestra.run.smithi145.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-11T00:13:04.204 INFO:teuthology.orchestra.run.smithi145.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-11T00:13:04.204 INFO:teuthology.orchestra.run.smithi145.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-11T00:13:04.204 INFO:teuthology.orchestra.run.smithi145.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-11T00:13:04.204 INFO:teuthology.orchestra.run.smithi145.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-11T00:13:04.204 INFO:teuthology.orchestra.run.smithi145.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-11T00:13:04.204 INFO:teuthology.orchestra.run.smithi145.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-11T00:13:04.204 INFO:teuthology.orchestra.run.smithi145.stdout: python3-ceph-argparse-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:13:04.204 INFO:teuthology.orchestra.run.smithi145.stdout: python3-ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:13:04.204 INFO:teuthology.orchestra.run.smithi145.stdout: python3-cephfs-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:13:04.204 INFO:teuthology.orchestra.run.smithi145.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-11T00:13:04.205 INFO:teuthology.orchestra.run.smithi145.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-11T00:13:04.205 INFO:teuthology.orchestra.run.smithi145.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-11T00:13:04.205 INFO:teuthology.orchestra.run.smithi145.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-11T00:13:04.205 INFO:teuthology.orchestra.run.smithi145.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-11T00:13:04.205 INFO:teuthology.orchestra.run.smithi145.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-11T00:13:04.205 INFO:teuthology.orchestra.run.smithi145.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-11T00:13:04.205 INFO:teuthology.orchestra.run.smithi145.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-11T00:13:04.205 INFO:teuthology.orchestra.run.smithi145.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-11T00:13:04.205 INFO:teuthology.orchestra.run.smithi145.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-11T00:13:04.205 INFO:teuthology.orchestra.run.smithi145.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-11T00:13:04.205 INFO:teuthology.orchestra.run.smithi145.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-11T00:13:04.205 INFO:teuthology.orchestra.run.smithi145.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-11T00:13:04.205 INFO:teuthology.orchestra.run.smithi145.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-11T00:13:04.206 INFO:teuthology.orchestra.run.smithi145.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-11T00:13:04.206 INFO:teuthology.orchestra.run.smithi145.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-11T00:13:04.206 INFO:teuthology.orchestra.run.smithi145.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-11T00:13:04.206 INFO:teuthology.orchestra.run.smithi145.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-11T00:13:04.206 INFO:teuthology.orchestra.run.smithi145.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-11T00:13:04.206 INFO:teuthology.orchestra.run.smithi145.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-11T00:13:04.206 INFO:teuthology.orchestra.run.smithi145.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-11T00:13:04.206 INFO:teuthology.orchestra.run.smithi145.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-11T00:13:04.206 INFO:teuthology.orchestra.run.smithi145.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-11T00:13:04.206 INFO:teuthology.orchestra.run.smithi145.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-11T00:13:04.206 INFO:teuthology.orchestra.run.smithi145.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-11T00:13:04.206 INFO:teuthology.orchestra.run.smithi145.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-11T00:13:04.206 INFO:teuthology.orchestra.run.smithi145.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-11T00:13:04.207 INFO:teuthology.orchestra.run.smithi145.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-11T00:13:04.207 INFO:teuthology.orchestra.run.smithi145.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-11T00:13:04.207 INFO:teuthology.orchestra.run.smithi145.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-11T00:13:04.207 INFO:teuthology.orchestra.run.smithi145.stdout: python3-ply-3.11-14.el9.noarch 2024-09-11T00:13:04.207 INFO:teuthology.orchestra.run.smithi145.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-11T00:13:04.207 INFO:teuthology.orchestra.run.smithi145.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-11T00:13:04.207 INFO:teuthology.orchestra.run.smithi145.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-11T00:13:04.207 INFO:teuthology.orchestra.run.smithi145.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-11T00:13:04.207 INFO:teuthology.orchestra.run.smithi145.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-11T00:13:04.207 INFO:teuthology.orchestra.run.smithi145.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-11T00:13:04.207 INFO:teuthology.orchestra.run.smithi145.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-11T00:13:04.207 INFO:teuthology.orchestra.run.smithi145.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-11T00:13:04.207 INFO:teuthology.orchestra.run.smithi145.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-11T00:13:04.208 INFO:teuthology.orchestra.run.smithi145.stdout: python3-rados-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:13:04.208 INFO:teuthology.orchestra.run.smithi145.stdout: python3-rbd-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:13:04.208 INFO:teuthology.orchestra.run.smithi145.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-11T00:13:04.208 INFO:teuthology.orchestra.run.smithi145.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-11T00:13:04.208 INFO:teuthology.orchestra.run.smithi145.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-11T00:13:04.208 INFO:teuthology.orchestra.run.smithi145.stdout: python3-rgw-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:13:04.208 INFO:teuthology.orchestra.run.smithi145.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-11T00:13:04.208 INFO:teuthology.orchestra.run.smithi145.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-11T00:13:04.208 INFO:teuthology.orchestra.run.smithi145.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-11T00:13:04.208 INFO:teuthology.orchestra.run.smithi145.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-11T00:13:04.208 INFO:teuthology.orchestra.run.smithi145.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-11T00:13:04.208 INFO:teuthology.orchestra.run.smithi145.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-11T00:13:04.209 INFO:teuthology.orchestra.run.smithi145.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-11T00:13:04.209 INFO:teuthology.orchestra.run.smithi145.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-11T00:13:04.209 INFO:teuthology.orchestra.run.smithi145.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-11T00:13:04.209 INFO:teuthology.orchestra.run.smithi145.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-11T00:13:04.209 INFO:teuthology.orchestra.run.smithi145.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-11T00:13:04.209 INFO:teuthology.orchestra.run.smithi145.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-11T00:13:04.209 INFO:teuthology.orchestra.run.smithi145.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-11T00:13:04.209 INFO:teuthology.orchestra.run.smithi145.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-11T00:13:04.209 INFO:teuthology.orchestra.run.smithi145.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-11T00:13:04.209 INFO:teuthology.orchestra.run.smithi145.stdout: rbd-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:13:04.209 INFO:teuthology.orchestra.run.smithi145.stdout: rbd-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:13:04.209 INFO:teuthology.orchestra.run.smithi145.stdout: rbd-nbd-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:13:04.209 INFO:teuthology.orchestra.run.smithi145.stdout: re2-1:20211101-20.el9.x86_64 2024-09-11T00:13:04.210 INFO:teuthology.orchestra.run.smithi145.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-11T00:13:04.210 INFO:teuthology.orchestra.run.smithi145.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-11T00:13:04.210 INFO:teuthology.orchestra.run.smithi145.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-11T00:13:04.210 INFO:teuthology.orchestra.run.smithi145.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-11T00:13:04.210 INFO:teuthology.orchestra.run.smithi145.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-11T00:13:04.210 INFO:teuthology.orchestra.run.smithi145.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-11T00:13:04.210 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-11T00:13:04.210 INFO:teuthology.orchestra.run.smithi145.stdout:Complete! 2024-09-11T00:13:04.353 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-11T00:13:04.353 INFO:teuthology.orchestra.run.smithi092.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-11T00:13:04.445 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-11T00:13:04.510 INFO:teuthology.orchestra.run.smithi092.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-11T00:13:04.637 DEBUG:teuthology.parallel:result is None 2024-09-11T00:13:11.103 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-11T00:13:11.104 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-2:19.3.0-4854.g8f219c47.el9.x86_64 1/165 2024-09-11T00:13:11.104 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-base-2:19.3.0-4854.g8f219c47.el9.x86_64 2/165 2024-09-11T00:13:11.104 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 3/165 2024-09-11T00:13:11.104 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 4/165 2024-09-11T00:13:11.104 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-4854.g8f219 5/165 2024-09-11T00:13:11.104 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-mds-2:19.3.0-4854.g8f219c47.el9.x86_64 6/165 2024-09-11T00:13:11.104 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-mgr-2:19.3.0-4854.g8f219c47.el9.x86_64 7/165 2024-09-11T00:13:11.104 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-mon-2:19.3.0-4854.g8f219c47.el9.x86_64 8/165 2024-09-11T00:13:11.105 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-osd-2:19.3.0-4854.g8f219c47.el9.x86_64 9/165 2024-09-11T00:13:11.105 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-radosgw-2:19.3.0-4854.g8f219c47.el9.x86_64 10/165 2024-09-11T00:13:11.105 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-selinux-2:19.3.0-4854.g8f219c47.el9.x86_64 11/165 2024-09-11T00:13:11.105 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-test-2:19.3.0-4854.g8f219c47.el9.x86_64 12/165 2024-09-11T00:13:11.105 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : cephfs-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 13/165 2024-09-11T00:13:11.105 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : cephfs-shell-2:19.3.0-4854.g8f219c47.el9.x86_64 14/165 2024-09-11T00:13:11.105 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libcephfs-devel-2:19.3.0-4854.g8f219c47.el9.x86_ 15/165 2024-09-11T00:13:11.105 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libcephfs2-2:19.3.0-4854.g8f219c47.el9.x86_64 16/165 2024-09-11T00:13:11.105 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libcephsqlite-2:19.3.0-4854.g8f219c47.el9.x86_64 17/165 2024-09-11T00:13:11.105 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : librados-devel-2:19.3.0-4854.g8f219c47.el9.x86_6 18/165 2024-09-11T00:13:11.105 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libradosstriper1-2:19.3.0-4854.g8f219c47.el9.x86 19/165 2024-09-11T00:13:11.105 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : librgw2-2:19.3.0-4854.g8f219c47.el9.x86_64 20/165 2024-09-11T00:13:11.105 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-ceph-argparse-2:19.3.0-4854.g8f219c47.el 21/165 2024-09-11T00:13:11.106 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-ceph-common-2:19.3.0-4854.g8f219c47.el9. 22/165 2024-09-11T00:13:11.106 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-cephfs-2:19.3.0-4854.g8f219c47.el9.x86_6 23/165 2024-09-11T00:13:11.106 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-rados-2:19.3.0-4854.g8f219c47.el9.x86_64 24/165 2024-09-11T00:13:11.106 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-rbd-2:19.3.0-4854.g8f219c47.el9.x86_64 25/165 2024-09-11T00:13:11.106 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-rgw-2:19.3.0-4854.g8f219c47.el9.x86_64 26/165 2024-09-11T00:13:11.106 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : rbd-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 27/165 2024-09-11T00:13:11.118 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : rbd-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 28/165 2024-09-11T00:13:11.118 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : rbd-nbd-2:19.3.0-4854.g8f219c47.el9.x86_64 29/165 2024-09-11T00:13:11.118 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-4854.g8f219c47. 30/165 2024-09-11T00:13:11.118 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-4854.g8f219c47.el9.noa 31/165 2024-09-11T00:13:11.118 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-4854.g8f219c47.el9.n 32/165 2024-09-11T00:13:11.119 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-4854.g8f2 33/165 2024-09-11T00:13:11.119 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-4854.g8f219c47.el 34/165 2024-09-11T00:13:11.119 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-mgr-rook-2:19.3.0-4854.g8f219c47.el9.noarch 35/165 2024-09-11T00:13:11.119 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-4854.g8f219c47.e 36/165 2024-09-11T00:13:11.119 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-volume-2:19.3.0-4854.g8f219c47.el9.noarch 37/165 2024-09-11T00:13:11.119 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : cephadm-2:19.3.0-4854.g8f219c47.el9.noarch 38/165 2024-09-11T00:13:11.119 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : cephfs-top-2:19.3.0-4854.g8f219c47.el9.noarch 39/165 2024-09-11T00:13:11.119 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/165 2024-09-11T00:13:11.119 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/165 2024-09-11T00:13:11.119 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/165 2024-09-11T00:13:11.119 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/165 2024-09-11T00:13:11.119 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/165 2024-09-11T00:13:11.119 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/165 2024-09-11T00:13:11.120 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/165 2024-09-11T00:13:11.120 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/165 2024-09-11T00:13:11.120 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/165 2024-09-11T00:13:11.120 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/165 2024-09-11T00:13:11.120 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/165 2024-09-11T00:13:11.120 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/165 2024-09-11T00:13:11.120 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/165 2024-09-11T00:13:11.120 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/165 2024-09-11T00:13:11.120 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/165 2024-09-11T00:13:11.120 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/165 2024-09-11T00:13:11.120 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/165 2024-09-11T00:13:11.121 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/165 2024-09-11T00:13:11.121 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libnbd-1.20.2-2.el9.x86_64 58/165 2024-09-11T00:13:11.121 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 59/165 2024-09-11T00:13:11.121 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 60/165 2024-09-11T00:13:11.121 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 61/165 2024-09-11T00:13:11.121 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 62/165 2024-09-11T00:13:11.121 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 63/165 2024-09-11T00:13:11.121 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 64/165 2024-09-11T00:13:11.121 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 65/165 2024-09-11T00:13:11.121 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : lua-5.4.4-4.el9.x86_64 66/165 2024-09-11T00:13:11.121 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 67/165 2024-09-11T00:13:11.121 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 68/165 2024-09-11T00:13:11.121 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 69/165 2024-09-11T00:13:11.122 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : postgresql-13.16-1.el9.x86_64 70/165 2024-09-11T00:13:11.122 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 71/165 2024-09-11T00:13:11.122 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 72/165 2024-09-11T00:13:11.122 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 73/165 2024-09-11T00:13:11.122 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 74/165 2024-09-11T00:13:11.122 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 75/165 2024-09-11T00:13:11.122 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 76/165 2024-09-11T00:13:11.122 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 77/165 2024-09-11T00:13:11.122 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 78/165 2024-09-11T00:13:11.122 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 79/165 2024-09-11T00:13:11.122 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 80/165 2024-09-11T00:13:11.122 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 81/165 2024-09-11T00:13:11.122 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 82/165 2024-09-11T00:13:11.122 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 83/165 2024-09-11T00:13:11.123 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 84/165 2024-09-11T00:13:11.123 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 85/165 2024-09-11T00:13:11.123 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 86/165 2024-09-11T00:13:11.123 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 87/165 2024-09-11T00:13:11.123 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 88/165 2024-09-11T00:13:11.123 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 89/165 2024-09-11T00:13:11.123 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 90/165 2024-09-11T00:13:11.123 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 91/165 2024-09-11T00:13:11.123 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 92/165 2024-09-11T00:13:11.123 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 93/165 2024-09-11T00:13:11.123 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 94/165 2024-09-11T00:13:11.123 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 95/165 2024-09-11T00:13:11.124 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 96/165 2024-09-11T00:13:11.124 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 97/165 2024-09-11T00:13:11.124 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 98/165 2024-09-11T00:13:11.124 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 99/165 2024-09-11T00:13:11.124 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 100/165 2024-09-11T00:13:11.124 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 101/165 2024-09-11T00:13:11.124 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 102/165 2024-09-11T00:13:11.124 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 103/165 2024-09-11T00:13:11.124 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 104/165 2024-09-11T00:13:11.124 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 105/165 2024-09-11T00:13:11.124 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 106/165 2024-09-11T00:13:11.124 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 107/165 2024-09-11T00:13:11.124 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 108/165 2024-09-11T00:13:11.124 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 109/165 2024-09-11T00:13:11.125 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 110/165 2024-09-11T00:13:11.125 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 111/165 2024-09-11T00:13:11.125 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 112/165 2024-09-11T00:13:11.125 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 113/165 2024-09-11T00:13:11.125 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 114/165 2024-09-11T00:13:11.125 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 115/165 2024-09-11T00:13:11.125 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 116/165 2024-09-11T00:13:11.125 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/165 2024-09-11T00:13:11.125 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/165 2024-09-11T00:13:11.125 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 119/165 2024-09-11T00:13:11.125 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/165 2024-09-11T00:13:11.125 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/165 2024-09-11T00:13:11.125 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/165 2024-09-11T00:13:11.126 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 123/165 2024-09-11T00:13:11.126 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 124/165 2024-09-11T00:13:11.126 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 125/165 2024-09-11T00:13:11.126 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 126/165 2024-09-11T00:13:11.126 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 127/165 2024-09-11T00:13:11.126 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 128/165 2024-09-11T00:13:11.126 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 129/165 2024-09-11T00:13:11.126 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 130/165 2024-09-11T00:13:11.126 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 131/165 2024-09-11T00:13:11.126 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 132/165 2024-09-11T00:13:11.126 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 133/165 2024-09-11T00:13:11.126 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 134/165 2024-09-11T00:13:11.127 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 135/165 2024-09-11T00:13:11.127 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 136/165 2024-09-11T00:13:11.127 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 137/165 2024-09-11T00:13:11.127 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 138/165 2024-09-11T00:13:11.127 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 139/165 2024-09-11T00:13:11.127 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 140/165 2024-09-11T00:13:11.127 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 141/165 2024-09-11T00:13:11.127 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 142/165 2024-09-11T00:13:11.127 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 143/165 2024-09-11T00:13:11.127 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 144/165 2024-09-11T00:13:11.127 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 145/165 2024-09-11T00:13:11.127 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 146/165 2024-09-11T00:13:11.127 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 147/165 2024-09-11T00:13:11.128 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : re2-1:20211101-20.el9.x86_64 148/165 2024-09-11T00:13:11.128 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 149/165 2024-09-11T00:13:11.128 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : librados2-2:19.3.0-4854.g8f219c47.el9.x86_64 150/165 2024-09-11T00:13:11.128 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 151/165 2024-09-11T00:13:11.128 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : librbd1-2:19.3.0-4854.g8f219c47.el9.x86_64 152/165 2024-09-11T00:13:11.128 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 153/165 2024-09-11T00:13:11.128 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : NetworkManager-1:1.49.90-1.el9.x86_64 154/165 2024-09-11T00:13:11.128 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 155/165 2024-09-11T00:13:11.128 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 156/165 2024-09-11T00:13:11.128 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 157/165 2024-09-11T00:13:11.128 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : NetworkManager-team-1:1.49.90-1.el9.x86_64 158/165 2024-09-11T00:13:11.128 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 159/165 2024-09-11T00:13:11.128 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : NetworkManager-tui-1:1.49.90-1.el9.x86_64 160/165 2024-09-11T00:13:11.128 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 161/165 2024-09-11T00:13:11.129 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 162/165 2024-09-11T00:13:11.129 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 163/165 2024-09-11T00:13:11.129 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 164/165 2024-09-11T00:13:13.708 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-11T00:13:13.709 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:13:13.709 INFO:teuthology.orchestra.run.smithi092.stdout:Upgraded: 2024-09-11T00:13:13.709 INFO:teuthology.orchestra.run.smithi092.stdout: NetworkManager-1:1.49.90-1.el9.x86_64 2024-09-11T00:13:13.709 INFO:teuthology.orchestra.run.smithi092.stdout: NetworkManager-libnm-1:1.49.90-1.el9.x86_64 2024-09-11T00:13:13.709 INFO:teuthology.orchestra.run.smithi092.stdout: NetworkManager-team-1:1.49.90-1.el9.x86_64 2024-09-11T00:13:13.709 INFO:teuthology.orchestra.run.smithi092.stdout: NetworkManager-tui-1:1.49.90-1.el9.x86_64 2024-09-11T00:13:13.709 INFO:teuthology.orchestra.run.smithi092.stdout: librados2-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:13:13.709 INFO:teuthology.orchestra.run.smithi092.stdout: librbd1-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:13:13.709 INFO:teuthology.orchestra.run.smithi092.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-11T00:13:13.709 INFO:teuthology.orchestra.run.smithi092.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-11T00:13:13.709 INFO:teuthology.orchestra.run.smithi092.stdout:Installed: 2024-09-11T00:13:13.709 INFO:teuthology.orchestra.run.smithi092.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-11T00:13:13.710 INFO:teuthology.orchestra.run.smithi092.stdout: automake-1.16.2-8.el9.noarch 2024-09-11T00:13:13.710 INFO:teuthology.orchestra.run.smithi092.stdout: bison-3.7.4-5.el9.x86_64 2024-09-11T00:13:13.710 INFO:teuthology.orchestra.run.smithi092.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-11T00:13:13.710 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:13:13.710 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-base-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:13:13.710 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:13:13.710 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:13:13.710 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-grafana-dashboards-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-11T00:13:13.710 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-immutable-object-cache-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:13:13.710 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mds-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:13:13.710 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mgr-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:13:13.710 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mgr-cephadm-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-11T00:13:13.711 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mgr-dashboard-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-11T00:13:13.711 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mgr-diskprediction-local-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-11T00:13:13.711 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mgr-modules-core-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-11T00:13:13.711 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mgr-rook-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-11T00:13:13.711 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mon-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:13:13.711 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-osd-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:13:13.711 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-prometheus-alerts-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-11T00:13:13.711 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-radosgw-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:13:13.711 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-selinux-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:13:13.711 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-test-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:13:13.711 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-volume-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-11T00:13:13.711 INFO:teuthology.orchestra.run.smithi092.stdout: cephadm-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-11T00:13:13.711 INFO:teuthology.orchestra.run.smithi092.stdout: cephfs-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:13:13.712 INFO:teuthology.orchestra.run.smithi092.stdout: cephfs-shell-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:13:13.712 INFO:teuthology.orchestra.run.smithi092.stdout: cephfs-top-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-11T00:13:13.712 INFO:teuthology.orchestra.run.smithi092.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-11T00:13:13.712 INFO:teuthology.orchestra.run.smithi092.stdout: flex-2.6.4-9.el9.x86_64 2024-09-11T00:13:13.712 INFO:teuthology.orchestra.run.smithi092.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-11T00:13:13.712 INFO:teuthology.orchestra.run.smithi092.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-11T00:13:13.712 INFO:teuthology.orchestra.run.smithi092.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-11T00:13:13.712 INFO:teuthology.orchestra.run.smithi092.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-11T00:13:13.712 INFO:teuthology.orchestra.run.smithi092.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-09-11T00:13:13.712 INFO:teuthology.orchestra.run.smithi092.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-11T00:13:13.712 INFO:teuthology.orchestra.run.smithi092.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-11T00:13:13.713 INFO:teuthology.orchestra.run.smithi092.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-11T00:13:13.713 INFO:teuthology.orchestra.run.smithi092.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-11T00:13:13.713 INFO:teuthology.orchestra.run.smithi092.stdout: libcephfs-devel-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:13:13.713 INFO:teuthology.orchestra.run.smithi092.stdout: libcephfs2-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:13:13.713 INFO:teuthology.orchestra.run.smithi092.stdout: libcephsqlite-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:13:13.713 INFO:teuthology.orchestra.run.smithi092.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-11T00:13:13.713 INFO:teuthology.orchestra.run.smithi092.stdout: libnbd-1.20.2-2.el9.x86_64 2024-09-11T00:13:13.713 INFO:teuthology.orchestra.run.smithi092.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-11T00:13:13.713 INFO:teuthology.orchestra.run.smithi092.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-11T00:13:13.713 INFO:teuthology.orchestra.run.smithi092.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-11T00:13:13.713 INFO:teuthology.orchestra.run.smithi092.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-11T00:13:13.713 INFO:teuthology.orchestra.run.smithi092.stdout: librados-devel-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:13:13.713 INFO:teuthology.orchestra.run.smithi092.stdout: libradosstriper1-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:13:13.714 INFO:teuthology.orchestra.run.smithi092.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-11T00:13:13.714 INFO:teuthology.orchestra.run.smithi092.stdout: librgw2-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:13:13.714 INFO:teuthology.orchestra.run.smithi092.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-11T00:13:13.714 INFO:teuthology.orchestra.run.smithi092.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-11T00:13:13.714 INFO:teuthology.orchestra.run.smithi092.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-11T00:13:13.714 INFO:teuthology.orchestra.run.smithi092.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-11T00:13:13.714 INFO:teuthology.orchestra.run.smithi092.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-11T00:13:13.714 INFO:teuthology.orchestra.run.smithi092.stdout: lua-5.4.4-4.el9.x86_64 2024-09-11T00:13:13.714 INFO:teuthology.orchestra.run.smithi092.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-11T00:13:13.714 INFO:teuthology.orchestra.run.smithi092.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-11T00:13:13.714 INFO:teuthology.orchestra.run.smithi092.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-11T00:13:13.714 INFO:teuthology.orchestra.run.smithi092.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-11T00:13:13.715 INFO:teuthology.orchestra.run.smithi092.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-11T00:13:13.715 INFO:teuthology.orchestra.run.smithi092.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-11T00:13:13.715 INFO:teuthology.orchestra.run.smithi092.stdout: postgresql-13.16-1.el9.x86_64 2024-09-11T00:13:13.715 INFO:teuthology.orchestra.run.smithi092.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-11T00:13:13.715 INFO:teuthology.orchestra.run.smithi092.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-11T00:13:13.715 INFO:teuthology.orchestra.run.smithi092.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-11T00:13:13.715 INFO:teuthology.orchestra.run.smithi092.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-11T00:13:13.715 INFO:teuthology.orchestra.run.smithi092.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-11T00:13:13.715 INFO:teuthology.orchestra.run.smithi092.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-11T00:13:13.715 INFO:teuthology.orchestra.run.smithi092.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-11T00:13:13.715 INFO:teuthology.orchestra.run.smithi092.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-11T00:13:13.715 INFO:teuthology.orchestra.run.smithi092.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-11T00:13:13.715 INFO:teuthology.orchestra.run.smithi092.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-11T00:13:13.716 INFO:teuthology.orchestra.run.smithi092.stdout: python3-ceph-argparse-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:13:13.716 INFO:teuthology.orchestra.run.smithi092.stdout: python3-ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:13:13.716 INFO:teuthology.orchestra.run.smithi092.stdout: python3-cephfs-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:13:13.716 INFO:teuthology.orchestra.run.smithi092.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-11T00:13:13.716 INFO:teuthology.orchestra.run.smithi092.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-11T00:13:13.716 INFO:teuthology.orchestra.run.smithi092.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-11T00:13:13.716 INFO:teuthology.orchestra.run.smithi092.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-11T00:13:13.716 INFO:teuthology.orchestra.run.smithi092.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-11T00:13:13.716 INFO:teuthology.orchestra.run.smithi092.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-11T00:13:13.716 INFO:teuthology.orchestra.run.smithi092.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-11T00:13:13.716 INFO:teuthology.orchestra.run.smithi092.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-11T00:13:13.716 INFO:teuthology.orchestra.run.smithi092.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-11T00:13:13.716 INFO:teuthology.orchestra.run.smithi092.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-11T00:13:13.717 INFO:teuthology.orchestra.run.smithi092.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-11T00:13:13.717 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-11T00:13:13.717 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-11T00:13:13.717 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-11T00:13:13.717 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-11T00:13:13.717 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-11T00:13:13.717 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-11T00:13:13.717 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-11T00:13:13.717 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-11T00:13:13.717 INFO:teuthology.orchestra.run.smithi092.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-11T00:13:13.717 INFO:teuthology.orchestra.run.smithi092.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-11T00:13:13.717 INFO:teuthology.orchestra.run.smithi092.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-11T00:13:13.717 INFO:teuthology.orchestra.run.smithi092.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-11T00:13:13.718 INFO:teuthology.orchestra.run.smithi092.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-11T00:13:13.718 INFO:teuthology.orchestra.run.smithi092.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-11T00:13:13.718 INFO:teuthology.orchestra.run.smithi092.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-11T00:13:13.718 INFO:teuthology.orchestra.run.smithi092.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-11T00:13:13.718 INFO:teuthology.orchestra.run.smithi092.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-11T00:13:13.718 INFO:teuthology.orchestra.run.smithi092.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-11T00:13:13.718 INFO:teuthology.orchestra.run.smithi092.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-11T00:13:13.718 INFO:teuthology.orchestra.run.smithi092.stdout: python3-ply-3.11-14.el9.noarch 2024-09-11T00:13:13.718 INFO:teuthology.orchestra.run.smithi092.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-11T00:13:13.718 INFO:teuthology.orchestra.run.smithi092.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-11T00:13:13.718 INFO:teuthology.orchestra.run.smithi092.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-11T00:13:13.718 INFO:teuthology.orchestra.run.smithi092.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-11T00:13:13.718 INFO:teuthology.orchestra.run.smithi092.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-11T00:13:13.719 INFO:teuthology.orchestra.run.smithi092.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-11T00:13:13.719 INFO:teuthology.orchestra.run.smithi092.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-11T00:13:13.719 INFO:teuthology.orchestra.run.smithi092.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-11T00:13:13.719 INFO:teuthology.orchestra.run.smithi092.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-11T00:13:13.719 INFO:teuthology.orchestra.run.smithi092.stdout: python3-rados-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:13:13.719 INFO:teuthology.orchestra.run.smithi092.stdout: python3-rbd-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:13:13.719 INFO:teuthology.orchestra.run.smithi092.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-11T00:13:13.719 INFO:teuthology.orchestra.run.smithi092.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-11T00:13:13.719 INFO:teuthology.orchestra.run.smithi092.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-11T00:13:13.719 INFO:teuthology.orchestra.run.smithi092.stdout: python3-rgw-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:13:13.719 INFO:teuthology.orchestra.run.smithi092.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-11T00:13:13.719 INFO:teuthology.orchestra.run.smithi092.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-11T00:13:13.720 INFO:teuthology.orchestra.run.smithi092.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-11T00:13:13.720 INFO:teuthology.orchestra.run.smithi092.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-11T00:13:13.720 INFO:teuthology.orchestra.run.smithi092.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-11T00:13:13.720 INFO:teuthology.orchestra.run.smithi092.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-11T00:13:13.720 INFO:teuthology.orchestra.run.smithi092.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-11T00:13:13.720 INFO:teuthology.orchestra.run.smithi092.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-11T00:13:13.720 INFO:teuthology.orchestra.run.smithi092.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-11T00:13:13.720 INFO:teuthology.orchestra.run.smithi092.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-11T00:13:13.720 INFO:teuthology.orchestra.run.smithi092.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-11T00:13:13.720 INFO:teuthology.orchestra.run.smithi092.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-11T00:13:13.720 INFO:teuthology.orchestra.run.smithi092.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-11T00:13:13.720 INFO:teuthology.orchestra.run.smithi092.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-11T00:13:13.721 INFO:teuthology.orchestra.run.smithi092.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-11T00:13:13.721 INFO:teuthology.orchestra.run.smithi092.stdout: rbd-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:13:13.721 INFO:teuthology.orchestra.run.smithi092.stdout: rbd-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:13:13.721 INFO:teuthology.orchestra.run.smithi092.stdout: rbd-nbd-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:13:13.721 INFO:teuthology.orchestra.run.smithi092.stdout: re2-1:20211101-20.el9.x86_64 2024-09-11T00:13:13.721 INFO:teuthology.orchestra.run.smithi092.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-11T00:13:13.721 INFO:teuthology.orchestra.run.smithi092.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-11T00:13:13.721 INFO:teuthology.orchestra.run.smithi092.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-11T00:13:13.721 INFO:teuthology.orchestra.run.smithi092.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-11T00:13:13.721 INFO:teuthology.orchestra.run.smithi092.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-11T00:13:13.722 INFO:teuthology.orchestra.run.smithi092.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-11T00:13:13.722 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:13:13.722 INFO:teuthology.orchestra.run.smithi092.stdout:Complete! 2024-09-11T00:13:14.157 DEBUG:teuthology.parallel:result is None 2024-09-11T00:13:14.158 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8f219c476cb4f26fc5719c661c0323719a45cb30 2024-09-11T00:13:14.320 DEBUG:teuthology.orchestra.run.smithi092:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-11T00:13:14.342 INFO:teuthology.orchestra.run.smithi092.stdout:19.3.0-4854.g8f219c47.el9 2024-09-11T00:13:14.343 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4854.g8f219c47.el9 2024-09-11T00:13:14.343 INFO:teuthology.task.install:The correct ceph version 19.3.0-4854.g8f219c47 is installed. 2024-09-11T00:13:14.345 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8f219c476cb4f26fc5719c661c0323719a45cb30 2024-09-11T00:13:14.502 DEBUG:teuthology.orchestra.run.smithi145:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-11T00:13:14.529 INFO:teuthology.orchestra.run.smithi145.stdout:19.3.0-4854.g8f219c47.el9 2024-09-11T00:13:14.530 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4854.g8f219c47.el9 2024-09-11T00:13:14.530 INFO:teuthology.task.install:The correct ceph version 19.3.0-4854.g8f219c47 is installed. 2024-09-11T00:13:14.531 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-11T00:13:14.532 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2024-09-11T00:13:14.532 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-11T00:13:14.560 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2024-09-11T00:13:14.560 DEBUG:teuthology.orchestra.run.smithi145:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-11T00:13:14.603 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-11T00:13:14.603 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2024-09-11T00:13:14.603 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd of=/usr/bin/daemon-helper 2024-09-11T00:13:14.628 DEBUG:teuthology.orchestra.run.smithi092:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-11T00:13:14.692 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2024-09-11T00:13:14.693 DEBUG:teuthology.orchestra.run.smithi145:> sudo dd of=/usr/bin/daemon-helper 2024-09-11T00:13:14.721 DEBUG:teuthology.orchestra.run.smithi145:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-11T00:13:14.788 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-11T00:13:14.788 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2024-09-11T00:13:14.788 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-11T00:13:14.813 DEBUG:teuthology.orchestra.run.smithi092:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-11T00:13:14.878 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2024-09-11T00:13:14.878 DEBUG:teuthology.orchestra.run.smithi145:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-11T00:13:14.905 DEBUG:teuthology.orchestra.run.smithi145:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-11T00:13:14.971 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-11T00:13:14.971 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2024-09-11T00:13:14.971 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd of=/usr/bin/stdin-killer 2024-09-11T00:13:14.996 DEBUG:teuthology.orchestra.run.smithi092:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-11T00:13:15.061 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2024-09-11T00:13:15.061 DEBUG:teuthology.orchestra.run.smithi145:> sudo dd of=/usr/bin/stdin-killer 2024-09-11T00:13:15.087 DEBUG:teuthology.orchestra.run.smithi145:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-11T00:13:15.152 INFO:teuthology.run_tasks:Running task ceph... 2024-09-11T00:13:15.256 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-09-11T00:13:15.256 DEBUG:teuthology.orchestra.run.smithi092:> sudo chmod 777 /var/log/ceph 2024-09-11T00:13:15.258 DEBUG:teuthology.orchestra.run.smithi145:> sudo chmod 777 /var/log/ceph 2024-09-11T00:13:15.283 INFO:tasks.ceph:Disabling ceph logrotate... 2024-09-11T00:13:15.283 DEBUG:teuthology.orchestra.run.smithi092:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-11T00:13:15.323 DEBUG:teuthology.orchestra.run.smithi145:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-11T00:13:15.348 INFO:tasks.ceph:Creating extra log directories... 2024-09-11T00:13:15.348 DEBUG:teuthology.orchestra.run.smithi092:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-11T00:13:15.388 DEBUG:teuthology.orchestra.run.smithi145:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-11T00:13:15.515 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-09-11T00:13:15.515 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-09-11T00:13:15.515 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-09-11T00:13:15.515 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2024-09-11T00:13:15.515 DEBUG:teuthology.orchestra.run.smithi092:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-09-11T00:13:15.531 DEBUG:teuthology.orchestra.run.smithi092:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-09-11T00:13:15.649 DEBUG:teuthology.orchestra.run.smithi092:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-09-11T00:13:15.673 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2024-09-11T00:13:15.674 DEBUG:teuthology.orchestra.run.smithi145:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-09-11T00:13:15.689 DEBUG:teuthology.orchestra.run.smithi145:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-09-11T00:13:15.805 DEBUG:teuthology.orchestra.run.smithi145:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-09-11T00:13:15.835 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-09-11T00:13:15.835 INFO:tasks.ceph:config {'conf': {'client': {'pid file': ''}, 'global': {'ms die on skipped message': False}, 'mgr': {'client mount timeout': 30, 'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'fs.*is degraded', 'filesystem is degraded', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'filesystem is offline', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'insufficient standby MDS daemons available', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-09-11T00:13:15.835 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi/7899833', 'branch': 'wip-hemanth-testing-2024-09-10-0723', 'description': 'fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v2 tasks/xfstests-dev}', 'email': 'hyelloji@redhat.com', 'first_in_suite': False, 'job_id': '7899833', 'kernel': {'client': {'sha1': 'distro'}, 'flavor': 'default', 'kdb': 1, 'sha1': '2ca44a2f35ca8f36983aaaa46d49312239ef519a'}, 'ktype': 'distro', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi', 'no_nested_subset': False, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-hemanth-testing-2024-09-10-0723'}, 'ceph': {'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'cluster-conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 2, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon': {'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'osd op complaint time': 180}}, 'conf': {'client': {'pid file': ''}, 'global': {'ms die on skipped message': False}, 'mgr': {'client mount timeout': 30, 'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'fs.*is degraded', 'filesystem is degraded', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'filesystem is offline', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'insufficient standby MDS daemons available', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy'], 'sha1': '8f219c476cb4f26fc5719c661c0323719a45cb30'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '8f219c476cb4f26fc5719c661c0323719a45cb30'}}, 'kclient': {'syntax': 'v1'}, 'subvolume_version': 2, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-hemanth-testing-2024-09-10-0723', 'sha1': '8f219c476cb4f26fc5719c661c0323719a45cb30'}}, 'owner': 'scheduled_hyelloji@teuthology', 'priority': 100, 'repo': 'https://github.com/ceph/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 6190, 'sha1': '8f219c476cb4f26fc5719c661c0323719a45cb30', 'sleep_before_teardown': 0, 'subset': '479/1024', 'suite': 'fs', 'suite_branch': 'wip-hemanth-testing-2024-09-10-0723', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph-c_8f219c476cb4f26fc5719c661c0323719a45cb30/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph-ci.git', 'suite_sha1': '8f219c476cb4f26fc5719c661c0323719a45cb30', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi092.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAyec3NWnFfM97aJ2HY8FYEPRfUJBlEB2Sd7yjNNnekvP+y1HpqvkIfn1f4EUJz/VR+Is8Zryj/hqXtnYg3/aGY=', 'smithi145.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLEbD1QYRqlpqyXt1BdtvkMS/R4UtuJHIFh7QaAyxYNg+QfZlN4VST9UbjD0vKJPS9jPIuHqA31+NY6bmgqH0g8='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'sha1': 'distro'}, 'flavor': 'default', 'kdb': 1, 'sha1': '2ca44a2f35ca8f36983aaaa46d49312239ef519a'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '8f219c476cb4f26fc5719c661c0323719a45cb30'}}, {'ceph': {'create_rbd_pool': False, 'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'cluster-conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 2, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon': {'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'osd op complaint time': 180}}, 'conf': {'client': {'pid file': ''}, 'global': {'ms die on skipped message': False}, 'mgr': {'client mount timeout': 30, 'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'fs.*is degraded', 'filesystem is degraded', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'filesystem is offline', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'insufficient standby MDS daemons available', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy'], 'sha1': '8f219c476cb4f26fc5719c661c0323719a45cb30', 'cluster': 'ceph'}}, {'kclient': None}, {'cephfs_test_runner': {'fail_on_skip': False, 'modules': ['tasks.cephfs.tests_from_xfstests_dev']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': '3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a', 'timestamp': '2024-09-10_16:59:47', 'tube': 'smithi', 'user': 'hyelloji', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856'} 2024-09-11T00:13:15.836 DEBUG:teuthology.orchestra.run.smithi092:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-11T00:13:15.838 DEBUG:teuthology.orchestra.run.smithi145:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-11T00:13:15.885 DEBUG:teuthology.orchestra.run.smithi092:> sudo install -d -m0777 -- /var/run/ceph 2024-09-11T00:13:15.893 DEBUG:teuthology.orchestra.run.smithi145:> sudo install -d -m0777 -- /var/run/ceph 2024-09-11T00:13:15.949 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2024-09-11T00:13:15.949 DEBUG:teuthology.orchestra.run.smithi092:> dd if=/scratch_devs of=/dev/stdout 2024-09-11T00:13:15.972 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-11T00:13:15.972 DEBUG:teuthology.orchestra.run.smithi092:> stat /dev/vg_nvme/lv_1 2024-09-11T00:13:16.027 INFO:teuthology.orchestra.run.smithi092.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-11T00:13:16.027 INFO:teuthology.orchestra.run.smithi092.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-11T00:13:16.027 INFO:teuthology.orchestra.run.smithi092.stdout:Device: 5h/5d Inode: 665 Links: 1 2024-09-11T00:13:16.027 INFO:teuthology.orchestra.run.smithi092.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-11T00:13:16.028 INFO:teuthology.orchestra.run.smithi092.stdout:Context: system_u:object_r:device_t:s0 2024-09-11T00:13:16.028 INFO:teuthology.orchestra.run.smithi092.stdout:Access: 2024-09-11 00:13:04.879529849 +0000 2024-09-11T00:13:16.028 INFO:teuthology.orchestra.run.smithi092.stdout:Modify: 2024-09-11 00:10:59.653276203 +0000 2024-09-11T00:13:16.028 INFO:teuthology.orchestra.run.smithi092.stdout:Change: 2024-09-11 00:10:59.653276203 +0000 2024-09-11T00:13:16.028 INFO:teuthology.orchestra.run.smithi092.stdout: Birth: 2024-09-11 00:10:59.653276203 +0000 2024-09-11T00:13:16.028 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-11T00:13:16.090 INFO:teuthology.orchestra.run.smithi092.stderr:1+0 records in 2024-09-11T00:13:16.090 INFO:teuthology.orchestra.run.smithi092.stderr:1+0 records out 2024-09-11T00:13:16.091 INFO:teuthology.orchestra.run.smithi092.stderr:512 bytes copied, 0.000225881 s, 2.3 MB/s 2024-09-11T00:13:16.092 DEBUG:teuthology.orchestra.run.smithi092:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-11T00:13:16.148 DEBUG:teuthology.orchestra.run.smithi092:> stat /dev/vg_nvme/lv_2 2024-09-11T00:13:16.203 INFO:teuthology.orchestra.run.smithi092.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-11T00:13:16.203 INFO:teuthology.orchestra.run.smithi092.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-11T00:13:16.203 INFO:teuthology.orchestra.run.smithi092.stdout:Device: 5h/5d Inode: 686 Links: 1 2024-09-11T00:13:16.204 INFO:teuthology.orchestra.run.smithi092.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-11T00:13:16.204 INFO:teuthology.orchestra.run.smithi092.stdout:Context: system_u:object_r:device_t:s0 2024-09-11T00:13:16.204 INFO:teuthology.orchestra.run.smithi092.stdout:Access: 2024-09-11 00:13:04.879529849 +0000 2024-09-11T00:13:16.204 INFO:teuthology.orchestra.run.smithi092.stdout:Modify: 2024-09-11 00:10:59.982266376 +0000 2024-09-11T00:13:16.204 INFO:teuthology.orchestra.run.smithi092.stdout:Change: 2024-09-11 00:10:59.982266376 +0000 2024-09-11T00:13:16.204 INFO:teuthology.orchestra.run.smithi092.stdout: Birth: 2024-09-11 00:10:59.982266376 +0000 2024-09-11T00:13:16.204 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-11T00:13:16.266 INFO:teuthology.orchestra.run.smithi092.stderr:1+0 records in 2024-09-11T00:13:16.266 INFO:teuthology.orchestra.run.smithi092.stderr:1+0 records out 2024-09-11T00:13:16.266 INFO:teuthology.orchestra.run.smithi092.stderr:512 bytes copied, 0.000162314 s, 3.2 MB/s 2024-09-11T00:13:16.267 DEBUG:teuthology.orchestra.run.smithi092:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-11T00:13:16.323 DEBUG:teuthology.orchestra.run.smithi092:> stat /dev/vg_nvme/lv_3 2024-09-11T00:13:16.378 INFO:teuthology.orchestra.run.smithi092.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-11T00:13:16.378 INFO:teuthology.orchestra.run.smithi092.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-11T00:13:16.378 INFO:teuthology.orchestra.run.smithi092.stdout:Device: 5h/5d Inode: 704 Links: 1 2024-09-11T00:13:16.379 INFO:teuthology.orchestra.run.smithi092.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-11T00:13:16.379 INFO:teuthology.orchestra.run.smithi092.stdout:Context: system_u:object_r:device_t:s0 2024-09-11T00:13:16.379 INFO:teuthology.orchestra.run.smithi092.stdout:Access: 2024-09-11 00:13:04.880529819 +0000 2024-09-11T00:13:16.379 INFO:teuthology.orchestra.run.smithi092.stdout:Modify: 2024-09-11 00:11:00.301256849 +0000 2024-09-11T00:13:16.379 INFO:teuthology.orchestra.run.smithi092.stdout:Change: 2024-09-11 00:11:00.301256849 +0000 2024-09-11T00:13:16.379 INFO:teuthology.orchestra.run.smithi092.stdout: Birth: 2024-09-11 00:11:00.301256849 +0000 2024-09-11T00:13:16.379 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-11T00:13:16.441 INFO:teuthology.orchestra.run.smithi092.stderr:1+0 records in 2024-09-11T00:13:16.441 INFO:teuthology.orchestra.run.smithi092.stderr:1+0 records out 2024-09-11T00:13:16.441 INFO:teuthology.orchestra.run.smithi092.stderr:512 bytes copied, 0.000199315 s, 2.6 MB/s 2024-09-11T00:13:16.443 DEBUG:teuthology.orchestra.run.smithi092:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-11T00:13:16.499 DEBUG:teuthology.orchestra.run.smithi092:> stat /dev/vg_nvme/lv_4 2024-09-11T00:13:16.554 INFO:teuthology.orchestra.run.smithi092.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-11T00:13:16.554 INFO:teuthology.orchestra.run.smithi092.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-11T00:13:16.554 INFO:teuthology.orchestra.run.smithi092.stdout:Device: 5h/5d Inode: 724 Links: 1 2024-09-11T00:13:16.554 INFO:teuthology.orchestra.run.smithi092.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-11T00:13:16.555 INFO:teuthology.orchestra.run.smithi092.stdout:Context: system_u:object_r:device_t:s0 2024-09-11T00:13:16.555 INFO:teuthology.orchestra.run.smithi092.stdout:Access: 2024-09-11 00:13:04.880529819 +0000 2024-09-11T00:13:16.555 INFO:teuthology.orchestra.run.smithi092.stdout:Modify: 2024-09-11 00:11:00.626247142 +0000 2024-09-11T00:13:16.555 INFO:teuthology.orchestra.run.smithi092.stdout:Change: 2024-09-11 00:11:00.626247142 +0000 2024-09-11T00:13:16.555 INFO:teuthology.orchestra.run.smithi092.stdout: Birth: 2024-09-11 00:11:00.626247142 +0000 2024-09-11T00:13:16.555 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-11T00:13:16.617 INFO:teuthology.orchestra.run.smithi092.stderr:1+0 records in 2024-09-11T00:13:16.618 INFO:teuthology.orchestra.run.smithi092.stderr:1+0 records out 2024-09-11T00:13:16.618 INFO:teuthology.orchestra.run.smithi092.stderr:512 bytes copied, 0.000201737 s, 2.5 MB/s 2024-09-11T00:13:16.619 DEBUG:teuthology.orchestra.run.smithi092:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-11T00:13:16.675 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-11T00:13:16.675 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2024-09-11T00:13:16.675 DEBUG:teuthology.orchestra.run.smithi145:> dd if=/scratch_devs of=/dev/stdout 2024-09-11T00:13:16.691 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-11T00:13:16.692 DEBUG:teuthology.orchestra.run.smithi145:> stat /dev/vg_nvme/lv_1 2024-09-11T00:13:16.748 INFO:teuthology.orchestra.run.smithi145.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-11T00:13:16.748 INFO:teuthology.orchestra.run.smithi145.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-11T00:13:16.748 INFO:teuthology.orchestra.run.smithi145.stdout:Device: 5h/5d Inode: 665 Links: 1 2024-09-11T00:13:16.748 INFO:teuthology.orchestra.run.smithi145.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-11T00:13:16.748 INFO:teuthology.orchestra.run.smithi145.stdout:Context: system_u:object_r:device_t:s0 2024-09-11T00:13:16.748 INFO:teuthology.orchestra.run.smithi145.stdout:Access: 2024-09-11 00:12:55.671247355 +0000 2024-09-11T00:13:16.748 INFO:teuthology.orchestra.run.smithi145.stdout:Modify: 2024-09-11 00:10:59.653544154 +0000 2024-09-11T00:13:16.749 INFO:teuthology.orchestra.run.smithi145.stdout:Change: 2024-09-11 00:10:59.653544154 +0000 2024-09-11T00:13:16.749 INFO:teuthology.orchestra.run.smithi145.stdout: Birth: 2024-09-11 00:10:59.653544154 +0000 2024-09-11T00:13:16.749 DEBUG:teuthology.orchestra.run.smithi145:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-11T00:13:16.812 INFO:teuthology.orchestra.run.smithi145.stderr:1+0 records in 2024-09-11T00:13:16.812 INFO:teuthology.orchestra.run.smithi145.stderr:1+0 records out 2024-09-11T00:13:16.812 INFO:teuthology.orchestra.run.smithi145.stderr:512 bytes copied, 0.000225259 s, 2.3 MB/s 2024-09-11T00:13:16.813 DEBUG:teuthology.orchestra.run.smithi145:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-11T00:13:16.869 DEBUG:teuthology.orchestra.run.smithi145:> stat /dev/vg_nvme/lv_2 2024-09-11T00:13:16.924 INFO:teuthology.orchestra.run.smithi145.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-11T00:13:16.924 INFO:teuthology.orchestra.run.smithi145.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-11T00:13:16.924 INFO:teuthology.orchestra.run.smithi145.stdout:Device: 5h/5d Inode: 686 Links: 1 2024-09-11T00:13:16.924 INFO:teuthology.orchestra.run.smithi145.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-11T00:13:16.924 INFO:teuthology.orchestra.run.smithi145.stdout:Context: system_u:object_r:device_t:s0 2024-09-11T00:13:16.924 INFO:teuthology.orchestra.run.smithi145.stdout:Access: 2024-09-11 00:12:55.671247355 +0000 2024-09-11T00:13:16.924 INFO:teuthology.orchestra.run.smithi145.stdout:Modify: 2024-09-11 00:10:59.973536815 +0000 2024-09-11T00:13:16.924 INFO:teuthology.orchestra.run.smithi145.stdout:Change: 2024-09-11 00:10:59.973536815 +0000 2024-09-11T00:13:16.924 INFO:teuthology.orchestra.run.smithi145.stdout: Birth: 2024-09-11 00:10:59.973536815 +0000 2024-09-11T00:13:16.925 DEBUG:teuthology.orchestra.run.smithi145:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-11T00:13:16.987 INFO:teuthology.orchestra.run.smithi145.stderr:1+0 records in 2024-09-11T00:13:16.987 INFO:teuthology.orchestra.run.smithi145.stderr:1+0 records out 2024-09-11T00:13:16.987 INFO:teuthology.orchestra.run.smithi145.stderr:512 bytes copied, 0.000213693 s, 2.4 MB/s 2024-09-11T00:13:16.988 DEBUG:teuthology.orchestra.run.smithi145:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-11T00:13:17.044 DEBUG:teuthology.orchestra.run.smithi145:> stat /dev/vg_nvme/lv_3 2024-09-11T00:13:17.099 INFO:teuthology.orchestra.run.smithi145.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-11T00:13:17.099 INFO:teuthology.orchestra.run.smithi145.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-11T00:13:17.100 INFO:teuthology.orchestra.run.smithi145.stdout:Device: 5h/5d Inode: 706 Links: 1 2024-09-11T00:13:17.100 INFO:teuthology.orchestra.run.smithi145.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-11T00:13:17.100 INFO:teuthology.orchestra.run.smithi145.stdout:Context: system_u:object_r:device_t:s0 2024-09-11T00:13:17.100 INFO:teuthology.orchestra.run.smithi145.stdout:Access: 2024-09-11 00:12:55.672247332 +0000 2024-09-11T00:13:17.100 INFO:teuthology.orchestra.run.smithi145.stdout:Modify: 2024-09-11 00:11:00.299529339 +0000 2024-09-11T00:13:17.100 INFO:teuthology.orchestra.run.smithi145.stdout:Change: 2024-09-11 00:11:00.299529339 +0000 2024-09-11T00:13:17.100 INFO:teuthology.orchestra.run.smithi145.stdout: Birth: 2024-09-11 00:11:00.299529339 +0000 2024-09-11T00:13:17.100 DEBUG:teuthology.orchestra.run.smithi145:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-11T00:13:17.162 INFO:teuthology.orchestra.run.smithi145.stderr:1+0 records in 2024-09-11T00:13:17.162 INFO:teuthology.orchestra.run.smithi145.stderr:1+0 records out 2024-09-11T00:13:17.162 INFO:teuthology.orchestra.run.smithi145.stderr:512 bytes copied, 0.000175186 s, 2.9 MB/s 2024-09-11T00:13:17.163 DEBUG:teuthology.orchestra.run.smithi145:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-11T00:13:17.218 DEBUG:teuthology.orchestra.run.smithi145:> stat /dev/vg_nvme/lv_4 2024-09-11T00:13:17.274 INFO:teuthology.orchestra.run.smithi145.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-11T00:13:17.274 INFO:teuthology.orchestra.run.smithi145.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-11T00:13:17.274 INFO:teuthology.orchestra.run.smithi145.stdout:Device: 5h/5d Inode: 722 Links: 1 2024-09-11T00:13:17.274 INFO:teuthology.orchestra.run.smithi145.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-11T00:13:17.274 INFO:teuthology.orchestra.run.smithi145.stdout:Context: system_u:object_r:device_t:s0 2024-09-11T00:13:17.274 INFO:teuthology.orchestra.run.smithi145.stdout:Access: 2024-09-11 00:12:55.672247332 +0000 2024-09-11T00:13:17.274 INFO:teuthology.orchestra.run.smithi145.stdout:Modify: 2024-09-11 00:11:00.609522230 +0000 2024-09-11T00:13:17.275 INFO:teuthology.orchestra.run.smithi145.stdout:Change: 2024-09-11 00:11:00.609522230 +0000 2024-09-11T00:13:17.275 INFO:teuthology.orchestra.run.smithi145.stdout: Birth: 2024-09-11 00:11:00.609522230 +0000 2024-09-11T00:13:17.275 DEBUG:teuthology.orchestra.run.smithi145:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-11T00:13:17.338 INFO:teuthology.orchestra.run.smithi145.stderr:1+0 records in 2024-09-11T00:13:17.338 INFO:teuthology.orchestra.run.smithi145.stderr:1+0 records out 2024-09-11T00:13:17.338 INFO:teuthology.orchestra.run.smithi145.stderr:512 bytes copied, 0.000259519 s, 2.0 MB/s 2024-09-11T00:13:17.339 DEBUG:teuthology.orchestra.run.smithi145:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-11T00:13:17.396 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-11T00:13:17.397 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi092.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi145.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-11T00:13:17.397 INFO:tasks.ceph:Generating config... 2024-09-11T00:13:17.399 INFO:tasks.ceph:[client] pid file = 2024-09-11T00:13:17.399 INFO:tasks.ceph:[global] ms die on skipped message = False 2024-09-11T00:13:17.399 INFO:tasks.ceph:[mgr] client mount timeout = 30 2024-09-11T00:13:17.400 INFO:tasks.ceph:[mgr] debug client = 20 2024-09-11T00:13:17.400 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-09-11T00:13:17.400 INFO:tasks.ceph:[mgr] debug ms = 1 2024-09-11T00:13:17.400 INFO:tasks.ceph:[mon] debug mon = 20 2024-09-11T00:13:17.400 INFO:tasks.ceph:[mon] debug ms = 1 2024-09-11T00:13:17.400 INFO:tasks.ceph:[mon] debug paxos = 20 2024-09-11T00:13:17.400 INFO:tasks.ceph:[mon] mon down mkfs grace = 300 2024-09-11T00:13:17.400 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-09-11T00:13:17.400 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-09-11T00:13:17.400 INFO:tasks.ceph:[osd] debug bluefs = 20 2024-09-11T00:13:17.400 INFO:tasks.ceph:[osd] debug bluestore = 20 2024-09-11T00:13:17.400 INFO:tasks.ceph:[osd] debug ms = 1 2024-09-11T00:13:17.401 INFO:tasks.ceph:[osd] debug osd = 20 2024-09-11T00:13:17.401 INFO:tasks.ceph:[osd] debug rocksdb = 10 2024-09-11T00:13:17.401 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-09-11T00:13:17.401 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-09-11T00:13:17.401 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-09-11T00:13:17.401 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-09-11T00:13:17.401 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-09-11T00:13:17.401 INFO:tasks.ceph:Setting up mon.a... 2024-09-11T00:13:17.401 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-09-11T00:13:17.460 INFO:teuthology.orchestra.run.smithi092.stdout:creating /etc/ceph/ceph.keyring 2024-09-11T00:13:17.462 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-09-11T00:13:17.506 DEBUG:teuthology.orchestra.run.smithi092:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-11T00:13:17.571 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.92'), ('mon.b', '172.21.15.145'), ('mon.c', '[v2:172.21.15.145:3301,v1:172.21.15.145:6790]')] 2024-09-11T00:13:17.571 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.92,172.21.15.145,[v2:172.21.15.145:3301,v1:172.21.15.145:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'client mount timeout': 30, 'debug client': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon down mkfs grace': 300}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'pid file': ''}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}} 2024-09-11T00:13:17.572 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2024-09-11T00:13:17.572 DEBUG:teuthology.orchestra.run.smithi092:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-09-11T00:13:17.627 DEBUG:teuthology.orchestra.run.smithi092:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.92 --add b 172.21.15.145 --addv c '[v2:172.21.15.145:3301,v1:172.21.15.145:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-09-11T00:13:17.713 INFO:teuthology.orchestra.run.smithi092.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-09-11T00:13:17.714 INFO:teuthology.orchestra.run.smithi092.stdout:monmaptool: generated fsid 47039cb3-5d2a-46bf-9066-8055b5dfc583 2024-09-11T00:13:17.714 INFO:teuthology.orchestra.run.smithi092.stdout:setting min_mon_release = quincy 2024-09-11T00:13:17.714 INFO:teuthology.orchestra.run.smithi092.stdout:epoch 0 2024-09-11T00:13:17.714 INFO:teuthology.orchestra.run.smithi092.stdout:fsid 47039cb3-5d2a-46bf-9066-8055b5dfc583 2024-09-11T00:13:17.714 INFO:teuthology.orchestra.run.smithi092.stdout:last_changed 2024-09-11T00:13:17.713218+0000 2024-09-11T00:13:17.714 INFO:teuthology.orchestra.run.smithi092.stdout:created 2024-09-11T00:13:17.713218+0000 2024-09-11T00:13:17.714 INFO:teuthology.orchestra.run.smithi092.stdout:min_mon_release 17 (quincy) 2024-09-11T00:13:17.714 INFO:teuthology.orchestra.run.smithi092.stdout:election_strategy: 1 2024-09-11T00:13:17.714 INFO:teuthology.orchestra.run.smithi092.stdout:0: [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] mon.a 2024-09-11T00:13:17.714 INFO:teuthology.orchestra.run.smithi092.stdout:1: [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] mon.b 2024-09-11T00:13:17.714 INFO:teuthology.orchestra.run.smithi092.stdout:2: [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] mon.c 2024-09-11T00:13:17.714 INFO:teuthology.orchestra.run.smithi092.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-09-11T00:13:17.715 DEBUG:teuthology.orchestra.run.smithi092:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-09-11T00:13:17.731 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 47039cb3-5d2a-46bf-9066-8055b5dfc583... 2024-09-11T00:13:17.731 DEBUG:teuthology.orchestra.run.smithi092:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-11T00:13:17.774 DEBUG:teuthology.orchestra.run.smithi145:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-11T00:13:17.814 INFO:teuthology.orchestra.run.smithi092.stdout:[global] 2024-09-11T00:13:17.814 INFO:teuthology.orchestra.run.smithi092.stdout: chdir = "" 2024-09-11T00:13:17.815 INFO:teuthology.orchestra.run.smithi092.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-11T00:13:17.815 INFO:teuthology.orchestra.run.smithi092.stdout: auth supported = cephx 2024-09-11T00:13:17.815 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:13:17.815 INFO:teuthology.orchestra.run.smithi092.stdout: filestore xattr use omap = true 2024-09-11T00:13:17.815 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:13:17.815 INFO:teuthology.orchestra.run.smithi092.stdout: mon clock drift allowed = 1.000 2024-09-11T00:13:17.815 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:13:17.815 INFO:teuthology.orchestra.run.smithi092.stdout: osd crush chooseleaf type = 0 2024-09-11T00:13:17.815 INFO:teuthology.orchestra.run.smithi092.stdout: auth debug = true 2024-09-11T00:13:17.815 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:13:17.815 INFO:teuthology.orchestra.run.smithi092.stdout: ms die on old message = true 2024-09-11T00:13:17.815 INFO:teuthology.orchestra.run.smithi092.stdout: ms die on bug = true 2024-09-11T00:13:17.815 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:13:17.815 INFO:teuthology.orchestra.run.smithi092.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-11T00:13:17.816 INFO:teuthology.orchestra.run.smithi092.stdout: mon pg warn max object skew = 0 2024-09-11T00:13:17.816 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:13:17.816 INFO:teuthology.orchestra.run.smithi092.stdout: # disable pg_autoscaler by default for new pools 2024-09-11T00:13:17.816 INFO:teuthology.orchestra.run.smithi092.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-11T00:13:17.816 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:13:17.816 INFO:teuthology.orchestra.run.smithi092.stdout: osd pool default size = 2 2024-09-11T00:13:17.816 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:13:17.816 INFO:teuthology.orchestra.run.smithi092.stdout: mon osd allow primary affinity = true 2024-09-11T00:13:17.816 INFO:teuthology.orchestra.run.smithi092.stdout: mon osd allow pg remap = true 2024-09-11T00:13:17.816 INFO:teuthology.orchestra.run.smithi092.stdout: mon warn on legacy crush tunables = false 2024-09-11T00:13:17.816 INFO:teuthology.orchestra.run.smithi092.stdout: mon warn on crush straw calc version zero = false 2024-09-11T00:13:17.816 INFO:teuthology.orchestra.run.smithi092.stdout: mon warn on no sortbitwise = false 2024-09-11T00:13:17.816 INFO:teuthology.orchestra.run.smithi092.stdout: mon warn on osd down out interval zero = false 2024-09-11T00:13:17.817 INFO:teuthology.orchestra.run.smithi092.stdout: mon warn on too few osds = false 2024-09-11T00:13:17.817 INFO:teuthology.orchestra.run.smithi092.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-11T00:13:17.817 INFO:teuthology.orchestra.run.smithi092.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-11T00:13:17.817 INFO:teuthology.orchestra.run.smithi092.stdout: mon_allow_pool_size_one = true 2024-09-11T00:13:17.817 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:13:17.817 INFO:teuthology.orchestra.run.smithi092.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-11T00:13:17.817 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:13:17.817 INFO:teuthology.orchestra.run.smithi092.stdout: osd default data pool replay window = 5 2024-09-11T00:13:17.817 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:13:17.817 INFO:teuthology.orchestra.run.smithi092.stdout: mon allow pool delete = true 2024-09-11T00:13:17.817 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:13:17.817 INFO:teuthology.orchestra.run.smithi092.stdout: mon cluster log file level = debug 2024-09-11T00:13:17.817 INFO:teuthology.orchestra.run.smithi092.stdout: debug asserts on shutdown = true 2024-09-11T00:13:17.817 INFO:teuthology.orchestra.run.smithi092.stdout: mon health detail to clog = false 2024-09-11T00:13:17.818 INFO:teuthology.orchestra.run.smithi092.stdout: mon host = "172.21.15.92,172.21.15.145,[v2:172.21.15.145:3301,v1:172.21.15.145:6790]" 2024-09-11T00:13:17.818 INFO:teuthology.orchestra.run.smithi092.stdout: ms die on skipped message = False 2024-09-11T00:13:17.818 INFO:teuthology.orchestra.run.smithi092.stdout: fsid = 47039cb3-5d2a-46bf-9066-8055b5dfc583 2024-09-11T00:13:17.818 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:13:17.818 INFO:teuthology.orchestra.run.smithi092.stdout:[osd] 2024-09-11T00:13:17.818 INFO:teuthology.orchestra.run.smithi092.stdout: osd journal size = 100 2024-09-11T00:13:17.818 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:13:17.818 INFO:teuthology.orchestra.run.smithi092.stdout: osd scrub load threshold = 5.0 2024-09-11T00:13:17.818 INFO:teuthology.orchestra.run.smithi092.stdout: osd scrub max interval = 600 2024-09-11T00:13:17.818 INFO:teuthology.orchestra.run.smithi092.stdout: osd mclock profile = high_recovery_ops 2024-09-11T00:13:17.818 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:13:17.818 INFO:teuthology.orchestra.run.smithi092.stdout: osd recover clone overlap = true 2024-09-11T00:13:17.818 INFO:teuthology.orchestra.run.smithi092.stdout: osd recovery max chunk = 1048576 2024-09-11T00:13:17.818 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:13:17.819 INFO:teuthology.orchestra.run.smithi092.stdout: osd debug shutdown = true 2024-09-11T00:13:17.819 INFO:teuthology.orchestra.run.smithi092.stdout: osd debug op order = true 2024-09-11T00:13:17.819 INFO:teuthology.orchestra.run.smithi092.stdout: osd debug verify stray on activate = true 2024-09-11T00:13:17.819 INFO:teuthology.orchestra.run.smithi092.stdout: osd debug trim objects = true 2024-09-11T00:13:17.819 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:13:17.819 INFO:teuthology.orchestra.run.smithi092.stdout: osd open classes on start = true 2024-09-11T00:13:17.819 INFO:teuthology.orchestra.run.smithi092.stdout: osd debug pg log writeout = true 2024-09-11T00:13:17.819 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:13:17.819 INFO:teuthology.orchestra.run.smithi092.stdout: osd deep scrub update digest min age = 30 2024-09-11T00:13:17.819 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:13:17.819 INFO:teuthology.orchestra.run.smithi092.stdout: osd map max advance = 10 2024-09-11T00:13:17.819 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:13:17.820 INFO:teuthology.orchestra.run.smithi092.stdout: journal zero on create = true 2024-09-11T00:13:17.820 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:13:17.820 INFO:teuthology.orchestra.run.smithi092.stdout: filestore ondisk finisher threads = 3 2024-09-11T00:13:17.820 INFO:teuthology.orchestra.run.smithi092.stdout: filestore apply finisher threads = 3 2024-09-11T00:13:17.820 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:13:17.820 INFO:teuthology.orchestra.run.smithi092.stdout: bdev debug aio = true 2024-09-11T00:13:17.820 INFO:teuthology.orchestra.run.smithi092.stdout: osd debug misdirected ops = true 2024-09-11T00:13:17.820 INFO:teuthology.orchestra.run.smithi092.stdout: bluestore block size = 96636764160 2024-09-11T00:13:17.820 INFO:teuthology.orchestra.run.smithi092.stdout: bluestore fsck on mount = True 2024-09-11T00:13:17.820 INFO:teuthology.orchestra.run.smithi092.stdout: debug bluefs = 20 2024-09-11T00:13:17.820 INFO:teuthology.orchestra.run.smithi092.stdout: debug bluestore = 20 2024-09-11T00:13:17.821 INFO:teuthology.orchestra.run.smithi092.stdout: debug ms = 1 2024-09-11T00:13:17.821 INFO:teuthology.orchestra.run.smithi092.stdout: debug osd = 20 2024-09-11T00:13:17.821 INFO:teuthology.orchestra.run.smithi092.stdout: debug rocksdb = 10 2024-09-11T00:13:17.821 INFO:teuthology.orchestra.run.smithi092.stdout: mon osd backfillfull_ratio = 0.85 2024-09-11T00:13:17.821 INFO:teuthology.orchestra.run.smithi092.stdout: mon osd full ratio = 0.9 2024-09-11T00:13:17.821 INFO:teuthology.orchestra.run.smithi092.stdout: mon osd nearfull ratio = 0.8 2024-09-11T00:13:17.821 INFO:teuthology.orchestra.run.smithi092.stdout: osd failsafe full ratio = 0.95 2024-09-11T00:13:17.821 INFO:teuthology.orchestra.run.smithi092.stdout: osd objectstore = bluestore 2024-09-11T00:13:17.821 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:13:17.821 INFO:teuthology.orchestra.run.smithi092.stdout:[mgr] 2024-09-11T00:13:17.821 INFO:teuthology.orchestra.run.smithi092.stdout: debug ms = 1 2024-09-11T00:13:17.821 INFO:teuthology.orchestra.run.smithi092.stdout: debug mgr = 20 2024-09-11T00:13:17.821 INFO:teuthology.orchestra.run.smithi092.stdout: debug mon = 20 2024-09-11T00:13:17.821 INFO:teuthology.orchestra.run.smithi092.stdout: debug auth = 20 2024-09-11T00:13:17.822 INFO:teuthology.orchestra.run.smithi092.stdout: mon reweight min pgs per osd = 4 2024-09-11T00:13:17.822 INFO:teuthology.orchestra.run.smithi092.stdout: mon reweight min bytes per osd = 10 2024-09-11T00:13:17.822 INFO:teuthology.orchestra.run.smithi092.stdout: mgr/telemetry/nag = false 2024-09-11T00:13:17.822 INFO:teuthology.orchestra.run.smithi092.stdout: client mount timeout = 30 2024-09-11T00:13:17.822 INFO:teuthology.orchestra.run.smithi092.stdout: debug client = 20 2024-09-11T00:13:17.822 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:13:17.822 INFO:teuthology.orchestra.run.smithi092.stdout:[mon] 2024-09-11T00:13:17.822 INFO:teuthology.orchestra.run.smithi092.stdout: debug ms = 1 2024-09-11T00:13:17.822 INFO:teuthology.orchestra.run.smithi092.stdout: debug mon = 20 2024-09-11T00:13:17.822 INFO:teuthology.orchestra.run.smithi092.stdout: debug paxos = 20 2024-09-11T00:13:17.822 INFO:teuthology.orchestra.run.smithi092.stdout: debug auth = 20 2024-09-11T00:13:17.822 INFO:teuthology.orchestra.run.smithi092.stdout: mon data avail warn = 5 2024-09-11T00:13:17.822 INFO:teuthology.orchestra.run.smithi092.stdout: mon mgr mkfs grace = 240 2024-09-11T00:13:17.823 INFO:teuthology.orchestra.run.smithi092.stdout: mon reweight min pgs per osd = 4 2024-09-11T00:13:17.823 INFO:teuthology.orchestra.run.smithi092.stdout: mon osd reporter subtree level = osd 2024-09-11T00:13:17.823 INFO:teuthology.orchestra.run.smithi092.stdout: mon osd prime pg temp = true 2024-09-11T00:13:17.823 INFO:teuthology.orchestra.run.smithi092.stdout: mon reweight min bytes per osd = 10 2024-09-11T00:13:17.823 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:13:17.823 INFO:teuthology.orchestra.run.smithi092.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-11T00:13:17.823 INFO:teuthology.orchestra.run.smithi092.stdout: auth mon ticket ttl = 660 # 11m 2024-09-11T00:13:17.823 INFO:teuthology.orchestra.run.smithi092.stdout: auth service ticket ttl = 240 # 4m 2024-09-11T00:13:17.823 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:13:17.823 INFO:teuthology.orchestra.run.smithi092.stdout: # don't complain about insecure global_id in the test suite 2024-09-11T00:13:17.823 INFO:teuthology.orchestra.run.smithi092.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-11T00:13:17.823 INFO:teuthology.orchestra.run.smithi092.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-11T00:13:17.823 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:13:17.823 INFO:teuthology.orchestra.run.smithi092.stdout: # 1m isn't quite enough 2024-09-11T00:13:17.824 INFO:teuthology.orchestra.run.smithi092.stdout: mon_down_mkfs_grace = 2m 2024-09-11T00:13:17.824 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:13:17.824 INFO:teuthology.orchestra.run.smithi092.stdout: mon_warn_on_filestore_osds = false 2024-09-11T00:13:17.824 INFO:teuthology.orchestra.run.smithi092.stdout: mon down mkfs grace = 300 2024-09-11T00:13:17.824 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:13:17.824 INFO:teuthology.orchestra.run.smithi092.stdout:[client] 2024-09-11T00:13:17.824 INFO:teuthology.orchestra.run.smithi092.stdout: rgw cache enabled = true 2024-09-11T00:13:17.824 INFO:teuthology.orchestra.run.smithi092.stdout: rgw enable ops log = true 2024-09-11T00:13:17.824 INFO:teuthology.orchestra.run.smithi092.stdout: rgw enable usage log = true 2024-09-11T00:13:17.824 INFO:teuthology.orchestra.run.smithi092.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-11T00:13:17.824 INFO:teuthology.orchestra.run.smithi092.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-11T00:13:17.824 INFO:teuthology.orchestra.run.smithi092.stdout: pid file = "" 2024-09-11T00:13:17.824 INFO:teuthology.orchestra.run.smithi092.stdout:[mon.a] 2024-09-11T00:13:17.824 INFO:teuthology.orchestra.run.smithi092.stdout:[mon.b] 2024-09-11T00:13:17.825 INFO:teuthology.orchestra.run.smithi092.stdout:[mon.c] 2024-09-11T00:13:17.825 INFO:teuthology.orchestra.run.smithi092.stdout:[mds.a] 2024-09-11T00:13:17.825 INFO:teuthology.orchestra.run.smithi092.stdout:[mds.c] 2024-09-11T00:13:17.825 INFO:teuthology.orchestra.run.smithi092.stdout:[mds.b] 2024-09-11T00:13:17.825 INFO:teuthology.orchestra.run.smithi092.stdout:[mds.d] 2024-09-11T00:13:17.825 INFO:teuthology.orchestra.run.smithi145.stdout:[global] 2024-09-11T00:13:17.826 INFO:teuthology.orchestra.run.smithi145.stdout: chdir = "" 2024-09-11T00:13:17.826 INFO:teuthology.orchestra.run.smithi145.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-11T00:13:17.826 INFO:teuthology.orchestra.run.smithi145.stdout: auth supported = cephx 2024-09-11T00:13:17.826 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-11T00:13:17.826 INFO:teuthology.orchestra.run.smithi145.stdout: filestore xattr use omap = true 2024-09-11T00:13:17.826 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-11T00:13:17.826 INFO:teuthology.orchestra.run.smithi145.stdout: mon clock drift allowed = 1.000 2024-09-11T00:13:17.826 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-11T00:13:17.826 INFO:teuthology.orchestra.run.smithi145.stdout: osd crush chooseleaf type = 0 2024-09-11T00:13:17.826 INFO:teuthology.orchestra.run.smithi145.stdout: auth debug = true 2024-09-11T00:13:17.826 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-11T00:13:17.826 INFO:teuthology.orchestra.run.smithi145.stdout: ms die on old message = true 2024-09-11T00:13:17.826 INFO:teuthology.orchestra.run.smithi145.stdout: ms die on bug = true 2024-09-11T00:13:17.826 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-11T00:13:17.827 INFO:teuthology.orchestra.run.smithi145.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-11T00:13:17.827 INFO:teuthology.orchestra.run.smithi145.stdout: mon pg warn max object skew = 0 2024-09-11T00:13:17.827 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-11T00:13:17.827 INFO:teuthology.orchestra.run.smithi145.stdout: # disable pg_autoscaler by default for new pools 2024-09-11T00:13:17.827 INFO:teuthology.orchestra.run.smithi145.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-11T00:13:17.827 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-11T00:13:17.827 INFO:teuthology.orchestra.run.smithi145.stdout: osd pool default size = 2 2024-09-11T00:13:17.827 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-11T00:13:17.827 INFO:teuthology.orchestra.run.smithi145.stdout: mon osd allow primary affinity = true 2024-09-11T00:13:17.827 INFO:teuthology.orchestra.run.smithi145.stdout: mon osd allow pg remap = true 2024-09-11T00:13:17.827 INFO:teuthology.orchestra.run.smithi145.stdout: mon warn on legacy crush tunables = false 2024-09-11T00:13:17.827 INFO:teuthology.orchestra.run.smithi145.stdout: mon warn on crush straw calc version zero = false 2024-09-11T00:13:17.827 INFO:teuthology.orchestra.run.smithi145.stdout: mon warn on no sortbitwise = false 2024-09-11T00:13:17.827 INFO:teuthology.orchestra.run.smithi145.stdout: mon warn on osd down out interval zero = false 2024-09-11T00:13:17.828 INFO:teuthology.orchestra.run.smithi145.stdout: mon warn on too few osds = false 2024-09-11T00:13:17.828 INFO:teuthology.orchestra.run.smithi145.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-11T00:13:17.828 INFO:teuthology.orchestra.run.smithi145.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-11T00:13:17.828 INFO:teuthology.orchestra.run.smithi145.stdout: mon_allow_pool_size_one = true 2024-09-11T00:13:17.828 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-11T00:13:17.828 INFO:teuthology.orchestra.run.smithi145.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-11T00:13:17.828 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-11T00:13:17.828 INFO:teuthology.orchestra.run.smithi145.stdout: osd default data pool replay window = 5 2024-09-11T00:13:17.828 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-11T00:13:17.828 INFO:teuthology.orchestra.run.smithi145.stdout: mon allow pool delete = true 2024-09-11T00:13:17.828 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-11T00:13:17.828 INFO:teuthology.orchestra.run.smithi145.stdout: mon cluster log file level = debug 2024-09-11T00:13:17.828 INFO:teuthology.orchestra.run.smithi145.stdout: debug asserts on shutdown = true 2024-09-11T00:13:17.828 INFO:teuthology.orchestra.run.smithi145.stdout: mon health detail to clog = false 2024-09-11T00:13:17.829 INFO:teuthology.orchestra.run.smithi145.stdout: mon host = "172.21.15.92,172.21.15.145,[v2:172.21.15.145:3301,v1:172.21.15.145:6790]" 2024-09-11T00:13:17.829 INFO:teuthology.orchestra.run.smithi145.stdout: ms die on skipped message = False 2024-09-11T00:13:17.829 INFO:teuthology.orchestra.run.smithi145.stdout: fsid = 47039cb3-5d2a-46bf-9066-8055b5dfc583 2024-09-11T00:13:17.829 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-11T00:13:17.829 INFO:teuthology.orchestra.run.smithi145.stdout:[osd] 2024-09-11T00:13:17.829 INFO:teuthology.orchestra.run.smithi145.stdout: osd journal size = 100 2024-09-11T00:13:17.829 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-11T00:13:17.829 INFO:teuthology.orchestra.run.smithi145.stdout: osd scrub load threshold = 5.0 2024-09-11T00:13:17.829 INFO:teuthology.orchestra.run.smithi145.stdout: osd scrub max interval = 600 2024-09-11T00:13:17.829 INFO:teuthology.orchestra.run.smithi145.stdout: osd mclock profile = high_recovery_ops 2024-09-11T00:13:17.829 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-11T00:13:17.829 INFO:teuthology.orchestra.run.smithi145.stdout: osd recover clone overlap = true 2024-09-11T00:13:17.829 INFO:teuthology.orchestra.run.smithi145.stdout: osd recovery max chunk = 1048576 2024-09-11T00:13:17.830 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-11T00:13:17.830 INFO:teuthology.orchestra.run.smithi145.stdout: osd debug shutdown = true 2024-09-11T00:13:17.830 INFO:teuthology.orchestra.run.smithi145.stdout: osd debug op order = true 2024-09-11T00:13:17.830 INFO:teuthology.orchestra.run.smithi145.stdout: osd debug verify stray on activate = true 2024-09-11T00:13:17.830 INFO:teuthology.orchestra.run.smithi145.stdout: osd debug trim objects = true 2024-09-11T00:13:17.830 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-11T00:13:17.830 INFO:teuthology.orchestra.run.smithi145.stdout: osd open classes on start = true 2024-09-11T00:13:17.830 INFO:teuthology.orchestra.run.smithi145.stdout: osd debug pg log writeout = true 2024-09-11T00:13:17.830 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-11T00:13:17.830 INFO:teuthology.orchestra.run.smithi145.stdout: osd deep scrub update digest min age = 30 2024-09-11T00:13:17.830 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-11T00:13:17.830 INFO:teuthology.orchestra.run.smithi145.stdout: osd map max advance = 10 2024-09-11T00:13:17.830 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-11T00:13:17.830 INFO:teuthology.orchestra.run.smithi145.stdout: journal zero on create = true 2024-09-11T00:13:17.830 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-11T00:13:17.831 INFO:teuthology.orchestra.run.smithi145.stdout: filestore ondisk finisher threads = 3 2024-09-11T00:13:17.831 INFO:teuthology.orchestra.run.smithi145.stdout: filestore apply finisher threads = 3 2024-09-11T00:13:17.831 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-11T00:13:17.831 INFO:teuthology.orchestra.run.smithi145.stdout: bdev debug aio = true 2024-09-11T00:13:17.831 INFO:teuthology.orchestra.run.smithi145.stdout: osd debug misdirected ops = true 2024-09-11T00:13:17.831 INFO:teuthology.orchestra.run.smithi145.stdout: bluestore block size = 96636764160 2024-09-11T00:13:17.831 INFO:teuthology.orchestra.run.smithi145.stdout: bluestore fsck on mount = True 2024-09-11T00:13:17.831 INFO:teuthology.orchestra.run.smithi145.stdout: debug bluefs = 20 2024-09-11T00:13:17.831 INFO:teuthology.orchestra.run.smithi145.stdout: debug bluestore = 20 2024-09-11T00:13:17.831 INFO:teuthology.orchestra.run.smithi145.stdout: debug ms = 1 2024-09-11T00:13:17.831 INFO:teuthology.orchestra.run.smithi145.stdout: debug osd = 20 2024-09-11T00:13:17.831 INFO:teuthology.orchestra.run.smithi145.stdout: debug rocksdb = 10 2024-09-11T00:13:17.831 INFO:teuthology.orchestra.run.smithi145.stdout: mon osd backfillfull_ratio = 0.85 2024-09-11T00:13:17.831 INFO:teuthology.orchestra.run.smithi145.stdout: mon osd full ratio = 0.9 2024-09-11T00:13:17.832 INFO:teuthology.orchestra.run.smithi145.stdout: mon osd nearfull ratio = 0.8 2024-09-11T00:13:17.832 INFO:teuthology.orchestra.run.smithi145.stdout: osd failsafe full ratio = 0.95 2024-09-11T00:13:17.832 INFO:teuthology.orchestra.run.smithi145.stdout: osd objectstore = bluestore 2024-09-11T00:13:17.832 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-11T00:13:17.832 INFO:teuthology.orchestra.run.smithi145.stdout:[mgr] 2024-09-11T00:13:17.832 INFO:teuthology.orchestra.run.smithi145.stdout: debug ms = 1 2024-09-11T00:13:17.832 INFO:teuthology.orchestra.run.smithi145.stdout: debug mgr = 20 2024-09-11T00:13:17.832 INFO:teuthology.orchestra.run.smithi145.stdout: debug mon = 20 2024-09-11T00:13:17.832 INFO:teuthology.orchestra.run.smithi145.stdout: debug auth = 20 2024-09-11T00:13:17.832 INFO:teuthology.orchestra.run.smithi145.stdout: mon reweight min pgs per osd = 4 2024-09-11T00:13:17.832 INFO:teuthology.orchestra.run.smithi145.stdout: mon reweight min bytes per osd = 10 2024-09-11T00:13:17.832 INFO:teuthology.orchestra.run.smithi145.stdout: mgr/telemetry/nag = false 2024-09-11T00:13:17.832 INFO:teuthology.orchestra.run.smithi145.stdout: client mount timeout = 30 2024-09-11T00:13:17.832 INFO:teuthology.orchestra.run.smithi145.stdout: debug client = 20 2024-09-11T00:13:17.833 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-11T00:13:17.833 INFO:teuthology.orchestra.run.smithi145.stdout:[mon] 2024-09-11T00:13:17.833 INFO:teuthology.orchestra.run.smithi145.stdout: debug ms = 1 2024-09-11T00:13:17.833 INFO:teuthology.orchestra.run.smithi145.stdout: debug mon = 20 2024-09-11T00:13:17.833 INFO:teuthology.orchestra.run.smithi145.stdout: debug paxos = 20 2024-09-11T00:13:17.833 INFO:teuthology.orchestra.run.smithi145.stdout: debug auth = 20 2024-09-11T00:13:17.833 INFO:teuthology.orchestra.run.smithi145.stdout: mon data avail warn = 5 2024-09-11T00:13:17.833 INFO:teuthology.orchestra.run.smithi145.stdout: mon mgr mkfs grace = 240 2024-09-11T00:13:17.833 INFO:teuthology.orchestra.run.smithi145.stdout: mon reweight min pgs per osd = 4 2024-09-11T00:13:17.833 INFO:teuthology.orchestra.run.smithi145.stdout: mon osd reporter subtree level = osd 2024-09-11T00:13:17.833 INFO:teuthology.orchestra.run.smithi145.stdout: mon osd prime pg temp = true 2024-09-11T00:13:17.833 INFO:teuthology.orchestra.run.smithi145.stdout: mon reweight min bytes per osd = 10 2024-09-11T00:13:17.833 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-11T00:13:17.833 INFO:teuthology.orchestra.run.smithi145.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-11T00:13:17.834 INFO:teuthology.orchestra.run.smithi145.stdout: auth mon ticket ttl = 660 # 11m 2024-09-11T00:13:17.834 INFO:teuthology.orchestra.run.smithi145.stdout: auth service ticket ttl = 240 # 4m 2024-09-11T00:13:17.834 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-11T00:13:17.834 INFO:teuthology.orchestra.run.smithi145.stdout: # don't complain about insecure global_id in the test suite 2024-09-11T00:13:17.834 INFO:teuthology.orchestra.run.smithi145.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-11T00:13:17.834 INFO:teuthology.orchestra.run.smithi145.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-11T00:13:17.834 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-11T00:13:17.834 INFO:teuthology.orchestra.run.smithi145.stdout: # 1m isn't quite enough 2024-09-11T00:13:17.834 INFO:teuthology.orchestra.run.smithi145.stdout: mon_down_mkfs_grace = 2m 2024-09-11T00:13:17.834 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-11T00:13:17.834 INFO:teuthology.orchestra.run.smithi145.stdout: mon_warn_on_filestore_osds = false 2024-09-11T00:13:17.834 INFO:teuthology.orchestra.run.smithi145.stdout: mon down mkfs grace = 300 2024-09-11T00:13:17.834 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-11T00:13:17.834 INFO:teuthology.orchestra.run.smithi145.stdout:[client] 2024-09-11T00:13:17.834 INFO:teuthology.orchestra.run.smithi145.stdout: rgw cache enabled = true 2024-09-11T00:13:17.835 INFO:teuthology.orchestra.run.smithi145.stdout: rgw enable ops log = true 2024-09-11T00:13:17.835 INFO:teuthology.orchestra.run.smithi145.stdout: rgw enable usage log = true 2024-09-11T00:13:17.835 INFO:teuthology.orchestra.run.smithi145.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-11T00:13:17.835 INFO:teuthology.orchestra.run.smithi145.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-11T00:13:17.835 INFO:teuthology.orchestra.run.smithi145.stdout: pid file = "" 2024-09-11T00:13:17.835 INFO:teuthology.orchestra.run.smithi145.stdout:[mon.a] 2024-09-11T00:13:17.835 INFO:teuthology.orchestra.run.smithi145.stdout:[mon.b] 2024-09-11T00:13:17.835 INFO:teuthology.orchestra.run.smithi145.stdout:[mon.c] 2024-09-11T00:13:17.835 INFO:teuthology.orchestra.run.smithi145.stdout:[mds.a] 2024-09-11T00:13:17.835 INFO:teuthology.orchestra.run.smithi145.stdout:[mds.c] 2024-09-11T00:13:17.835 INFO:teuthology.orchestra.run.smithi145.stdout:[mds.b] 2024-09-11T00:13:17.835 INFO:teuthology.orchestra.run.smithi145.stdout:[mds.d] 2024-09-11T00:13:17.837 INFO:tasks.ceph:Creating admin key on mon.a... 2024-09-11T00:13:17.837 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-09-11T00:13:17.931 INFO:tasks.ceph:Copying monmap to all nodes... 2024-09-11T00:13:17.931 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2024-09-11T00:13:17.931 DEBUG:teuthology.orchestra.run.smithi092:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-09-11T00:13:17.950 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2024-09-11T00:13:17.950 DEBUG:teuthology.orchestra.run.smithi092:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-09-11T00:13:18.004 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi092.front.sepia.ceph.com 2024-09-11T00:13:18.004 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2024-09-11T00:13:18.004 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-11T00:13:18.005 DEBUG:teuthology.orchestra.run.smithi092:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-11T00:13:18.078 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2024-09-11T00:13:18.078 DEBUG:teuthology.orchestra.run.smithi092:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-11T00:13:18.134 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi145.front.sepia.ceph.com 2024-09-11T00:13:18.134 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2024-09-11T00:13:18.134 DEBUG:teuthology.orchestra.run.smithi145:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-11T00:13:18.134 DEBUG:teuthology.orchestra.run.smithi145:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-11T00:13:18.168 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2024-09-11T00:13:18.169 DEBUG:teuthology.orchestra.run.smithi145:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-11T00:13:18.224 INFO:tasks.ceph:Setting up mon nodes... 2024-09-11T00:13:18.224 INFO:tasks.ceph:Setting up mgr nodes... 2024-09-11T00:13:18.225 DEBUG:teuthology.orchestra.run.smithi092:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-09-11T00:13:18.275 INFO:teuthology.orchestra.run.smithi092.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-09-11T00:13:18.278 DEBUG:teuthology.orchestra.run.smithi145:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-09-11T00:13:18.335 INFO:teuthology.orchestra.run.smithi145.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-09-11T00:13:18.338 INFO:tasks.ceph:Setting up mds nodes... 2024-09-11T00:13:18.338 DEBUG:teuthology.orchestra.run.smithi092:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-09-11T00:13:18.389 INFO:teuthology.orchestra.run.smithi092.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-09-11T00:13:18.392 DEBUG:teuthology.orchestra.run.smithi092:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-09-11T00:13:18.417 DEBUG:teuthology.orchestra.run.smithi092:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-09-11T00:13:18.508 INFO:teuthology.orchestra.run.smithi092.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-09-11T00:13:18.510 DEBUG:teuthology.orchestra.run.smithi092:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-09-11T00:13:18.534 DEBUG:teuthology.orchestra.run.smithi145:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-09-11T00:13:18.586 INFO:teuthology.orchestra.run.smithi145.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-09-11T00:13:18.588 DEBUG:teuthology.orchestra.run.smithi145:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-09-11T00:13:18.613 DEBUG:teuthology.orchestra.run.smithi145:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-09-11T00:13:18.704 INFO:teuthology.orchestra.run.smithi145.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-09-11T00:13:18.707 DEBUG:teuthology.orchestra.run.smithi145:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-09-11T00:13:18.731 INFO:tasks.ceph_client:Setting up client nodes... 2024-09-11T00:13:18.731 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-11T00:13:18.772 INFO:teuthology.orchestra.run.smithi092.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-09-11T00:13:18.785 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2024-09-11T00:13:18.867 INFO:teuthology.orchestra.run.smithi092.stdout:creating /etc/ceph/ceph.client.2.keyring 2024-09-11T00:13:18.879 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-09-11T00:13:18.920 INFO:teuthology.orchestra.run.smithi145.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-09-11T00:13:18.933 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2024-09-11T00:13:19.014 INFO:teuthology.orchestra.run.smithi145.stdout:creating /etc/ceph/ceph.client.3.keyring 2024-09-11T00:13:19.026 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-09-11T00:13:19.026 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi092.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi145.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-11T00:13:19.027 DEBUG:teuthology.orchestra.run.smithi092:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-09-11T00:13:19.052 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-11T00:13:19.052 INFO:tasks.ceph:role: osd.0 2024-09-11T00:13:19.053 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi092.front.sepia.ceph.com 2024-09-11T00:13:19.053 DEBUG:teuthology.orchestra.run.smithi092:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-11T00:13:19.125 INFO:teuthology.orchestra.run.smithi092.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-11T00:13:19.125 INFO:teuthology.orchestra.run.smithi092.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-11T00:13:19.125 INFO:teuthology.orchestra.run.smithi092.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-11T00:13:19.126 INFO:teuthology.orchestra.run.smithi092.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-11T00:13:19.126 INFO:teuthology.orchestra.run.smithi092.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-11T00:13:19.126 INFO:teuthology.orchestra.run.smithi092.stdout: = sunit=0 swidth=0 blks 2024-09-11T00:13:19.126 INFO:teuthology.orchestra.run.smithi092.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-11T00:13:19.127 INFO:teuthology.orchestra.run.smithi092.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-11T00:13:19.127 INFO:teuthology.orchestra.run.smithi092.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-11T00:13:19.127 INFO:teuthology.orchestra.run.smithi092.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-11T00:13:19.624 INFO:teuthology.orchestra.run.smithi092.stdout:Discarding blocks...Done. 2024-09-11T00:13:19.626 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi092.front.sepia.ceph.com -o noatime 2024-09-11T00:13:19.626 DEBUG:teuthology.orchestra.run.smithi092:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-09-11T00:13:19.746 DEBUG:teuthology.orchestra.run.smithi092:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-09-11T00:13:19.781 DEBUG:teuthology.orchestra.run.smithi092:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-09-11T00:13:19.846 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-11T00:13:19.846 INFO:tasks.ceph:role: osd.1 2024-09-11T00:13:19.846 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi092.front.sepia.ceph.com 2024-09-11T00:13:19.846 DEBUG:teuthology.orchestra.run.smithi092:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-11T00:13:19.918 INFO:teuthology.orchestra.run.smithi092.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-11T00:13:19.918 INFO:teuthology.orchestra.run.smithi092.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-11T00:13:19.918 INFO:teuthology.orchestra.run.smithi092.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-11T00:13:19.918 INFO:teuthology.orchestra.run.smithi092.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-11T00:13:19.918 INFO:teuthology.orchestra.run.smithi092.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-11T00:13:19.918 INFO:teuthology.orchestra.run.smithi092.stdout: = sunit=0 swidth=0 blks 2024-09-11T00:13:19.918 INFO:teuthology.orchestra.run.smithi092.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-11T00:13:19.918 INFO:teuthology.orchestra.run.smithi092.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-11T00:13:19.919 INFO:teuthology.orchestra.run.smithi092.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-11T00:13:19.919 INFO:teuthology.orchestra.run.smithi092.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-11T00:13:20.383 INFO:teuthology.orchestra.run.smithi092.stdout:Discarding blocks...Done. 2024-09-11T00:13:20.385 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi092.front.sepia.ceph.com -o noatime 2024-09-11T00:13:20.385 DEBUG:teuthology.orchestra.run.smithi092:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-09-11T00:13:20.476 DEBUG:teuthology.orchestra.run.smithi092:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-09-11T00:13:20.505 DEBUG:teuthology.orchestra.run.smithi092:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-09-11T00:13:20.571 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-11T00:13:20.571 INFO:tasks.ceph:role: osd.2 2024-09-11T00:13:20.571 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi092.front.sepia.ceph.com 2024-09-11T00:13:20.571 DEBUG:teuthology.orchestra.run.smithi092:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-11T00:13:20.643 INFO:teuthology.orchestra.run.smithi092.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-11T00:13:20.643 INFO:teuthology.orchestra.run.smithi092.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-11T00:13:20.643 INFO:teuthology.orchestra.run.smithi092.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-11T00:13:20.643 INFO:teuthology.orchestra.run.smithi092.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-11T00:13:20.643 INFO:teuthology.orchestra.run.smithi092.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-11T00:13:20.643 INFO:teuthology.orchestra.run.smithi092.stdout: = sunit=0 swidth=0 blks 2024-09-11T00:13:20.643 INFO:teuthology.orchestra.run.smithi092.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-11T00:13:20.643 INFO:teuthology.orchestra.run.smithi092.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-11T00:13:20.643 INFO:teuthology.orchestra.run.smithi092.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-11T00:13:20.643 INFO:teuthology.orchestra.run.smithi092.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-11T00:13:21.141 INFO:teuthology.orchestra.run.smithi092.stdout:Discarding blocks...Done. 2024-09-11T00:13:21.143 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi092.front.sepia.ceph.com -o noatime 2024-09-11T00:13:21.143 DEBUG:teuthology.orchestra.run.smithi092:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-09-11T00:13:21.289 DEBUG:teuthology.orchestra.run.smithi092:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-09-11T00:13:21.320 DEBUG:teuthology.orchestra.run.smithi092:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-09-11T00:13:21.385 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-11T00:13:21.386 INFO:tasks.ceph:role: osd.3 2024-09-11T00:13:21.386 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi092.front.sepia.ceph.com 2024-09-11T00:13:21.386 DEBUG:teuthology.orchestra.run.smithi092:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-11T00:13:21.457 INFO:teuthology.orchestra.run.smithi092.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-11T00:13:21.458 INFO:teuthology.orchestra.run.smithi092.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-11T00:13:21.458 INFO:teuthology.orchestra.run.smithi092.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-11T00:13:21.458 INFO:teuthology.orchestra.run.smithi092.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-11T00:13:21.458 INFO:teuthology.orchestra.run.smithi092.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-11T00:13:21.458 INFO:teuthology.orchestra.run.smithi092.stdout: = sunit=0 swidth=0 blks 2024-09-11T00:13:21.458 INFO:teuthology.orchestra.run.smithi092.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-11T00:13:21.458 INFO:teuthology.orchestra.run.smithi092.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-11T00:13:21.458 INFO:teuthology.orchestra.run.smithi092.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-11T00:13:21.458 INFO:teuthology.orchestra.run.smithi092.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-11T00:13:21.972 INFO:teuthology.orchestra.run.smithi092.stdout:Discarding blocks...Done. 2024-09-11T00:13:21.974 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi092.front.sepia.ceph.com -o noatime 2024-09-11T00:13:21.974 DEBUG:teuthology.orchestra.run.smithi092:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-09-11T00:13:22.114 DEBUG:teuthology.orchestra.run.smithi092:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-09-11T00:13:22.148 DEBUG:teuthology.orchestra.run.smithi092:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-11T00:13:22.245 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:22.243+0000 7f218b5dd640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-09-11T00:13:22.245 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:22.243+0000 7f218b5dd640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-09-11T00:13:22.245 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:22.243+0000 7f218b5dd640 -1 bdev(0x55d36610f800 /var/lib/ceph/osd/ceph-0/block) open stat got: (1) Operation not permitted 2024-09-11T00:13:22.245 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:22.243+0000 7f218b5dd640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-09-11T00:13:25.408 DEBUG:teuthology.orchestra.run.smithi092:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-11T00:13:25.438 DEBUG:teuthology.orchestra.run.smithi092:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-11T00:13:25.529 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:25.524+0000 7f6c0bdb9640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-09-11T00:13:25.529 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:25.525+0000 7f6c0bdb9640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-09-11T00:13:25.530 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:25.525+0000 7f6c0bdb9640 -1 bdev(0x55b01c50b800 /var/lib/ceph/osd/ceph-1/block) open stat got: (1) Operation not permitted 2024-09-11T00:13:25.530 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:25.525+0000 7f6c0bdb9640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-09-11T00:13:28.923 DEBUG:teuthology.orchestra.run.smithi092:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-11T00:13:28.952 DEBUG:teuthology.orchestra.run.smithi092:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-11T00:13:29.044 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:29.042+0000 7f422b8e6640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-09-11T00:13:29.044 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:29.042+0000 7f422b8e6640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-09-11T00:13:29.044 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:29.042+0000 7f422b8e6640 -1 bdev(0x55dfecef5800 /var/lib/ceph/osd/ceph-2/block) open stat got: (1) Operation not permitted 2024-09-11T00:13:29.044 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:29.043+0000 7f422b8e6640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-09-11T00:13:32.202 DEBUG:teuthology.orchestra.run.smithi092:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-11T00:13:32.231 DEBUG:teuthology.orchestra.run.smithi092:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-11T00:13:32.320 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:32.318+0000 7f21aba15640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-09-11T00:13:32.320 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:32.318+0000 7f21aba15640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-09-11T00:13:32.320 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:32.318+0000 7f21aba15640 -1 bdev(0x55a2fc3b1800 /var/lib/ceph/osd/ceph-3/block) open stat got: (1) Operation not permitted 2024-09-11T00:13:32.320 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:32.319+0000 7f21aba15640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-09-11T00:13:35.226 DEBUG:teuthology.orchestra.run.smithi092:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-11T00:13:35.255 DEBUG:teuthology.orchestra.run.smithi145:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-09-11T00:13:35.286 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-11T00:13:35.286 INFO:tasks.ceph:role: osd.4 2024-09-11T00:13:35.286 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi145.front.sepia.ceph.com 2024-09-11T00:13:35.286 DEBUG:teuthology.orchestra.run.smithi145:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-11T00:13:35.362 INFO:teuthology.orchestra.run.smithi145.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-11T00:13:35.362 INFO:teuthology.orchestra.run.smithi145.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-11T00:13:35.362 INFO:teuthology.orchestra.run.smithi145.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-11T00:13:35.362 INFO:teuthology.orchestra.run.smithi145.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-11T00:13:35.362 INFO:teuthology.orchestra.run.smithi145.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-11T00:13:35.362 INFO:teuthology.orchestra.run.smithi145.stdout: = sunit=0 swidth=0 blks 2024-09-11T00:13:35.362 INFO:teuthology.orchestra.run.smithi145.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-11T00:13:35.362 INFO:teuthology.orchestra.run.smithi145.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-11T00:13:35.363 INFO:teuthology.orchestra.run.smithi145.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-11T00:13:35.363 INFO:teuthology.orchestra.run.smithi145.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-11T00:13:35.855 INFO:teuthology.orchestra.run.smithi145.stdout:Discarding blocks...Done. 2024-09-11T00:13:35.858 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi145.front.sepia.ceph.com -o noatime 2024-09-11T00:13:35.859 DEBUG:teuthology.orchestra.run.smithi145:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-09-11T00:13:35.982 DEBUG:teuthology.orchestra.run.smithi145:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-09-11T00:13:36.015 DEBUG:teuthology.orchestra.run.smithi145:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-09-11T00:13:36.083 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-11T00:13:36.083 INFO:tasks.ceph:role: osd.5 2024-09-11T00:13:36.083 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi145.front.sepia.ceph.com 2024-09-11T00:13:36.083 DEBUG:teuthology.orchestra.run.smithi145:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-11T00:13:36.158 INFO:teuthology.orchestra.run.smithi145.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-11T00:13:36.158 INFO:teuthology.orchestra.run.smithi145.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-11T00:13:36.158 INFO:teuthology.orchestra.run.smithi145.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-11T00:13:36.158 INFO:teuthology.orchestra.run.smithi145.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-11T00:13:36.158 INFO:teuthology.orchestra.run.smithi145.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-11T00:13:36.158 INFO:teuthology.orchestra.run.smithi145.stdout: = sunit=0 swidth=0 blks 2024-09-11T00:13:36.158 INFO:teuthology.orchestra.run.smithi145.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-11T00:13:36.158 INFO:teuthology.orchestra.run.smithi145.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-11T00:13:36.158 INFO:teuthology.orchestra.run.smithi145.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-11T00:13:36.158 INFO:teuthology.orchestra.run.smithi145.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-11T00:13:36.618 INFO:teuthology.orchestra.run.smithi145.stdout:Discarding blocks...Done. 2024-09-11T00:13:36.620 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi145.front.sepia.ceph.com -o noatime 2024-09-11T00:13:36.621 DEBUG:teuthology.orchestra.run.smithi145:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-09-11T00:13:36.717 DEBUG:teuthology.orchestra.run.smithi145:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-09-11T00:13:36.745 DEBUG:teuthology.orchestra.run.smithi145:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-09-11T00:13:36.810 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-11T00:13:36.810 INFO:tasks.ceph:role: osd.6 2024-09-11T00:13:36.810 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi145.front.sepia.ceph.com 2024-09-11T00:13:36.810 DEBUG:teuthology.orchestra.run.smithi145:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-11T00:13:36.883 INFO:teuthology.orchestra.run.smithi145.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-11T00:13:36.883 INFO:teuthology.orchestra.run.smithi145.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-11T00:13:36.883 INFO:teuthology.orchestra.run.smithi145.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-11T00:13:36.883 INFO:teuthology.orchestra.run.smithi145.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-11T00:13:36.883 INFO:teuthology.orchestra.run.smithi145.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-11T00:13:36.883 INFO:teuthology.orchestra.run.smithi145.stdout: = sunit=0 swidth=0 blks 2024-09-11T00:13:36.883 INFO:teuthology.orchestra.run.smithi145.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-11T00:13:36.883 INFO:teuthology.orchestra.run.smithi145.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-11T00:13:36.883 INFO:teuthology.orchestra.run.smithi145.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-11T00:13:36.884 INFO:teuthology.orchestra.run.smithi145.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-11T00:13:37.364 INFO:teuthology.orchestra.run.smithi145.stdout:Discarding blocks...Done. 2024-09-11T00:13:37.366 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi145.front.sepia.ceph.com -o noatime 2024-09-11T00:13:37.366 DEBUG:teuthology.orchestra.run.smithi145:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-09-11T00:13:37.492 DEBUG:teuthology.orchestra.run.smithi145:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-09-11T00:13:37.522 DEBUG:teuthology.orchestra.run.smithi145:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-09-11T00:13:37.587 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-11T00:13:37.587 INFO:tasks.ceph:role: osd.7 2024-09-11T00:13:37.587 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi145.front.sepia.ceph.com 2024-09-11T00:13:37.587 DEBUG:teuthology.orchestra.run.smithi145:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-11T00:13:37.660 INFO:teuthology.orchestra.run.smithi145.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-11T00:13:37.660 INFO:teuthology.orchestra.run.smithi145.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-11T00:13:37.660 INFO:teuthology.orchestra.run.smithi145.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-11T00:13:37.660 INFO:teuthology.orchestra.run.smithi145.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-11T00:13:37.660 INFO:teuthology.orchestra.run.smithi145.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-11T00:13:37.660 INFO:teuthology.orchestra.run.smithi145.stdout: = sunit=0 swidth=0 blks 2024-09-11T00:13:37.660 INFO:teuthology.orchestra.run.smithi145.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-11T00:13:37.660 INFO:teuthology.orchestra.run.smithi145.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-11T00:13:37.660 INFO:teuthology.orchestra.run.smithi145.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-11T00:13:37.660 INFO:teuthology.orchestra.run.smithi145.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-11T00:13:38.182 INFO:teuthology.orchestra.run.smithi145.stdout:Discarding blocks...Done. 2024-09-11T00:13:38.184 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi145.front.sepia.ceph.com -o noatime 2024-09-11T00:13:38.184 DEBUG:teuthology.orchestra.run.smithi145:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-09-11T00:13:38.303 DEBUG:teuthology.orchestra.run.smithi145:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-09-11T00:13:38.336 DEBUG:teuthology.orchestra.run.smithi145:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-11T00:13:38.428 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:38.426+0000 7f8e2b487640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-09-11T00:13:38.428 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:38.427+0000 7f8e2b487640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-09-11T00:13:38.429 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:38.427+0000 7f8e2b487640 -1 bdev(0x55647089b800 /var/lib/ceph/osd/ceph-4/block) open stat got: (1) Operation not permitted 2024-09-11T00:13:38.429 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:38.427+0000 7f8e2b487640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-09-11T00:13:41.584 DEBUG:teuthology.orchestra.run.smithi145:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-11T00:13:41.615 DEBUG:teuthology.orchestra.run.smithi145:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-11T00:13:41.706 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:41.704+0000 7fc80a083640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-09-11T00:13:41.706 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:41.705+0000 7fc80a083640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-09-11T00:13:41.706 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:41.705+0000 7fc80a083640 -1 bdev(0x55f1e4fa7800 /var/lib/ceph/osd/ceph-5/block) open stat got: (1) Operation not permitted 2024-09-11T00:13:41.706 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:41.705+0000 7fc80a083640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-09-11T00:13:44.620 DEBUG:teuthology.orchestra.run.smithi145:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-11T00:13:44.650 DEBUG:teuthology.orchestra.run.smithi145:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-11T00:13:44.741 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:44.739+0000 7f79fdf54640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-09-11T00:13:44.741 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:44.739+0000 7f79fdf54640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-09-11T00:13:44.741 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:44.739+0000 7f79fdf54640 -1 bdev(0x55e3481b5800 /var/lib/ceph/osd/ceph-6/block) open stat got: (1) Operation not permitted 2024-09-11T00:13:44.742 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:44.739+0000 7f79fdf54640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-09-11T00:13:45.837 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T00:13:45.839 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T00:13:47.906 DEBUG:teuthology.orchestra.run.smithi145:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-09-11T00:13:47.932 DEBUG:teuthology.orchestra.run.smithi145:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-11T00:13:48.018 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:48.016+0000 7fd47d2a5640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-09-11T00:13:48.018 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:48.017+0000 7fd47d2a5640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-09-11T00:13:48.018 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:48.017+0000 7fd47d2a5640 -1 bdev(0x55708ea5f800 /var/lib/ceph/osd/ceph-7/block) open stat got: (1) Operation not permitted 2024-09-11T00:13:48.019 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:48.017+0000 7fd47d2a5640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-09-11T00:13:50.927 DEBUG:teuthology.orchestra.run.smithi145:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-09-11T00:13:50.957 INFO:tasks.ceph:Reading keys from all nodes... 2024-09-11T00:13:50.957 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2024-09-11T00:13:50.957 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-09-11T00:13:50.987 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2024-09-11T00:13:50.987 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-09-11T00:13:51.056 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2024-09-11T00:13:51.056 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-09-11T00:13:51.123 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2024-09-11T00:13:51.123 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-09-11T00:13:51.190 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2024-09-11T00:13:51.190 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-09-11T00:13:51.258 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2024-09-11T00:13:51.258 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-09-11T00:13:51.324 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2024-09-11T00:13:51.324 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-09-11T00:13:51.390 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2024-09-11T00:13:51.390 DEBUG:teuthology.orchestra.run.smithi145:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-09-11T00:13:51.421 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2024-09-11T00:13:51.421 DEBUG:teuthology.orchestra.run.smithi145:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-09-11T00:13:51.490 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2024-09-11T00:13:51.490 DEBUG:teuthology.orchestra.run.smithi145:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-09-11T00:13:51.558 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2024-09-11T00:13:51.558 DEBUG:teuthology.orchestra.run.smithi145:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-09-11T00:13:51.625 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2024-09-11T00:13:51.625 DEBUG:teuthology.orchestra.run.smithi145:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-09-11T00:13:51.691 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2024-09-11T00:13:51.691 DEBUG:teuthology.orchestra.run.smithi145:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-09-11T00:13:51.756 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2024-09-11T00:13:51.756 DEBUG:teuthology.orchestra.run.smithi145:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-09-11T00:13:51.821 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2024-09-11T00:13:51.822 DEBUG:teuthology.orchestra.run.smithi092:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-09-11T00:13:51.839 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2024-09-11T00:13:51.839 DEBUG:teuthology.orchestra.run.smithi092:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2024-09-11T00:13:51.896 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2024-09-11T00:13:51.896 DEBUG:teuthology.orchestra.run.smithi145:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-09-11T00:13:51.912 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2024-09-11T00:13:51.912 DEBUG:teuthology.orchestra.run.smithi145:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2024-09-11T00:13:51.970 INFO:tasks.ceph:Adding keys to all mons... 2024-09-11T00:13:51.971 DEBUG:teuthology.orchestra.run.smithi092:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-11T00:13:51.974 DEBUG:teuthology.orchestra.run.smithi145:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-11T00:13:52.013 INFO:teuthology.orchestra.run.smithi092.stdout:[mgr.y] 2024-09-11T00:13:52.013 INFO:teuthology.orchestra.run.smithi092.stdout: key = AQCe4OBmV1tkEBAA2jhMKrgxcO6OGKvnusmviA== 2024-09-11T00:13:52.013 INFO:teuthology.orchestra.run.smithi092.stdout:[mds.a] 2024-09-11T00:13:52.013 INFO:teuthology.orchestra.run.smithi092.stdout: key = AQCe4OBmmT0yFxAA8GmXJ+YS1BYWN4Mkk5cMkg== 2024-09-11T00:13:52.014 INFO:teuthology.orchestra.run.smithi092.stdout:[mds.c] 2024-09-11T00:13:52.014 INFO:teuthology.orchestra.run.smithi092.stdout: key = AQCe4OBm1sdBHhAAxxAg+qrd5wYAlbu0ihkzkw== 2024-09-11T00:13:52.014 INFO:teuthology.orchestra.run.smithi092.stdout:[osd.0] 2024-09-11T00:13:52.014 INFO:teuthology.orchestra.run.smithi092.stdout: key = AQCi4OBmtDqPDhAAx12Cm9ty3MItAY+7G5KUZA== 2024-09-11T00:13:52.014 INFO:teuthology.orchestra.run.smithi092.stdout:[osd.1] 2024-09-11T00:13:52.014 INFO:teuthology.orchestra.run.smithi092.stdout: key = AQCl4OBmMX1lHxAA9gNthXojiV/CwkzNV4EtsA== 2024-09-11T00:13:52.014 INFO:teuthology.orchestra.run.smithi092.stdout:[osd.2] 2024-09-11T00:13:52.014 INFO:teuthology.orchestra.run.smithi092.stdout: key = AQCp4OBmT8GXAhAAI02baR11qQP8BQgP5EuuHw== 2024-09-11T00:13:52.014 INFO:teuthology.orchestra.run.smithi092.stdout:[osd.3] 2024-09-11T00:13:52.014 INFO:teuthology.orchestra.run.smithi092.stdout: key = AQCs4OBmbDILExAA8hH1qACKd2U2EVwQ1NxPgA== 2024-09-11T00:13:52.014 INFO:teuthology.orchestra.run.smithi092.stdout:[mgr.x] 2024-09-11T00:13:52.014 INFO:teuthology.orchestra.run.smithi092.stdout: key = AQCe4OBmYXf5ExAAX8zEBI+7JeYIxOVBdgi2uw== 2024-09-11T00:13:52.014 INFO:teuthology.orchestra.run.smithi092.stdout:[mds.b] 2024-09-11T00:13:52.015 INFO:teuthology.orchestra.run.smithi092.stdout: key = AQCe4OBmozHpIhAA9/Si4L5wwVt64OQFAKnkdw== 2024-09-11T00:13:52.015 INFO:teuthology.orchestra.run.smithi092.stdout:[mds.d] 2024-09-11T00:13:52.015 INFO:teuthology.orchestra.run.smithi092.stdout: key = AQCe4OBmxAr4KRAA9Cx/xqXkLHfCLWwOQ53rDw== 2024-09-11T00:13:52.015 INFO:teuthology.orchestra.run.smithi092.stdout:[osd.4] 2024-09-11T00:13:52.015 INFO:teuthology.orchestra.run.smithi092.stdout: key = AQCy4OBmgYt7GRAAyseePTbu7tElPtVIHEC8jA== 2024-09-11T00:13:52.015 INFO:teuthology.orchestra.run.smithi092.stdout:[osd.5] 2024-09-11T00:13:52.015 INFO:teuthology.orchestra.run.smithi092.stdout: key = AQC14OBmVjcPKhAA8ORCTlHOMqPi2BqXV39qug== 2024-09-11T00:13:52.015 INFO:teuthology.orchestra.run.smithi092.stdout:[osd.6] 2024-09-11T00:13:52.015 INFO:teuthology.orchestra.run.smithi092.stdout: key = AQC44OBmuWgaLBAASsJt9EZ9WqxQBe8peGQELg== 2024-09-11T00:13:52.015 INFO:teuthology.orchestra.run.smithi092.stdout:[osd.7] 2024-09-11T00:13:52.015 INFO:teuthology.orchestra.run.smithi092.stdout: key = AQC84OBmNLgLARAAeES0seHW36ArPyi8E0bCKw== 2024-09-11T00:13:52.015 INFO:teuthology.orchestra.run.smithi092.stdout:[client.0] 2024-09-11T00:13:52.015 INFO:teuthology.orchestra.run.smithi092.stdout: key = AQCe4OBmiRAJLhAATruvtg1BGyubuDnFLT3rug== 2024-09-11T00:13:52.015 INFO:teuthology.orchestra.run.smithi092.stdout:[client.2] 2024-09-11T00:13:52.016 INFO:teuthology.orchestra.run.smithi092.stdout: key = AQCe4OBmtbGpMxAAV0wJY70pS7DRP9+z+U0joQ== 2024-09-11T00:13:52.016 INFO:teuthology.orchestra.run.smithi092.stdout:[client.1] 2024-09-11T00:13:52.016 INFO:teuthology.orchestra.run.smithi092.stdout: key = AQCe4OBm5/DWNhAABWcFpCDqMTspKGv+BnvGqg== 2024-09-11T00:13:52.016 INFO:teuthology.orchestra.run.smithi092.stdout:[client.3] 2024-09-11T00:13:52.016 INFO:teuthology.orchestra.run.smithi092.stdout: key = AQCf4OBm1ofPABAA4PD7UowE1Ou30IvhXc5H4Q== 2024-09-11T00:13:52.033 INFO:teuthology.orchestra.run.smithi145.stdout:[mgr.y] 2024-09-11T00:13:52.033 INFO:teuthology.orchestra.run.smithi145.stdout: key = AQCe4OBmV1tkEBAA2jhMKrgxcO6OGKvnusmviA== 2024-09-11T00:13:52.033 INFO:teuthology.orchestra.run.smithi145.stdout:[mds.a] 2024-09-11T00:13:52.033 INFO:teuthology.orchestra.run.smithi145.stdout: key = AQCe4OBmmT0yFxAA8GmXJ+YS1BYWN4Mkk5cMkg== 2024-09-11T00:13:52.033 INFO:teuthology.orchestra.run.smithi145.stdout:[mds.c] 2024-09-11T00:13:52.033 INFO:teuthology.orchestra.run.smithi145.stdout: key = AQCe4OBm1sdBHhAAxxAg+qrd5wYAlbu0ihkzkw== 2024-09-11T00:13:52.033 INFO:teuthology.orchestra.run.smithi145.stdout:[osd.0] 2024-09-11T00:13:52.033 INFO:teuthology.orchestra.run.smithi145.stdout: key = AQCi4OBmtDqPDhAAx12Cm9ty3MItAY+7G5KUZA== 2024-09-11T00:13:52.033 INFO:teuthology.orchestra.run.smithi145.stdout:[osd.1] 2024-09-11T00:13:52.034 INFO:teuthology.orchestra.run.smithi145.stdout: key = AQCl4OBmMX1lHxAA9gNthXojiV/CwkzNV4EtsA== 2024-09-11T00:13:52.034 INFO:teuthology.orchestra.run.smithi145.stdout:[osd.2] 2024-09-11T00:13:52.034 INFO:teuthology.orchestra.run.smithi145.stdout: key = AQCp4OBmT8GXAhAAI02baR11qQP8BQgP5EuuHw== 2024-09-11T00:13:52.034 INFO:teuthology.orchestra.run.smithi145.stdout:[osd.3] 2024-09-11T00:13:52.034 INFO:teuthology.orchestra.run.smithi145.stdout: key = AQCs4OBmbDILExAA8hH1qACKd2U2EVwQ1NxPgA== 2024-09-11T00:13:52.034 INFO:teuthology.orchestra.run.smithi145.stdout:[mgr.x] 2024-09-11T00:13:52.034 INFO:teuthology.orchestra.run.smithi145.stdout: key = AQCe4OBmYXf5ExAAX8zEBI+7JeYIxOVBdgi2uw== 2024-09-11T00:13:52.034 INFO:teuthology.orchestra.run.smithi145.stdout:[mds.b] 2024-09-11T00:13:52.034 INFO:teuthology.orchestra.run.smithi145.stdout: key = AQCe4OBmozHpIhAA9/Si4L5wwVt64OQFAKnkdw== 2024-09-11T00:13:52.034 INFO:teuthology.orchestra.run.smithi145.stdout:[mds.d] 2024-09-11T00:13:52.034 INFO:teuthology.orchestra.run.smithi145.stdout: key = AQCe4OBmxAr4KRAA9Cx/xqXkLHfCLWwOQ53rDw== 2024-09-11T00:13:52.034 INFO:teuthology.orchestra.run.smithi145.stdout:[osd.4] 2024-09-11T00:13:52.034 INFO:teuthology.orchestra.run.smithi145.stdout: key = AQCy4OBmgYt7GRAAyseePTbu7tElPtVIHEC8jA== 2024-09-11T00:13:52.034 INFO:teuthology.orchestra.run.smithi145.stdout:[osd.5] 2024-09-11T00:13:52.035 INFO:teuthology.orchestra.run.smithi145.stdout: key = AQC14OBmVjcPKhAA8ORCTlHOMqPi2BqXV39qug== 2024-09-11T00:13:52.035 INFO:teuthology.orchestra.run.smithi145.stdout:[osd.6] 2024-09-11T00:13:52.035 INFO:teuthology.orchestra.run.smithi145.stdout: key = AQC44OBmuWgaLBAASsJt9EZ9WqxQBe8peGQELg== 2024-09-11T00:13:52.035 INFO:teuthology.orchestra.run.smithi145.stdout:[osd.7] 2024-09-11T00:13:52.035 INFO:teuthology.orchestra.run.smithi145.stdout: key = AQC84OBmNLgLARAAeES0seHW36ArPyi8E0bCKw== 2024-09-11T00:13:52.035 INFO:teuthology.orchestra.run.smithi145.stdout:[client.0] 2024-09-11T00:13:52.035 INFO:teuthology.orchestra.run.smithi145.stdout: key = AQCe4OBmiRAJLhAATruvtg1BGyubuDnFLT3rug== 2024-09-11T00:13:52.035 INFO:teuthology.orchestra.run.smithi145.stdout:[client.2] 2024-09-11T00:13:52.035 INFO:teuthology.orchestra.run.smithi145.stdout: key = AQCe4OBmtbGpMxAAV0wJY70pS7DRP9+z+U0joQ== 2024-09-11T00:13:52.035 INFO:teuthology.orchestra.run.smithi145.stdout:[client.1] 2024-09-11T00:13:52.035 INFO:teuthology.orchestra.run.smithi145.stdout: key = AQCe4OBm5/DWNhAABWcFpCDqMTspKGv+BnvGqg== 2024-09-11T00:13:52.035 INFO:teuthology.orchestra.run.smithi145.stdout:[client.3] 2024-09-11T00:13:52.035 INFO:teuthology.orchestra.run.smithi145.stdout: key = AQCf4OBm1ofPABAA4PD7UowE1Ou30IvhXc5H4Q== 2024-09-11T00:13:52.036 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-11T00:13:52.060 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-11T00:13:52.127 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-11T00:13:52.129 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-11T00:13:52.182 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-11T00:13:52.185 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-11T00:13:52.238 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-11T00:13:52.241 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-11T00:13:52.291 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-11T00:13:52.294 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-11T00:13:52.344 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-11T00:13:52.347 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-11T00:13:52.397 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-11T00:13:52.400 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-11T00:13:52.451 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-11T00:13:52.453 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-11T00:13:52.504 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-11T00:13:52.506 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-11T00:13:52.560 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-11T00:13:52.562 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-11T00:13:52.617 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-11T00:13:52.619 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-11T00:13:52.670 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-11T00:13:52.672 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-11T00:13:52.725 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-11T00:13:52.727 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-11T00:13:52.779 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-11T00:13:52.782 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-11T00:13:52.833 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-11T00:13:52.835 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-11T00:13:52.889 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-11T00:13:52.891 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-11T00:13:52.945 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-11T00:13:52.948 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-11T00:13:53.002 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-11T00:13:53.005 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-11T00:13:53.058 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-09-11T00:13:53.058 DEBUG:teuthology.orchestra.run.smithi092:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-09-11T00:13:53.083 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-11T00:13:53.178 DEBUG:teuthology.orchestra.run.smithi092:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-09-11T00:13:53.203 DEBUG:teuthology.orchestra.run.smithi145:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-09-11T00:13:53.228 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-11T00:13:53.325 DEBUG:teuthology.orchestra.run.smithi145:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-09-11T00:13:53.350 DEBUG:teuthology.orchestra.run.smithi145:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-09-11T00:13:53.415 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-11T00:13:53.511 DEBUG:teuthology.orchestra.run.smithi145:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-09-11T00:13:53.535 DEBUG:teuthology.orchestra.run.smithi092:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-11T00:13:53.537 DEBUG:teuthology.orchestra.run.smithi145:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-11T00:13:53.591 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-09-11T00:13:53.592 INFO:tasks.ceph.mon.a:Restarting daemon 2024-09-11T00:13:53.592 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-09-11T00:13:53.595 INFO:tasks.ceph.mon.a:Started 2024-09-11T00:13:53.595 INFO:tasks.ceph.mon.b:Restarting daemon 2024-09-11T00:13:53.595 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-09-11T00:13:53.634 INFO:tasks.ceph.mon.b:Started 2024-09-11T00:13:53.634 INFO:tasks.ceph.mon.c:Restarting daemon 2024-09-11T00:13:53.634 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-09-11T00:13:53.636 INFO:tasks.ceph.mon.c:Started 2024-09-11T00:13:53.636 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-09-11T00:13:53.636 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-09-11T00:13:53.637 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-09-11T00:13:53.639 INFO:tasks.ceph.mgr.y:Started 2024-09-11T00:13:53.639 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-09-11T00:13:53.639 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-09-11T00:13:53.641 INFO:tasks.ceph.mgr.x:Started 2024-09-11T00:13:53.641 INFO:tasks.ceph:setting config [client] client_mount_timeout = 600 2024-09-11T00:13:53.641 DEBUG:teuthology.orchestra.run.smithi092:> sudo ceph --cluster ceph config set client client_mount_timeout 600 2024-09-11T00:13:53.644 INFO:tasks.ceph:setting config [client] debug_client = 20 2024-09-11T00:13:53.644 DEBUG:teuthology.orchestra.run.smithi092:> sudo ceph --cluster ceph config set client debug_client 20 2024-09-11T00:13:53.686 INFO:tasks.ceph:setting config [client] debug_ms = 1 2024-09-11T00:13:53.686 DEBUG:teuthology.orchestra.run.smithi092:> sudo ceph --cluster ceph config set client debug_ms 1 2024-09-11T00:13:53.729 INFO:tasks.ceph:setting config [client] rados_mon_op_timeout = 900 2024-09-11T00:13:53.729 DEBUG:teuthology.orchestra.run.smithi092:> sudo ceph --cluster ceph config set client rados_mon_op_timeout 900 2024-09-11T00:13:53.772 INFO:tasks.ceph:setting config [client] rados_osd_op_timeout = 900 2024-09-11T00:13:53.772 DEBUG:teuthology.orchestra.run.smithi092:> sudo ceph --cluster ceph config set client rados_osd_op_timeout 900 2024-09-11T00:13:53.817 INFO:tasks.ceph:setting config [mds] debug_mds = 20 2024-09-11T00:13:53.817 DEBUG:teuthology.orchestra.run.smithi092:> sudo ceph --cluster ceph config set mds debug_mds 20 2024-09-11T00:13:53.862 INFO:tasks.ceph:setting config [mds] debug_mds_balancer = 20 2024-09-11T00:13:53.862 DEBUG:teuthology.orchestra.run.smithi092:> sudo ceph --cluster ceph config set mds debug_mds_balancer 20 2024-09-11T00:13:53.905 INFO:tasks.ceph:setting config [mds] debug_ms = 2 2024-09-11T00:13:53.906 DEBUG:teuthology.orchestra.run.smithi092:> sudo ceph --cluster ceph config set mds debug_ms 2 2024-09-11T00:13:53.949 INFO:tasks.ceph:setting config [mds] mds_debug_frag = True 2024-09-11T00:13:53.949 DEBUG:teuthology.orchestra.run.smithi092:> sudo ceph --cluster ceph config set mds mds_debug_frag True 2024-09-11T00:13:53.992 INFO:tasks.ceph:setting config [mds] mds_debug_scatterstat = True 2024-09-11T00:13:53.992 DEBUG:teuthology.orchestra.run.smithi092:> sudo ceph --cluster ceph config set mds mds_debug_scatterstat True 2024-09-11T00:13:54.037 INFO:tasks.ceph:setting config [mds] mds_op_complaint_time = 180 2024-09-11T00:13:54.037 DEBUG:teuthology.orchestra.run.smithi092:> sudo ceph --cluster ceph config set mds mds_op_complaint_time 180 2024-09-11T00:13:54.084 INFO:tasks.ceph:setting config [mds] mds_verify_scatter = True 2024-09-11T00:13:54.084 DEBUG:teuthology.orchestra.run.smithi092:> sudo ceph --cluster ceph config set mds mds_verify_scatter True 2024-09-11T00:13:54.095 INFO:tasks.ceph:setting config [mds] osd_op_complaint_time = 180 2024-09-11T00:13:54.095 DEBUG:teuthology.orchestra.run.smithi092:> sudo ceph --cluster ceph config set mds osd_op_complaint_time 180 2024-09-11T00:13:54.128 INFO:tasks.ceph:setting config [mds] rados_mon_op_timeout = 900 2024-09-11T00:13:54.129 DEBUG:teuthology.orchestra.run.smithi092:> sudo ceph --cluster ceph config set mds rados_mon_op_timeout 900 2024-09-11T00:13:54.159 INFO:tasks.ceph:setting config [mds] rados_osd_op_timeout = 900 2024-09-11T00:13:54.160 DEBUG:teuthology.orchestra.run.smithi092:> sudo ceph --cluster ceph config set mds rados_osd_op_timeout 900 2024-09-11T00:13:54.202 INFO:tasks.ceph:setting config [mon] mon_op_complaint_time = 120 2024-09-11T00:13:54.202 DEBUG:teuthology.orchestra.run.smithi092:> sudo ceph --cluster ceph config set mon mon_op_complaint_time 120 2024-09-11T00:13:54.245 INFO:tasks.ceph:setting config [mon] mon_warn_on_pool_no_app = False 2024-09-11T00:13:54.246 DEBUG:teuthology.orchestra.run.smithi092:> sudo ceph --cluster ceph config set mon mon_warn_on_pool_no_app False 2024-09-11T00:13:54.255 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.253+0000 7f407cff9640 1 -- 172.21.15.92:0/2819004165 <== mon.1 v2:172.21.15.145:3300/0 12 ==== mon_command_ack([{prefix=config set, name=debug_ms}]=0 v7)=0 v7) ==== 109+0+0 (secure 0 0 0) 0x7f4074010dd0 con 0x7f408006fa30 2024-09-11T00:13:54.256 INFO:tasks.ceph:setting config [osd] osd_op_complaint_time = 180 2024-09-11T00:13:54.256 DEBUG:teuthology.orchestra.run.smithi092:> sudo ceph --cluster ceph config set osd osd_op_complaint_time 180 2024-09-11T00:13:54.258 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.256+0000 7f40864b1640 1 -- 172.21.15.92:0/2819004165 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f408006fa30 msgr2=0x7f408015beb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:54.258 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.256+0000 7f40864b1640 1 --2- 172.21.15.92:0/2819004165 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f408006fa30 0x7f408015beb0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f407400d630 tx=0x7f407400daf0 comp rx=0 tx=0).stop 2024-09-11T00:13:54.258 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.256+0000 7f40864b1640 1 -- 172.21.15.92:0/2819004165 shutdown_connections 2024-09-11T00:13:54.258 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.256+0000 7f40864b1640 1 --2- 172.21.15.92:0/2819004165 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4080071e40 0x7f408015c3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:54.258 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.256+0000 7f40864b1640 1 --2- 172.21.15.92:0/2819004165 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f408006fa30 0x7f408015beb0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:54.259 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.256+0000 7f40864b1640 1 --2- 172.21.15.92:0/2819004165 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f408006d1c0 0x7f4080145bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:54.259 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.256+0000 7f40864b1640 1 -- 172.21.15.92:0/2819004165 >> 172.21.15.92:0/2819004165 conn(0x7f40800b2ad0 msgr2=0x7f40800b0940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:13:54.259 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.256+0000 7f40864b1640 1 -- 172.21.15.92:0/2819004165 shutdown_connections 2024-09-11T00:13:54.259 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.256+0000 7f40864b1640 1 -- 172.21.15.92:0/2819004165 wait complete. 2024-09-11T00:13:54.259 DEBUG:tasks.ceph:set 18 configs 2024-09-11T00:13:54.259 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'client', 'client_mount_timeout', '600'], check_status=True, hostname='smithi092') 2024-09-11T00:13:54.260 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'client', 'debug_client', '20'], check_status=True, hostname='smithi092') 2024-09-11T00:13:54.260 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'client', 'debug_ms', '1'], check_status=True, hostname='smithi092') 2024-09-11T00:13:54.281 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.279+0000 7f1e97552640 1 -- 172.21.15.92:0/3970387607 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1e7c004800 msgr2=0x7f1e7c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:54.281 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.279+0000 7f1e97552640 1 --2- 172.21.15.92:0/3970387607 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1e7c004800 0x7f1e7c004c80 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f1e90066670 tx=0x7f1e7c005830 comp rx=0 tx=0).stop 2024-09-11T00:13:54.284 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.283+0000 7f1e97552640 1 -- 172.21.15.92:0/3970387607 shutdown_connections 2024-09-11T00:13:54.284 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.283+0000 7f1e97552640 1 --2- 172.21.15.92:0/3970387607 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1e7c004800 0x7f1e7c004c80 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:54.284 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.283+0000 7f1e97552640 1 -- 172.21.15.92:0/3970387607 >> 172.21.15.92:0/3970387607 conn(0x7f1e8801d7a0 msgr2=0x7f1e88054590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:13:54.288 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.285+0000 7f1e97552640 1 -- 172.21.15.92:0/3970387607 shutdown_connections 2024-09-11T00:13:54.289 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.285+0000 7f1e97552640 1 -- 172.21.15.92:0/3970387607 wait complete. 2024-09-11T00:13:54.289 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.287+0000 7f1e97552640 1 Processor -- start 2024-09-11T00:13:54.290 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.287+0000 7f1e97552640 1 -- start start 2024-09-11T00:13:54.290 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.289+0000 7f1e97552640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1e7c004800 0x7f1e8804aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:54.291 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.289+0000 7f1e97552640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1e88048240 0x7f1e8800aec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:54.291 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.289+0000 7f1e97552640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1e880d5380 0x7f1e880d5830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:54.291 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.289+0000 7f1e97552640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f1e88007000 con 0x7f1e7c004800 2024-09-11T00:13:54.293 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.289+0000 7f1e97552640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f1e88006e80 con 0x7f1e880d5380 2024-09-11T00:13:54.293 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.289+0000 7f1e97552640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f1e88007180 con 0x7f1e88048240 2024-09-11T00:13:54.293 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.291+0000 7f1e95aef640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1e880d5380 0x7f1e880d5830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:54.294 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.291+0000 7f1e95aef640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1e880d5380 0x7f1e880d5830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.92:43082/0 (socket says 172.21.15.92:43082) 2024-09-11T00:13:54.294 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.291+0000 7f1e95aef640 1 -- 172.21.15.92:0/3663251641 learned_addr learned my addr 172.21.15.92:0/3663251641 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-11T00:13:54.294 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.292+0000 7f1e95aef640 1 -- 172.21.15.92:0/3663251641 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1e88048240 msgr2=0x7f1e8800aec0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T00:13:54.295 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'client', 'rados_mon_op_timeout', '900'], check_status=True, hostname='smithi092') 2024-09-11T00:13:54.295 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'client', 'rados_osd_op_timeout', '900'], check_status=True, hostname='smithi092') 2024-09-11T00:13:54.295 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'debug_mds', '20'], check_status=True, hostname='smithi092') 2024-09-11T00:13:54.295 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'debug_mds_balancer', '20'], check_status=True, hostname='smithi092') 2024-09-11T00:13:54.297 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.292+0000 7f1e95aef640 1 --2- 172.21.15.92:0/3663251641 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1e88048240 0x7f1e8800aec0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:54.297 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.292+0000 7f1e95aef640 1 -- 172.21.15.92:0/3663251641 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1e7c004800 msgr2=0x7f1e8804aaa0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T00:13:54.297 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.296+0000 7f1e952ee640 1 --2- 172.21.15.92:0/3663251641 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1e7c004800 0x7f1e8804aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:54.298 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.296+0000 7f1e95aef640 1 --2- 172.21.15.92:0/3663251641 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1e7c004800 0x7f1e8804aaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:54.298 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.296+0000 7f1e95aef640 1 -- 172.21.15.92:0/3663251641 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e88181040 con 0x7f1e880d5380 2024-09-11T00:13:54.298 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.296+0000 7f1e952ee640 1 --2- 172.21.15.92:0/3663251641 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1e7c004800 0x7f1e8804aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:13:54.298 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.297+0000 7f1e95aef640 1 --2- 172.21.15.92:0/3663251641 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1e880d5380 0x7f1e880d5830 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f1e88035450 tx=0x7f1e800039c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:13:54.298 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.297+0000 7f1e85ffb640 1 -- 172.21.15.92:0/3663251641 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e800119c0 con 0x7f1e880d5380 2024-09-11T00:13:54.299 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.297+0000 7f1e85ffb640 1 -- 172.21.15.92:0/3663251641 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1e80018070 con 0x7f1e880d5380 2024-09-11T00:13:54.300 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.297+0000 7f1e85ffb640 1 -- 172.21.15.92:0/3663251641 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e80011de0 con 0x7f1e880d5380 2024-09-11T00:13:54.300 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.299+0000 7f1e97552640 1 -- 172.21.15.92:0/3663251641 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1e88181320 con 0x7f1e880d5380 2024-09-11T00:13:54.301 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.300+0000 7f1e97552640 1 -- 172.21.15.92:0/3663251641 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1e881818e0 con 0x7f1e880d5380 2024-09-11T00:13:54.307 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.306+0000 7f1e85ffb640 1 -- 172.21.15.92:0/3663251641 <== mon.1 v2:172.21.15.145:3300/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7f1e8001d460 con 0x7f1e880d5380 2024-09-11T00:13:54.308 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.306+0000 7f1e85ffb640 1 -- 172.21.15.92:0/3663251641 <== mon.1 v2:172.21.15.145:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f1e8001c950 con 0x7f1e880d5380 2024-09-11T00:13:54.313 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.311+0000 7f1e97552640 1 -- 172.21.15.92:0/3663251641 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1e88049650 con 0x7f1e880d5380 2024-09-11T00:13:54.316 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.314+0000 7fa54fa16640 1 -- 172.21.15.92:0/3761711745 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa540054ca0 msgr2=0x7fa540104310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:54.316 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.314+0000 7fa54fa16640 1 --2- 172.21.15.92:0/3761711745 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa540054ca0 0x7fa540104310 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fa548069dc0 tx=0x7fa548096e10 comp rx=0 tx=0).stop 2024-09-11T00:13:54.316 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.314+0000 7fa54fa16640 1 -- 172.21.15.92:0/3761711745 shutdown_connections 2024-09-11T00:13:54.316 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.314+0000 7fa54fa16640 1 --2- 172.21.15.92:0/3761711745 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa540104850 0x7fa5400392e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:54.316 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.314+0000 7fa54fa16640 1 --2- 172.21.15.92:0/3761711745 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa540054ca0 0x7fa540104310 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:54.316 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.314+0000 7fa54fa16640 1 --2- 172.21.15.92:0/3761711745 >> v2:172.21.15.92:3300/0 conn(0x7fa540100720 0x7fa540033ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:54.316 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.314+0000 7fa54fa16640 1 -- 172.21.15.92:0/3761711745 >> 172.21.15.92:0/3761711745 conn(0x7fa54001d7a0 msgr2=0x7fa540054590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:13:54.317 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.316+0000 7f9ff1ffb640 1 -- 172.21.15.92:0/4043247723 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_command([{prefix=config set, name=debug_mds_balancer}] v 0) -- 0x7f9fe00016f0 con 0x7f9ffc205010 2024-09-11T00:13:54.325 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.320+0000 7f1e85ffb640 1 -- 172.21.15.92:0/3663251641 <== mon.1 v2:172.21.15.145:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+76091 (secure 0 0 0) 0x7f1e8001cb50 con 0x7f1e880d5380 2024-09-11T00:13:54.325 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.317+0000 7fa54fa16640 1 -- 172.21.15.92:0/3761711745 shutdown_connections 2024-09-11T00:13:54.325 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.317+0000 7fa54fa16640 1 -- 172.21.15.92:0/3761711745 wait complete. 2024-09-11T00:13:54.325 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.319+0000 7fa54fa16640 1 Processor -- start 2024-09-11T00:13:54.325 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.319+0000 7fa54fa16640 1 -- start start 2024-09-11T00:13:54.326 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.320+0000 7fa54fa16640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa540100720 0x7fa5400fc8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:54.326 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.320+0000 7fa54fa16640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa540104850 0x7fa540006690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:54.326 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.320+0000 7fa54fa16640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa54004cbb0 0x7fa54004d060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:54.326 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.320+0000 7fa54fa16640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fa5400399a0 con 0x7fa540104850 2024-09-11T00:13:54.326 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.320+0000 7fa54fa16640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fa540039820 con 0x7fa540100720 2024-09-11T00:13:54.326 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.320+0000 7fa54fa16640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7fa540039b20 con 0x7fa54004cbb0 2024-09-11T00:13:54.326 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.321+0000 7fa54d7b2640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa540100720 0x7fa5400fc8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:54.326 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.321+0000 7fa54dfb3640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa54004cbb0 0x7fa54004d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:54.326 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.321+0000 7fa54d7b2640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa540100720 0x7fa5400fc8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.92:43096/0 (socket says 172.21.15.92:43096) 2024-09-11T00:13:54.326 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.321+0000 7fa54d7b2640 1 -- 172.21.15.92:0/3905735264 learned_addr learned my addr 172.21.15.92:0/3905735264 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-11T00:13:54.326 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.322+0000 7fa54d7b2640 1 -- 172.21.15.92:0/3905735264 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa54004cbb0 msgr2=0x7fa54004d060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:54.326 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.322+0000 7fa54d7b2640 1 --2- 172.21.15.92:0/3905735264 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa54004cbb0 0x7fa54004d060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:54.327 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.322+0000 7fa54d7b2640 1 -- 172.21.15.92:0/3905735264 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa540104850 msgr2=0x7fa540006690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:54.327 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.322+0000 7fa54d7b2640 1 --2- 172.21.15.92:0/3905735264 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa540104850 0x7fa540006690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:54.327 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.322+0000 7fa54d7b2640 1 -- 172.21.15.92:0/3905735264 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5400537e0 con 0x7fa540100720 2024-09-11T00:13:54.327 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.323+0000 7fa54d7b2640 1 --2- 172.21.15.92:0/3905735264 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa540100720 0x7fa5400fc8d0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fa54400fb00 tx=0x7fa54400cf10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:13:54.327 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.323+0000 7fa53dffb640 1 -- 172.21.15.92:0/3905735264 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa54400dcd0 con 0x7fa540100720 2024-09-11T00:13:54.327 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.323+0000 7fa54fa16640 1 -- 172.21.15.92:0/3905735264 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa540051b20 con 0x7fa540100720 2024-09-11T00:13:54.328 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.323+0000 7fa54fa16640 1 -- 172.21.15.92:0/3905735264 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa540053a80 con 0x7fa540100720 2024-09-11T00:13:54.328 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.325+0000 7fa53dffb640 1 -- 172.21.15.92:0/3905735264 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa544004020 con 0x7fa540100720 2024-09-11T00:13:54.328 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.325+0000 7fa53dffb640 1 -- 172.21.15.92:0/3905735264 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa544004450 con 0x7fa540100720 2024-09-11T00:13:54.328 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.326+0000 7fa53dffb640 1 -- 172.21.15.92:0/3905735264 <== mon.1 v2:172.21.15.145:3300/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7fa5440053b0 con 0x7fa540100720 2024-09-11T00:13:54.328 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.326+0000 7fa53dffb640 1 -- 172.21.15.92:0/3905735264 <== mon.1 v2:172.21.15.145:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fa5440038c0 con 0x7fa540100720 2024-09-11T00:13:54.328 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.327+0000 7f9ff3fff640 1 -- 172.21.15.92:0/4043247723 <== mon.1 v2:172.21.15.145:3300/0 8 ==== mon_command_ack([{prefix=config set, name=debug_mds_balancer}]=0 v8)=0 v8) ==== 117+0+0 (secure 0 0 0) 0x7f9ff403ea90 con 0x7f9ffc205010 2024-09-11T00:13:54.329 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.328+0000 7fa5337fe640 1 -- 172.21.15.92:0/3905735264 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa528005290 con 0x7fa540100720 2024-09-11T00:13:54.336 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.335+0000 7fa001a7f640 1 -- 172.21.15.92:0/4043247723 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9ffc205010 msgr2=0x7f9ffc205490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:54.336 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.335+0000 7fa001a7f640 1 --2- 172.21.15.92:0/4043247723 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9ffc205010 0x7f9ffc205490 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f9ff402b240 tx=0x7f9ff4000f40 comp rx=0 tx=0).stop 2024-09-11T00:13:54.339 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.338+0000 7fa001a7f640 1 -- 172.21.15.92:0/4043247723 shutdown_connections 2024-09-11T00:13:54.339 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.338+0000 7fa001a7f640 1 --2- 172.21.15.92:0/4043247723 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9ffc205010 0x7f9ffc205490 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:54.339 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.338+0000 7fa001a7f640 1 --2- 172.21.15.92:0/4043247723 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9ffc15c050 0x7f9ffc15c490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:54.339 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.338+0000 7fa001a7f640 1 --2- 172.21.15.92:0/4043247723 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9fe8004280 0x7f9ffc0ca350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:54.339 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.338+0000 7fa001a7f640 1 -- 172.21.15.92:0/4043247723 >> 172.21.15.92:0/4043247723 conn(0x7f9ffc0d3db0 msgr2=0x7f9ffc0b9690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:13:54.340 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.338+0000 7fa001a7f640 1 -- 172.21.15.92:0/4043247723 shutdown_connections 2024-09-11T00:13:54.340 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.338+0000 7fa001a7f640 1 -- 172.21.15.92:0/4043247723 wait complete. 2024-09-11T00:13:54.349 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.344+0000 7fa53dffb640 1 -- 172.21.15.92:0/3905735264 <== mon.1 v2:172.21.15.145:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+76091 (secure 0 0 0) 0x7fa544025070 con 0x7fa540100720 2024-09-11T00:13:54.349 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.348+0000 7fad3e623640 1 -- 172.21.15.92:0/1703640013 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command([{prefix=config set, name=debug_ms}] v 0) -- 0x7fad380b36e0 con 0x7fad38154a50 2024-09-11T00:13:54.356 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.354+0000 7f100b124640 1 -- 172.21.15.92:0/3528407544 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1004072560 msgr2=0x7f1004161a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:54.356 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.354+0000 7f100b124640 1 --2- 172.21.15.92:0/3528407544 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1004072560 0x7f1004161a20 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f0ffc005fd0 tx=0x7f0ffc02a830 comp rx=0 tx=0).stop 2024-09-11T00:13:54.369 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'debug_ms', '2'], check_status=True, hostname='smithi092') 2024-09-11T00:13:54.373 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.372+0000 7fad2dffb640 1 -- 172.21.15.92:0/1703640013 <== mon.0 v2:172.21.15.92:3300/0 8 ==== mon_command_ack([{prefix=config set, name=debug_ms}]=0 v9)=0 v9) ==== 106+0+0 (secure 0 0 0) 0x7fad30004710 con 0x7fad38154a50 2024-09-11T00:13:54.375 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.373+0000 7fad237fe640 1 -- 172.21.15.92:0/1703640013 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fad38154a50 msgr2=0x7fad3814eeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:54.375 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.373+0000 7fad237fe640 1 --2- 172.21.15.92:0/1703640013 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fad38154a50 0x7fad3814eeb0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fad30009000 tx=0x7fad30032da0 comp rx=0 tx=0).stop 2024-09-11T00:13:54.375 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.367+0000 7f100b124640 1 -- 172.21.15.92:0/3528407544 shutdown_connections 2024-09-11T00:13:54.375 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.367+0000 7f100b124640 1 --2- 172.21.15.92:0/3528407544 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1004072560 0x7f1004161a20 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:54.375 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.367+0000 7f100b124640 1 --2- 172.21.15.92:0/3528407544 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f10040b2cd0 0x7f10040b4960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:54.375 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.367+0000 7f100b124640 1 -- 172.21.15.92:0/3528407544 >> 172.21.15.92:0/3528407544 conn(0x7f10040cfaf0 msgr2=0x7f10040cff00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:13:54.376 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.374+0000 7fad237fe640 1 -- 172.21.15.92:0/1703640013 shutdown_connections 2024-09-11T00:13:54.376 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.374+0000 7fad237fe640 1 --2- 172.21.15.92:0/1703640013 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fad38154a50 0x7fad3814eeb0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:54.376 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.374+0000 7fad237fe640 1 --2- 172.21.15.92:0/1703640013 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fad380cf4c0 0x7fad3815ffd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:54.376 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.374+0000 7fad237fe640 1 --2- 172.21.15.92:0/1703640013 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fad38072d70 0x7fad38156c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:54.376 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.374+0000 7fad237fe640 1 -- 172.21.15.92:0/1703640013 >> 172.21.15.92:0/1703640013 conn(0x7fad3806ca50 msgr2=0x7fad3806ee20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:13:54.376 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.375+0000 7f100b124640 1 -- 172.21.15.92:0/3528407544 shutdown_connections 2024-09-11T00:13:54.385 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.384+0000 7fad237fe640 1 -- 172.21.15.92:0/1703640013 shutdown_connections 2024-09-11T00:13:54.385 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.384+0000 7fad237fe640 1 -- 172.21.15.92:0/1703640013 wait complete. 2024-09-11T00:13:54.390 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.385+0000 7f100b124640 1 -- 172.21.15.92:0/3528407544 wait complete. 2024-09-11T00:13:54.390 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.386+0000 7f100b124640 1 Processor -- start 2024-09-11T00:13:54.390 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.386+0000 7f100b124640 1 -- start start 2024-09-11T00:13:54.390 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.388+0000 7f100b124640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1004072560 0x7f10040701a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:54.390 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.388+0000 7f100b124640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f10040b2cd0 0x7f100413b280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:54.390 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.388+0000 7f100b124640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f10040b30b0 0x7f100406e2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:54.390 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.388+0000 7f100b124640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f10040cdc00 con 0x7f10040b2cd0 2024-09-11T00:13:54.390 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.388+0000 7f100b124640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f10040cda80 con 0x7f1004072560 2024-09-11T00:13:54.391 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.388+0000 7f100b124640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f10040cdd80 con 0x7f10040b30b0 2024-09-11T00:13:54.391 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.388+0000 7f1003fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f10040b2cd0 0x7f100413b280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:54.391 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.388+0000 7f1003fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f10040b2cd0 0x7f100413b280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:60486/0 (socket says 172.21.15.92:60486) 2024-09-11T00:13:54.391 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.388+0000 7f1003fff640 1 -- 172.21.15.92:0/3930471949 learned_addr learned my addr 172.21.15.92:0/3930471949 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-11T00:13:54.392 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.389+0000 7f1003fff640 1 -- 172.21.15.92:0/3930471949 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f10040b30b0 msgr2=0x7f100406e2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:54.392 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.389+0000 7f1003fff640 1 --2- 172.21.15.92:0/3930471949 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f10040b30b0 0x7f100406e2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:54.392 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.389+0000 7f1003fff640 1 -- 172.21.15.92:0/3930471949 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1004072560 msgr2=0x7f10040701a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T00:13:54.392 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.389+0000 7f1003fff640 1 --2- 172.21.15.92:0/3930471949 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1004072560 0x7f10040701a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:54.392 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.389+0000 7f1003fff640 1 -- 172.21.15.92:0/3930471949 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f100406eea0 con 0x7f10040b2cd0 2024-09-11T00:13:54.392 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.390+0000 7f1003fff640 1 --2- 172.21.15.92:0/3930471949 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f10040b2cd0 0x7f100413b280 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f0ffc02ae20 tx=0x7f0ffc033f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:13:54.392 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.390+0000 7f10017fa640 1 -- 172.21.15.92:0/3930471949 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ffc042020 con 0x7f10040b2cd0 2024-09-11T00:13:54.392 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.390+0000 7f100b124640 1 -- 172.21.15.92:0/3930471949 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f100406f180 con 0x7f10040b2cd0 2024-09-11T00:13:54.393 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.390+0000 7f100b124640 1 -- 172.21.15.92:0/3930471949 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f100406f9a0 con 0x7f10040b2cd0 2024-09-11T00:13:54.393 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.392+0000 7f10017fa640 1 -- 172.21.15.92:0/3930471949 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0ffc038040 con 0x7f10040b2cd0 2024-09-11T00:13:54.394 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.392+0000 7f10017fa640 1 -- 172.21.15.92:0/3930471949 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ffc037070 con 0x7f10040b2cd0 2024-09-11T00:13:54.395 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.393+0000 7f10017fa640 1 -- 172.21.15.92:0/3930471949 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7f0ffc04f060 con 0x7f10040b2cd0 2024-09-11T00:13:54.395 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.393+0000 7f10017fa640 1 -- 172.21.15.92:0/3930471949 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f0ffc0046f0 con 0x7f10040b2cd0 2024-09-11T00:13:54.395 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.394+0000 7f100b124640 1 -- 172.21.15.92:0/3930471949 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0fe4005290 con 0x7f10040b2cd0 2024-09-11T00:13:54.399 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.398+0000 7f10017fa640 1 -- 172.21.15.92:0/3930471949 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+76091 (secure 0 0 0) 0x7f0ffc050420 con 0x7f10040b2cd0 2024-09-11T00:13:54.421 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'mds_debug_frag', 'True'], check_status=True, hostname='smithi092') 2024-09-11T00:13:54.431 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.430+0000 7f5541d89640 1 -- 172.21.15.92:0/1878706716 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5528004800 msgr2=0x7f5528004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:54.431 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.430+0000 7f5541d89640 1 --2- 172.21.15.92:0/1878706716 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5528004800 0x7f5528004c80 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f552c004040 tx=0x7f5528005830 comp rx=0 tx=0).stop 2024-09-11T00:13:54.431 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.430+0000 7f553bfff640 1 -- 172.21.15.92:0/1878706716 reap_dead start 2024-09-11T00:13:54.437 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.435+0000 7f5541d89640 1 -- 172.21.15.92:0/1878706716 shutdown_connections 2024-09-11T00:13:54.437 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.435+0000 7f5541d89640 1 -- 172.21.15.92:0/1878706716 >> 172.21.15.92:0/1878706716 conn(0x7f553c074170 msgr2=0x7f553c074580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:13:54.439 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.436+0000 7f5541d89640 1 -- 172.21.15.92:0/1878706716 shutdown_connections 2024-09-11T00:13:54.439 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.436+0000 7f5541d89640 1 -- 172.21.15.92:0/1878706716 wait complete. 2024-09-11T00:13:54.440 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.438+0000 7f5541d89640 1 Processor -- start 2024-09-11T00:13:54.440 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.438+0000 7f5541d89640 1 -- start start 2024-09-11T00:13:54.441 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.440+0000 7f5541d89640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5528004800 0x7f553c0c6b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:54.442 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.440+0000 7f553b7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5528004800 0x7f553c0c6b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:54.442 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.440+0000 7f553b7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5528004800 0x7f553c0c6b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:60494/0 (socket says 172.21.15.92:60494) 2024-09-11T00:13:54.442 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.440+0000 7f553b7fe640 1 -- 172.21.15.92:0/2403190876 learned_addr learned my addr 172.21.15.92:0/2403190876 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-11T00:13:54.442 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.440+0000 7f5541d89640 1 --2- 172.21.15.92:0/2403190876 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f553c0707e0 0x7f553c154220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:54.443 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.440+0000 7f5541d89640 1 --2- 172.21.15.92:0/2403190876 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f553c0adbd0 0x7f553c0ae050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:54.443 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.441+0000 7f5533fff640 1 --2- 172.21.15.92:0/2403190876 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f553c0707e0 0x7f553c154220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:54.443 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.441+0000 7f5541d89640 1 -- 172.21.15.92:0/2403190876 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f553c06d0f0 con 0x7f5528004800 2024-09-11T00:13:54.443 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.441+0000 7f5541d89640 1 -- 172.21.15.92:0/2403190876 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f553c0b5fd0 con 0x7f553c0707e0 2024-09-11T00:13:54.443 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.441+0000 7f5541d89640 1 -- 172.21.15.92:0/2403190876 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f553c06d270 con 0x7f553c0adbd0 2024-09-11T00:13:54.445 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.441+0000 7f553bfff640 1 --2- 172.21.15.92:0/2403190876 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f553c0adbd0 0x7f553c0ae050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:54.445 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.441+0000 7f553b7fe640 1 -- 172.21.15.92:0/2403190876 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f553c0adbd0 msgr2=0x7f553c0ae050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:54.446 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.441+0000 7f553b7fe640 1 --2- 172.21.15.92:0/2403190876 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f553c0adbd0 0x7f553c0ae050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:54.446 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.442+0000 7f553b7fe640 1 -- 172.21.15.92:0/2403190876 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f553c0707e0 msgr2=0x7f553c154220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:54.446 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.442+0000 7f553b7fe640 1 --2- 172.21.15.92:0/2403190876 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f553c0707e0 0x7f553c154220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:54.446 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.442+0000 7f553b7fe640 1 -- 172.21.15.92:0/2403190876 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f553c154760 con 0x7f5528004800 2024-09-11T00:13:54.446 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.442+0000 7f5533fff640 1 --2- 172.21.15.92:0/2403190876 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f553c0707e0 0x7f553c154220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:13:54.446 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.442+0000 7f553b7fe640 1 --2- 172.21.15.92:0/2403190876 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5528004800 0x7f553c0c6b20 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f552400b420 tx=0x7f552400b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:13:54.446 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.443+0000 7f553bfff640 1 --2- 172.21.15.92:0/2403190876 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f553c0adbd0 0x7f553c0ae050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:13:54.446 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.443+0000 7f5538ff9640 1 -- 172.21.15.92:0/2403190876 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5524011830 con 0x7f5528004800 2024-09-11T00:13:54.446 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.443+0000 7f5538ff9640 1 -- 172.21.15.92:0/2403190876 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5524016070 con 0x7f5528004800 2024-09-11T00:13:54.446 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.443+0000 7f5541d89640 1 -- 172.21.15.92:0/2403190876 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f553c1f2270 con 0x7f5528004800 2024-09-11T00:13:54.446 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.444+0000 7f5541d89640 1 -- 172.21.15.92:0/2403190876 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f553c0c98c0 con 0x7f5528004800 2024-09-11T00:13:54.447 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.445+0000 7f5538ff9640 1 -- 172.21.15.92:0/2403190876 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5524011d80 con 0x7f5528004800 2024-09-11T00:13:54.447 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.446+0000 7f5538ff9640 1 -- 172.21.15.92:0/2403190876 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7f552401b460 con 0x7f5528004800 2024-09-11T00:13:54.447 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.446+0000 7f5538ff9640 1 -- 172.21.15.92:0/2403190876 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f552401ab30 con 0x7f5528004800 2024-09-11T00:13:54.448 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.446+0000 7f5531ffb640 1 -- 172.21.15.92:0/2403190876 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f553c0aef60 con 0x7f5528004800 2024-09-11T00:13:54.451 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.450+0000 7f5538ff9640 1 -- 172.21.15.92:0/2403190876 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+76091 (secure 0 0 0) 0x7f553c0aef60 con 0x7f5528004800 2024-09-11T00:13:54.462 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.461+0000 7ff167fff640 1 -- 172.21.15.92:0/3523144190 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_command([{prefix=config set, name=mds_debug_frag}] v 0) -- 0x7ff1840ced00 con 0x7ff1840cce40 2024-09-11T00:13:54.469 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.467+0000 7f77d8e95640 1 -- 172.21.15.92:0/2144351510 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f77d416e1f0 msgr2=0x7f77d406fb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:54.469 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.467+0000 7f77d8e95640 1 --2- 172.21.15.92:0/2144351510 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f77d416e1f0 0x7f77d406fb40 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f77d40b5cb0 tx=0x7f77c802aa40 comp rx=0 tx=0).stop 2024-09-11T00:13:54.469 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.467+0000 7f77d8e95640 1 -- 172.21.15.92:0/2144351510 shutdown_connections 2024-09-11T00:13:54.469 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.467+0000 7f77d8e95640 1 --2- 172.21.15.92:0/2144351510 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f77d416e1f0 0x7f77d406fb40 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:54.469 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.467+0000 7f77d8e95640 1 --2- 172.21.15.92:0/2144351510 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f77d40723b0 0x7f77d406f600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:54.469 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.467+0000 7f77d8e95640 1 --2- 172.21.15.92:0/2144351510 >> v2:172.21.15.145:3300/0 conn(0x7f77d40cf400 0x7f77d40738e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:54.469 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.467+0000 7f77d8e95640 1 -- 172.21.15.92:0/2144351510 >> 172.21.15.92:0/2144351510 conn(0x7f77d40af660 msgr2=0x7f77d40afa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:13:54.469 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.468+0000 7f77d8e95640 1 -- 172.21.15.92:0/2144351510 shutdown_connections 2024-09-11T00:13:54.470 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.468+0000 7f77d8e95640 1 -- 172.21.15.92:0/2144351510 wait complete. 2024-09-11T00:13:54.473 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.469+0000 7f4cd1dec640 1 -- 172.21.15.92:0/962607962 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4cb4003a00 msgr2=0x7f4cb4003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:54.473 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.469+0000 7f4cd1dec640 1 --2- 172.21.15.92:0/962607962 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4cb4003a00 0x7f4cb4003e20 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f4cbc00c260 tx=0x7f4cb4005830 comp rx=0 tx=0).stop 2024-09-11T00:13:54.473 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.470+0000 7f4ccbfff640 1 -- 172.21.15.92:0/962607962 reap_dead start 2024-09-11T00:13:54.473 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.470+0000 7f4cd1dec640 1 -- 172.21.15.92:0/962607962 shutdown_connections 2024-09-11T00:13:54.473 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.470+0000 7f4cd1dec640 1 -- 172.21.15.92:0/962607962 >> 172.21.15.92:0/962607962 conn(0x7f4ccc06e480 msgr2=0x7f4ccc0b2870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:13:54.473 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.470+0000 7f4cd1dec640 1 -- 172.21.15.92:0/962607962 shutdown_connections 2024-09-11T00:13:54.474 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.470+0000 7f77d8e95640 1 Processor -- start 2024-09-11T00:13:54.474 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.470+0000 7f77d8e95640 1 -- start start 2024-09-11T00:13:54.474 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.471+0000 7f77d8e95640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f77d40cf400 0x7f77d417a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:54.474 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.471+0000 7f77d8e95640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f77d41605f0 0x7f77d415fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:54.474 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.471+0000 7f77d8e95640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f77d40b3d50 0x7f77d40b41d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:54.474 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.471+0000 7f77d8e95640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f77d40cce00 con 0x7f77d41605f0 2024-09-11T00:13:54.474 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.471+0000 7f77d8e95640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f77d40ccc80 con 0x7f77d40b3d50 2024-09-11T00:13:54.474 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.471+0000 7f77d8e95640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f77d40ccf80 con 0x7f77d40cf400 2024-09-11T00:13:54.475 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.470+0000 7f4cd1dec640 1 -- 172.21.15.92:0/962607962 wait complete. 2024-09-11T00:13:54.476 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.471+0000 7f77d259c640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f77d40cf400 0x7f77d417a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:54.476 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.472+0000 7f77d259c640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f77d40cf400 0x7f77d417a8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3301/0 says I am v2:172.21.15.92:49584/0 (socket says 172.21.15.92:49584) 2024-09-11T00:13:54.476 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.472+0000 7f77d259c640 1 -- 172.21.15.92:0/647031401 learned_addr learned my addr 172.21.15.92:0/647031401 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-11T00:13:54.476 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.472+0000 7f77d2d9d640 1 --2- 172.21.15.92:0/647031401 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f77d40b3d50 0x7f77d40b41d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:54.476 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.472+0000 7f77d259c640 1 -- 172.21.15.92:0/647031401 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f77d40b3d50 msgr2=0x7f77d40b41d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:54.477 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.472+0000 7f77d259c640 1 --2- 172.21.15.92:0/647031401 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f77d40b3d50 0x7f77d40b41d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:54.477 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.472+0000 7f77d259c640 1 -- 172.21.15.92:0/647031401 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f77d41605f0 msgr2=0x7f77d415fdd0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T00:13:54.477 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.473+0000 7f77d1d9b640 1 --2- 172.21.15.92:0/647031401 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f77d41605f0 0x7f77d415fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:54.477 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.473+0000 7f77d259c640 1 --2- 172.21.15.92:0/647031401 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f77d41605f0 0x7f77d415fdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:54.477 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.473+0000 7f77d259c640 1 -- 172.21.15.92:0/647031401 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77d417ae00 con 0x7f77d40cf400 2024-09-11T00:13:54.477 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.474+0000 7f77d2d9d640 1 --2- 172.21.15.92:0/647031401 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f77d40b3d50 0x7f77d40b41d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:13:54.478 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.472+0000 7f4cd1dec640 1 Processor -- start 2024-09-11T00:13:54.478 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.474+0000 7f4cd1dec640 1 -- start start 2024-09-11T00:13:54.478 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.475+0000 7f4cd1dec640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4cb4003a00 0x7f4ccc0a9db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:54.478 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.475+0000 7f4cd1dec640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4ccc0af450 0x7f4ccc0cfe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:54.478 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.475+0000 7f4cd1dec640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4ccc201010 0x7f4ccc0ad200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:54.479 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.475+0000 7f4cd1dec640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f4ccc15edf0 con 0x7f4ccc201010 2024-09-11T00:13:54.479 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.475+0000 7f4cd1dec640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f4ccc15ec70 con 0x7f4cb4003a00 2024-09-11T00:13:54.479 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.475+0000 7f4cd1dec640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f4ccc15ef70 con 0x7f4ccc0af450 2024-09-11T00:13:54.479 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.476+0000 7f4ccb7fe640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4cb4003a00 0x7f4ccc0a9db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:54.479 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.476+0000 7f4ccb7fe640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4cb4003a00 0x7f4ccc0a9db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.92:43178/0 (socket says 172.21.15.92:43178) 2024-09-11T00:13:54.479 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.476+0000 7f4ccb7fe640 1 -- 172.21.15.92:0/3738516433 learned_addr learned my addr 172.21.15.92:0/3738516433 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-11T00:13:54.479 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.476+0000 7f77d259c640 1 --2- 172.21.15.92:0/647031401 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f77d40cf400 0x7f77d417a8c0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f77c400b410 tx=0x7f77c400b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:13:54.479 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.476+0000 7f77d1d9b640 1 --2- 172.21.15.92:0/647031401 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f77d41605f0 0x7f77d415fdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:13:54.480 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.476+0000 7f4ccbfff640 1 --2- 172.21.15.92:0/3738516433 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4ccc201010 0x7f4ccc0ad200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:54.480 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.476+0000 7f4ccb7fe640 1 -- 172.21.15.92:0/3738516433 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4ccc0af450 msgr2=0x7f4ccc0cfe20 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-11T00:13:54.480 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.476+0000 7f4ccb7fe640 1 --2- 172.21.15.92:0/3738516433 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4ccc0af450 0x7f4ccc0cfe20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:54.481 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.476+0000 7f4ccb7fe640 1 -- 172.21.15.92:0/3738516433 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4ccc201010 msgr2=0x7f4ccc0ad200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:54.481 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.476+0000 7f4ccb7fe640 1 --2- 172.21.15.92:0/3738516433 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4ccc201010 0x7f4ccc0ad200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:54.481 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.476+0000 7f4ccb7fe640 1 -- 172.21.15.92:0/3738516433 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ccc201980 con 0x7f4cb4003a00 2024-09-11T00:13:54.481 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.477+0000 7f4ccb7fe640 1 --2- 172.21.15.92:0/3738516433 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4cb4003a00 0x7f4ccc0a9db0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f4cbc00c350 tx=0x7f4cbc006670 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:13:54.481 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.478+0000 7f11571e6640 1 -- 172.21.15.92:0/3481798761 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1148034ba0 msgr2=0x7f1148008640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:54.481 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.478+0000 7f11571e6640 1 --2- 172.21.15.92:0/3481798761 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1148034ba0 0x7f1148008640 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f1140009900 tx=0x7f114003b550 comp rx=0 tx=0).stop 2024-09-11T00:13:54.482 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.478+0000 7f4cb3fff640 1 -- 172.21.15.92:0/3738516433 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cbc031040 con 0x7f4cb4003a00 2024-09-11T00:13:54.482 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.478+0000 7f4cb3fff640 1 -- 172.21.15.92:0/3738516433 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4cbc0038c0 con 0x7f4cb4003a00 2024-09-11T00:13:54.482 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.478+0000 7f4cd1dec640 1 -- 172.21.15.92:0/3738516433 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ccc201c60 con 0x7f4cb4003a00 2024-09-11T00:13:54.482 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.478+0000 7f4cd1dec640 1 -- 172.21.15.92:0/3738516433 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ccc0aa2f0 con 0x7f4cb4003a00 2024-09-11T00:13:54.482 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.478+0000 7f4cb3fff640 1 -- 172.21.15.92:0/3738516433 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cbc003cf0 con 0x7f4cb4003a00 2024-09-11T00:13:54.482 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.480+0000 7f4cb3fff640 1 -- 172.21.15.92:0/3738516433 <== mon.1 v2:172.21.15.145:3300/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7f4cbc048030 con 0x7f4cb4003a00 2024-09-11T00:13:54.482 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.480+0000 7f4cb3fff640 1 -- 172.21.15.92:0/3738516433 <== mon.1 v2:172.21.15.145:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f4cbc02d770 con 0x7f4cb4003a00 2024-09-11T00:13:54.482 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.480+0000 7f11571e6640 1 -- 172.21.15.92:0/3481798761 shutdown_connections 2024-09-11T00:13:54.483 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.480+0000 7f11571e6640 1 --2- 172.21.15.92:0/3481798761 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1148034ba0 0x7f1148008640 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:54.483 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.480+0000 7f11571e6640 1 -- 172.21.15.92:0/3481798761 >> 172.21.15.92:0/3481798761 conn(0x7f114801e890 msgr2=0x7f1148055640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:13:54.483 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.481+0000 7f4cd1dec640 1 -- 172.21.15.92:0/3738516433 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4cac005290 con 0x7f4cb4003a00 2024-09-11T00:13:54.483 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.480+0000 7f11571e6640 1 -- 172.21.15.92:0/3481798761 shutdown_connections 2024-09-11T00:13:54.485 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.480+0000 7f11571e6640 1 -- 172.21.15.92:0/3481798761 wait complete. 2024-09-11T00:13:54.485 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.482+0000 7f11571e6640 1 Processor -- start 2024-09-11T00:13:54.487 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.482+0000 7f11571e6640 1 -- start start 2024-09-11T00:13:54.487 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.484+0000 7f11571e6640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1148034650 0x7f11480334a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:54.487 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.484+0000 7f11571e6640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1148034ba0 0x7f1148179560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:54.487 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.484+0000 7f11571e6640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1148054860 0x7f11480da240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:54.488 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.484+0000 7f11571e6640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f11480e7cc0 con 0x7f1148054860 2024-09-11T00:13:54.488 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.484+0000 7f11571e6640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f11480e7b40 con 0x7f1148034ba0 2024-09-11T00:13:54.488 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.484+0000 7f11571e6640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f11480e7e40 con 0x7f1148034650 2024-09-11T00:13:54.488 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.484+0000 7f11569e5640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1148054860 0x7f11480da240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:54.488 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.484+0000 7f11569e5640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1148054860 0x7f11480da240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:60546/0 (socket says 172.21.15.92:60546) 2024-09-11T00:13:54.488 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.484+0000 7f11569e5640 1 -- 172.21.15.92:0/621895507 learned_addr learned my addr 172.21.15.92:0/621895507 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-11T00:13:54.488 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.484+0000 7f11561e4640 1 --2- 172.21.15.92:0/621895507 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1148034650 0x7f11480334a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:54.488 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.484+0000 7f11559e3640 1 --2- 172.21.15.92:0/621895507 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1148034ba0 0x7f1148179560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:54.488 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.484+0000 7f11569e5640 1 -- 172.21.15.92:0/621895507 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1148034650 msgr2=0x7f11480334a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:54.488 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.484+0000 7f11569e5640 1 --2- 172.21.15.92:0/621895507 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1148034650 0x7f11480334a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:54.488 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.484+0000 7f11569e5640 1 -- 172.21.15.92:0/621895507 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1148034ba0 msgr2=0x7f1148179560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:54.488 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.484+0000 7f11569e5640 1 --2- 172.21.15.92:0/621895507 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1148034ba0 0x7f1148179560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:54.488 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.484+0000 7f11569e5640 1 -- 172.21.15.92:0/621895507 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11480e5c80 con 0x7f1148054860 2024-09-11T00:13:54.489 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.484+0000 7f11569e5640 1 --2- 172.21.15.92:0/621895507 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1148054860 0x7f11480da240 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f114c00c3c0 tx=0x7f114c00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:13:54.491 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.487+0000 7f1146ffd640 1 -- 172.21.15.92:0/621895507 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f114c017070 con 0x7f1148054860 2024-09-11T00:13:54.491 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.487+0000 7f11571e6640 1 -- 172.21.15.92:0/621895507 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11480e5f60 con 0x7f1148054860 2024-09-11T00:13:54.491 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.487+0000 7f11571e6640 1 -- 172.21.15.92:0/621895507 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11480339e0 con 0x7f1148054860 2024-09-11T00:13:54.491 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.488+0000 7f1146ffd640 1 -- 172.21.15.92:0/621895507 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f114c0053c0 con 0x7f1148054860 2024-09-11T00:13:54.491 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.488+0000 7f1146ffd640 1 -- 172.21.15.92:0/621895507 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f114c003830 con 0x7f1148054860 2024-09-11T00:13:54.491 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.489+0000 7f1146ffd640 1 -- 172.21.15.92:0/621895507 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7f114c003af0 con 0x7f1148054860 2024-09-11T00:13:54.491 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.489+0000 7f1146ffd640 1 -- 172.21.15.92:0/621895507 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f114c01c7a0 con 0x7f1148054860 2024-09-11T00:13:54.492 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.485+0000 7f4cb3fff640 1 -- 172.21.15.92:0/3738516433 <== mon.1 v2:172.21.15.145:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+76091 (secure 0 0 0) 0x7f4cbc060950 con 0x7f4cb4003a00 2024-09-11T00:13:54.492 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.487+0000 7ff17a7fc640 1 -- 172.21.15.92:0/3523144190 <== mon.1 v2:172.21.15.145:3300/0 8 ==== mon_command_ack([{prefix=config set, name=mds_debug_frag}]=0 v10)=0 v10) ==== 115+0+0 (secure 0 0 0) 0x7ff180010cb0 con 0x7ff1840cce40 2024-09-11T00:13:54.492 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.484+0000 7f77c2ffd640 1 -- 172.21.15.92:0/647031401 <== mon.2 v2:172.21.15.145:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77c4015020 con 0x7f77d40cf400 2024-09-11T00:13:54.492 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.484+0000 7f77c2ffd640 1 -- 172.21.15.92:0/647031401 <== mon.2 v2:172.21.15.145:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f77c4011920 con 0x7f77d40cf400 2024-09-11T00:13:54.492 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.485+0000 7f77c2ffd640 1 -- 172.21.15.92:0/647031401 <== mon.2 v2:172.21.15.145:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77c4011d50 con 0x7f77d40cf400 2024-09-11T00:13:54.492 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.488+0000 7f77d8e95640 1 -- 172.21.15.92:0/647031401 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77d417b0b0 con 0x7f77d40cf400 2024-09-11T00:13:54.493 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.488+0000 7f77d8e95640 1 -- 172.21.15.92:0/647031401 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f77d417b670 con 0x7f77d40cf400 2024-09-11T00:13:54.493 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.489+0000 7f77c2ffd640 1 -- 172.21.15.92:0/647031401 <== mon.2 v2:172.21.15.145:3301/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7f77c401a790 con 0x7f77d40cf400 2024-09-11T00:13:54.493 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.490+0000 7f77c2ffd640 1 -- 172.21.15.92:0/647031401 <== mon.2 v2:172.21.15.145:3301/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f77c4019c10 con 0x7f77d40cf400 2024-09-11T00:13:54.493 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.491+0000 7f11571e6640 1 -- 172.21.15.92:0/621895507 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1138005290 con 0x7f1148054860 2024-09-11T00:13:54.493 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.491+0000 7ff167fff640 1 -- 172.21.15.92:0/3523144190 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff1840cce40 msgr2=0x7ff1840ada30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:54.493 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.491+0000 7ff167fff640 1 --2- 172.21.15.92:0/3523144190 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff1840cce40 0x7ff1840ada30 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7ff18000d950 tx=0x7ff18000de10 comp rx=0 tx=0).stop 2024-09-11T00:13:54.494 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.491+0000 7ff167fff640 1 -- 172.21.15.92:0/3523144190 shutdown_connections 2024-09-11T00:13:54.494 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.491+0000 7ff167fff640 1 --2- 172.21.15.92:0/3523144190 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff184161980 0x7ff1840c6050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:54.494 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.491+0000 7ff167fff640 1 --2- 172.21.15.92:0/3523144190 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff1840cce40 0x7ff1840ada30 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:54.494 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.491+0000 7ff167fff640 1 --2- 172.21.15.92:0/3523144190 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff1840b5000 0x7ff184200a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:54.494 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.491+0000 7ff167fff640 1 -- 172.21.15.92:0/3523144190 >> 172.21.15.92:0/3523144190 conn(0x7ff184074170 msgr2=0x7ff1840cefe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:13:54.494 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.491+0000 7ff167fff640 1 -- 172.21.15.92:0/3523144190 shutdown_connections 2024-09-11T00:13:54.495 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.492+0000 7ff167fff640 1 -- 172.21.15.92:0/3523144190 wait complete. 2024-09-11T00:13:54.495 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.492+0000 7f1e97552640 1 -- 172.21.15.92:0/3663251641 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_command([{prefix=config set, name=mds_debug_scatterstat}] v 0) -- 0x7f1e880349e0 con 0x7f1e880d5380 2024-09-11T00:13:54.495 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.492+0000 7f77d8e95640 1 -- 172.21.15.92:0/647031401 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f77d40b4710 con 0x7f77d40cf400 2024-09-11T00:13:54.495 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.493+0000 7f9de8a57640 1 -- 172.21.15.92:0/1797633598 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9dcc004800 msgr2=0x7f9dcc004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:54.495 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.493+0000 7f9de8a57640 1 --2- 172.21.15.92:0/1797633598 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9dcc004800 0x7f9dcc004c80 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f9de406b710 tx=0x7f9dcc005830 comp rx=0 tx=0).stop 2024-09-11T00:13:54.500 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.496+0000 7f1146ffd640 1 -- 172.21.15.92:0/621895507 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+76091 (secure 0 0 0) 0x7f114c022080 con 0x7f1148054860 2024-09-11T00:13:54.500 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.495+0000 7f77c2ffd640 1 -- 172.21.15.92:0/647031401 <== mon.2 v2:172.21.15.145:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+76091 (secure 0 0 0) 0x7f77c401f020 con 0x7f77d40cf400 2024-09-11T00:13:54.502 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.501+0000 7f9de2d9d640 1 -- 172.21.15.92:0/1797633598 reap_dead start 2024-09-11T00:13:54.502 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.501+0000 7f9de8a57640 1 -- 172.21.15.92:0/1797633598 shutdown_connections 2024-09-11T00:13:54.502 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.501+0000 7f9de8a57640 1 -- 172.21.15.92:0/1797633598 >> 172.21.15.92:0/1797633598 conn(0x7f9ddc01d7a0 msgr2=0x7f9ddc054590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:13:54.508 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.502+0000 7f9de8a57640 1 -- 172.21.15.92:0/1797633598 shutdown_connections 2024-09-11T00:13:54.508 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.502+0000 7f9de8a57640 1 -- 172.21.15.92:0/1797633598 wait complete. 2024-09-11T00:13:54.508 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.504+0000 7f9de8a57640 1 Processor -- start 2024-09-11T00:13:54.508 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.504+0000 7f9de8a57640 1 -- start start 2024-09-11T00:13:54.509 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.505+0000 7f9de8a57640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9dcc004800 0x7f9ddc04bfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:54.509 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.505+0000 7f9de8a57640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9ddc006e40 0x7f9ddc04e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:54.509 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.505+0000 7f9de8a57640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9ddc0debe0 0x7f9ddc048030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:54.509 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.505+0000 7f9de1d9b640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9ddc006e40 0x7f9ddc04e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:54.509 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.505+0000 7f9de1d9b640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9ddc006e40 0x7f9ddc04e4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.92:43192/0 (socket says 172.21.15.92:43192) 2024-09-11T00:13:54.509 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.505+0000 7f9de1d9b640 1 -- 172.21.15.92:0/3208761898 learned_addr learned my addr 172.21.15.92:0/3208761898 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-11T00:13:54.509 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.505+0000 7f9de2d9d640 1 --2- 172.21.15.92:0/3208761898 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9ddc0debe0 0x7f9ddc048030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:54.509 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.505+0000 7f9de8a57640 1 -- 172.21.15.92:0/3208761898 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f9ddc036850 con 0x7f9dcc004800 2024-09-11T00:13:54.509 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.505+0000 7f9de8a57640 1 -- 172.21.15.92:0/3208761898 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f9ddc0553d0 con 0x7f9ddc006e40 2024-09-11T00:13:54.509 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.505+0000 7f9de8a57640 1 -- 172.21.15.92:0/3208761898 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f9ddc0369d0 con 0x7f9ddc0debe0 2024-09-11T00:13:54.509 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.506+0000 7f9de1d9b640 1 -- 172.21.15.92:0/3208761898 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9ddc0debe0 msgr2=0x7f9ddc048030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:54.509 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.506+0000 7f9de1d9b640 1 --2- 172.21.15.92:0/3208761898 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9ddc0debe0 0x7f9ddc048030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:54.510 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.506+0000 7f9de1d9b640 1 -- 172.21.15.92:0/3208761898 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9dcc004800 msgr2=0x7f9ddc04bfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:54.510 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.506+0000 7f9de259c640 1 --2- 172.21.15.92:0/3208761898 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9dcc004800 0x7f9ddc04bfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:54.510 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.506+0000 7f9de1d9b640 1 --2- 172.21.15.92:0/3208761898 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9dcc004800 0x7f9ddc04bfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:54.510 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.506+0000 7f9de1d9b640 1 -- 172.21.15.92:0/3208761898 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ddc0dbc40 con 0x7f9ddc006e40 2024-09-11T00:13:54.510 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.506+0000 7f9de1d9b640 1 --2- 172.21.15.92:0/3208761898 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9ddc006e40 0x7f9ddc04e4e0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f9de406a990 tx=0x7f9de40008d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:13:54.510 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.506+0000 7f9de259c640 1 --2- 172.21.15.92:0/3208761898 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9dcc004800 0x7f9ddc04bfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:13:54.510 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.507+0000 7f1e85ffb640 1 -- 172.21.15.92:0/3663251641 <== mon.1 v2:172.21.15.145:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_debug_scatterstat}]=0 v11)=0 v11) ==== 122+0+0 (secure 0 0 0) 0x7f1e8001cd30 con 0x7f1e880d5380 2024-09-11T00:13:54.511 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.503+0000 7f2ffc2d6640 1 -- 172.21.15.92:0/35813820 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2fec104a10 msgr2=0x7f2fec10b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:54.511 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.503+0000 7f2ffc2d6640 1 --2- 172.21.15.92:0/35813820 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2fec104a10 0x7f2fec10b670 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f2ff406b130 tx=0x7f2ff4094c40 comp rx=0 tx=0).stop 2024-09-11T00:13:54.511 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.503+0000 7f2ffc2d6640 1 -- 172.21.15.92:0/35813820 shutdown_connections 2024-09-11T00:13:54.511 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.503+0000 7f2ffc2d6640 1 --2- 172.21.15.92:0/35813820 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2fec104a10 0x7f2fec10b670 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:54.511 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.503+0000 7f2ffc2d6640 1 -- 172.21.15.92:0/35813820 >> 172.21.15.92:0/35813820 conn(0x7f2fec01d790 msgr2=0x7f2fec054580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:13:54.511 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.507+0000 7f2ffc2d6640 1 -- 172.21.15.92:0/35813820 shutdown_connections 2024-09-11T00:13:54.511 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.507+0000 7f2ffc2d6640 1 -- 172.21.15.92:0/35813820 wait complete. 2024-09-11T00:13:54.512 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.507+0000 7f9dd2ffd640 1 -- 172.21.15.92:0/3208761898 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9de406ab10 con 0x7f9ddc006e40 2024-09-11T00:13:54.512 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.507+0000 7f9de8a57640 1 -- 172.21.15.92:0/3208761898 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ddc04da00 con 0x7f9ddc006e40 2024-09-11T00:13:54.512 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.507+0000 7f9de8a57640 1 -- 172.21.15.92:0/3208761898 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ddc04dfc0 con 0x7f9ddc006e40 2024-09-11T00:13:54.512 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.508+0000 7f9dd2ffd640 1 -- 172.21.15.92:0/3208761898 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9de40a8c90 con 0x7f9ddc006e40 2024-09-11T00:13:54.512 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.508+0000 7f9dd2ffd640 1 -- 172.21.15.92:0/3208761898 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9de40a8e80 con 0x7f9ddc006e40 2024-09-11T00:13:54.512 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.508+0000 7f9dd2ffd640 1 -- 172.21.15.92:0/3208761898 <== mon.1 v2:172.21.15.145:3300/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7f9de40ba070 con 0x7f9ddc006e40 2024-09-11T00:13:54.513 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.508+0000 7f9dd2ffd640 1 -- 172.21.15.92:0/3208761898 <== mon.1 v2:172.21.15.145:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f9de4068dc0 con 0x7f9ddc006e40 2024-09-11T00:13:54.513 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.509+0000 7f9de8a57640 1 -- 172.21.15.92:0/3208761898 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9ddc04e1c0 con 0x7f9ddc006e40 2024-09-11T00:13:54.513 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.509+0000 7f2ffc2d6640 1 Processor -- start 2024-09-11T00:13:54.513 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.509+0000 7f2ffc2d6640 1 -- start start 2024-09-11T00:13:54.513 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.510+0000 7f2ffc2d6640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2fec054c90 0x7f2fec0ff570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:54.513 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.510+0000 7f2ffc2d6640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2fec100710 0x7f2fec101a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:54.514 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.510+0000 7f2ffc2d6640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2fec104a10 0x7f2fec100e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:54.514 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.510+0000 7f2ffc2d6640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f2fec114540 con 0x7f2fec100710 2024-09-11T00:13:54.514 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.510+0000 7f2ffc2d6640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f2fec1143c0 con 0x7f2fec054c90 2024-09-11T00:13:54.514 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.510+0000 7f2ffc2d6640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f2fec1146c0 con 0x7f2fec104a10 2024-09-11T00:13:54.514 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'mds_debug_scatterstat', 'True'], check_status=True, hostname='smithi092') 2024-09-11T00:13:54.514 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.511+0000 7f9dd2ffd640 1 -- 172.21.15.92:0/3208761898 <== mon.1 v2:172.21.15.145:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+76091 (secure 0 0 0) 0x7f9ddc04e1c0 con 0x7f9ddc006e40 2024-09-11T00:13:54.515 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.511+0000 7f2ff9871640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2fec100710 0x7f2fec101a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:54.515 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.511+0000 7f2ff9871640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2fec100710 0x7f2fec101a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:60592/0 (socket says 172.21.15.92:60592) 2024-09-11T00:13:54.516 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.511+0000 7f2ff9871640 1 -- 172.21.15.92:0/3197440555 learned_addr learned my addr 172.21.15.92:0/3197440555 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-11T00:13:54.516 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.512+0000 7f2ff9871640 1 -- 172.21.15.92:0/3197440555 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2fec104a10 msgr2=0x7f2fec100e00 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-11T00:13:54.516 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.512+0000 7f2ff9871640 1 --2- 172.21.15.92:0/3197440555 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2fec104a10 0x7f2fec100e00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:54.516 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.512+0000 7f2ff9871640 1 -- 172.21.15.92:0/3197440555 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2fec054c90 msgr2=0x7f2fec0ff570 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-11T00:13:54.516 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.512+0000 7f2ff9871640 1 --2- 172.21.15.92:0/3197440555 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2fec054c90 0x7f2fec0ff570 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:54.516 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.512+0000 7f2ff9871640 1 -- 172.21.15.92:0/3197440555 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2fec1020d0 con 0x7f2fec100710 2024-09-11T00:13:54.516 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.512+0000 7f2ff9871640 1 --2- 172.21.15.92:0/3197440555 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2fec100710 0x7f2fec101a80 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f2fe400c410 tx=0x7f2fe400c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:13:54.517 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.511+0000 7f1e97552640 1 -- 172.21.15.92:0/3663251641 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1e880d5380 msgr2=0x7f1e880d5830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:54.517 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.511+0000 7f1e97552640 1 --2- 172.21.15.92:0/3663251641 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1e880d5380 0x7f1e880d5830 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f1e88035450 tx=0x7f1e800039c0 comp rx=0 tx=0).stop 2024-09-11T00:13:54.517 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.513+0000 7f1e97552640 1 -- 172.21.15.92:0/3663251641 shutdown_connections 2024-09-11T00:13:54.517 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.513+0000 7f1e97552640 1 --2- 172.21.15.92:0/3663251641 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1e880d5380 0x7f1e880d5830 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:54.517 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.513+0000 7f1e97552640 1 --2- 172.21.15.92:0/3663251641 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1e88048240 0x7f1e8800aec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:54.517 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.513+0000 7f1e97552640 1 --2- 172.21.15.92:0/3663251641 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1e7c004800 0x7f1e8804aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:54.517 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.513+0000 7f1e97552640 1 -- 172.21.15.92:0/3663251641 >> 172.21.15.92:0/3663251641 conn(0x7f1e8801d7a0 msgr2=0x7f1e880dc940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:13:54.517 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.513+0000 7f1e97552640 1 -- 172.21.15.92:0/3663251641 shutdown_connections 2024-09-11T00:13:54.517 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.513+0000 7f1e97552640 1 -- 172.21.15.92:0/3663251641 wait complete. 2024-09-11T00:13:54.520 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.515+0000 7f2feaffd640 1 -- 172.21.15.92:0/3197440555 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fe4017070 con 0x7f2fec100710 2024-09-11T00:13:54.520 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.515+0000 7f2feaffd640 1 -- 172.21.15.92:0/3197440555 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2fe40035f0 con 0x7f2fec100710 2024-09-11T00:13:54.521 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.515+0000 7f2feaffd640 1 -- 172.21.15.92:0/3197440555 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fe4003a00 con 0x7f2fec100710 2024-09-11T00:13:54.521 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.519+0000 7f2ffc2d6640 1 -- 172.21.15.92:0/3197440555 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2fec1023b0 con 0x7f2fec100710 2024-09-11T00:13:54.521 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.519+0000 7f2ffc2d6640 1 -- 172.21.15.92:0/3197440555 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2fec1ab610 con 0x7f2fec100710 2024-09-11T00:13:54.525 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.524+0000 7f2feaffd640 1 -- 172.21.15.92:0/3197440555 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7f2fe4003ba0 con 0x7f2fec100710 2024-09-11T00:13:54.525 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.524+0000 7f2feaffd640 1 -- 172.21.15.92:0/3197440555 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f2fe4012760 con 0x7f2fec100710 2024-09-11T00:13:54.525 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.524+0000 7f2ffc2d6640 1 -- 172.21.15.92:0/3197440555 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2fec100030 con 0x7f2fec100710 2024-09-11T00:13:54.529 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.528+0000 7f2feaffd640 1 -- 172.21.15.92:0/3197440555 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+76091 (secure 0 0 0) 0x7f2fe4021030 con 0x7f2fec100710 2024-09-11T00:13:54.538 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'mds_op_complaint_time', '180'], check_status=True, hostname='smithi092') 2024-09-11T00:13:54.543 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.542+0000 7f100b124640 1 -- 172.21.15.92:0/3930471949 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command([{prefix=config set, name=mds_verify_scatter}] v 0) -- 0x7f0fe4005580 con 0x7f10040b2cd0 2024-09-11T00:13:54.549 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.548+0000 7f10017fa640 1 -- 172.21.15.92:0/3930471949 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_verify_scatter}]=0 v12)=0 v12) ==== 119+0+0 (secure 0 0 0) 0x7f0ffc03e9f0 con 0x7f10040b2cd0 2024-09-11T00:13:54.553 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.552+0000 7f100b124640 1 -- 172.21.15.92:0/3930471949 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f10040b2cd0 msgr2=0x7f100413b280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:54.553 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.552+0000 7f100b124640 1 --2- 172.21.15.92:0/3930471949 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f10040b2cd0 0x7f100413b280 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f0ffc02ae20 tx=0x7f0ffc033f50 comp rx=0 tx=0).stop 2024-09-11T00:13:54.554 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.553+0000 7f100b124640 1 -- 172.21.15.92:0/3930471949 shutdown_connections 2024-09-11T00:13:54.554 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.553+0000 7f100b124640 1 --2- 172.21.15.92:0/3930471949 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f10040b30b0 0x7f100406e2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:54.554 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.553+0000 7f100b124640 1 --2- 172.21.15.92:0/3930471949 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f10040b2cd0 0x7f100413b280 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:54.554 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.553+0000 7f100b124640 1 --2- 172.21.15.92:0/3930471949 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1004072560 0x7f10040701a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:54.554 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.553+0000 7f100b124640 1 -- 172.21.15.92:0/3930471949 >> 172.21.15.92:0/3930471949 conn(0x7f10040cfaf0 msgr2=0x7f1004138e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:13:54.559 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.558+0000 7f100b124640 1 -- 172.21.15.92:0/3930471949 shutdown_connections 2024-09-11T00:13:54.559 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.558+0000 7f100b124640 1 -- 172.21.15.92:0/3930471949 wait complete. 2024-09-11T00:13:54.566 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.560+0000 7fa5337fe640 1 -- 172.21.15.92:0/3905735264 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_command([{prefix=config set, name=mds_op_complaint_time}] v 0) -- 0x7fa528005580 con 0x7fa540100720 2024-09-11T00:13:54.572 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.571+0000 7fa53dffb640 1 -- 172.21.15.92:0/3905735264 <== mon.1 v2:172.21.15.145:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_op_complaint_time}]=0 v13)=0 v13) ==== 121+0+0 (secure 0 0 0) 0x7fa544003b10 con 0x7fa540100720 2024-09-11T00:13:54.574 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.572+0000 7fa5337fe640 1 -- 172.21.15.92:0/3905735264 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa540100720 msgr2=0x7fa5400fc8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:54.574 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.572+0000 7fa5337fe640 1 --2- 172.21.15.92:0/3905735264 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa540100720 0x7fa5400fc8d0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fa54400fb00 tx=0x7fa54400cf10 comp rx=0 tx=0).stop 2024-09-11T00:13:54.574 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.573+0000 7fa5337fe640 1 -- 172.21.15.92:0/3905735264 shutdown_connections 2024-09-11T00:13:54.574 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.573+0000 7fa5337fe640 1 --2- 172.21.15.92:0/3905735264 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa54004cbb0 0x7fa54004d060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:54.574 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.573+0000 7fa5337fe640 1 --2- 172.21.15.92:0/3905735264 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa540104850 0x7fa540006690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:54.574 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.573+0000 7fa5337fe640 1 --2- 172.21.15.92:0/3905735264 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa540100720 0x7fa5400fc8d0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:54.574 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.573+0000 7fa5337fe640 1 -- 172.21.15.92:0/3905735264 >> 172.21.15.92:0/3905735264 conn(0x7fa54001d7a0 msgr2=0x7fa540052f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:13:54.575 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.573+0000 7fa5337fe640 1 -- 172.21.15.92:0/3905735264 shutdown_connections 2024-09-11T00:13:54.575 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.573+0000 7fa5337fe640 1 -- 172.21.15.92:0/3905735264 wait complete. 2024-09-11T00:13:54.590 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'mds_verify_scatter', 'True'], check_status=True, hostname='smithi092') 2024-09-11T00:13:54.590 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'osd_op_complaint_time', '180'], check_status=True, hostname='smithi092') 2024-09-11T00:13:54.610 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.609+0000 7f5531ffb640 1 -- 172.21.15.92:0/2403190876 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command([{prefix=config set, name=osd_op_complaint_time}] v 0) -- 0x7f553c0af600 con 0x7f5528004800 2024-09-11T00:13:54.613 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.612+0000 7f5538ff9640 1 -- 172.21.15.92:0/2403190876 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_op_complaint_time}]=0 v14)=0 v14) ==== 121+0+0 (secure 0 0 0) 0x7f553c154760 con 0x7f5528004800 2024-09-11T00:13:54.616 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.614+0000 7f5531ffb640 1 -- 172.21.15.92:0/2403190876 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5528004800 msgr2=0x7f553c0c6b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:54.616 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.614+0000 7f5531ffb640 1 --2- 172.21.15.92:0/2403190876 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5528004800 0x7f553c0c6b20 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f552400b420 tx=0x7f552400b8e0 comp rx=0 tx=0).stop 2024-09-11T00:13:54.616 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.614+0000 7f5531ffb640 1 -- 172.21.15.92:0/2403190876 shutdown_connections 2024-09-11T00:13:54.616 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.614+0000 7f5531ffb640 1 --2- 172.21.15.92:0/2403190876 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f553c0adbd0 0x7f553c0ae050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:54.616 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.614+0000 7f5531ffb640 1 --2- 172.21.15.92:0/2403190876 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f553c0707e0 0x7f553c154220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:54.617 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.614+0000 7f5531ffb640 1 --2- 172.21.15.92:0/2403190876 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5528004800 0x7f553c0c6b20 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:54.617 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.614+0000 7f5531ffb640 1 -- 172.21.15.92:0/2403190876 >> 172.21.15.92:0/2403190876 conn(0x7f553c074170 msgr2=0x7f553c0ce9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:13:54.617 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.614+0000 7f5531ffb640 1 -- 172.21.15.92:0/2403190876 shutdown_connections 2024-09-11T00:13:54.617 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.614+0000 7f5531ffb640 1 -- 172.21.15.92:0/2403190876 wait complete. 2024-09-11T00:13:54.631 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'rados_mon_op_timeout', '900'], check_status=True, hostname='smithi092') 2024-09-11T00:13:54.631 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.629+0000 7f4cd1dec640 1 -- 172.21.15.92:0/3738516433 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_command([{prefix=config set, name=rados_mon_op_timeout}] v 0) -- 0x7f4cac005580 con 0x7f4cb4003a00 2024-09-11T00:13:54.633 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.631+0000 7f9de8a57640 1 -- 172.21.15.92:0/3208761898 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_command([{prefix=config set, name=mon_op_complaint_time}] v 0) -- 0x7f9ddc04d7f0 con 0x7f9ddc006e40 2024-09-11T00:13:54.635 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.634+0000 7f77d8e95640 1 -- 172.21.15.92:0/647031401 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_command([{prefix=config set, name=osd_op_complaint_time}] v 0) -- 0x7f77d416e1f0 con 0x7f77d40cf400 2024-09-11T00:13:54.637 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.635+0000 7f4cb3fff640 1 -- 172.21.15.92:0/3738516433 <== mon.1 v2:172.21.15.145:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_mon_op_timeout}]=0 v15)=0 v15) ==== 120+0+0 (secure 0 0 0) 0x7f4cbc04e070 con 0x7f4cb4003a00 2024-09-11T00:13:54.639 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.637+0000 7f4cd1dec640 1 -- 172.21.15.92:0/3738516433 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4cb4003a00 msgr2=0x7f4ccc0a9db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:54.639 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.637+0000 7f4cd1dec640 1 --2- 172.21.15.92:0/3738516433 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4cb4003a00 0x7f4ccc0a9db0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f4cbc00c350 tx=0x7f4cbc006670 comp rx=0 tx=0).stop 2024-09-11T00:13:54.639 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.637+0000 7f4cd1dec640 1 -- 172.21.15.92:0/3738516433 shutdown_connections 2024-09-11T00:13:54.639 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.637+0000 7f4cd1dec640 1 --2- 172.21.15.92:0/3738516433 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4ccc201010 0x7f4ccc0ad200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:54.639 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.637+0000 7f4cd1dec640 1 --2- 172.21.15.92:0/3738516433 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4ccc0af450 0x7f4ccc0cfe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:54.639 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.637+0000 7f4cd1dec640 1 --2- 172.21.15.92:0/3738516433 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4cb4003a00 0x7f4ccc0a9db0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:54.639 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.637+0000 7f4cd1dec640 1 -- 172.21.15.92:0/3738516433 >> 172.21.15.92:0/3738516433 conn(0x7f4ccc06e480 msgr2=0x7f4ccc15d720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:13:54.639 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.637+0000 7f4cd1dec640 1 -- 172.21.15.92:0/3738516433 shutdown_connections 2024-09-11T00:13:54.639 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.637+0000 7f4cd1dec640 1 -- 172.21.15.92:0/3738516433 wait complete. 2024-09-11T00:13:54.640 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.638+0000 7f11571e6640 1 -- 172.21.15.92:0/621895507 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command([{prefix=config set, name=rados_osd_op_timeout}] v 0) -- 0x7f1138005580 con 0x7f1148054860 2024-09-11T00:13:54.640 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.639+0000 7f9dd2ffd640 1 -- 172.21.15.92:0/3208761898 <== mon.1 v2:172.21.15.145:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_op_complaint_time}]=0 v16)=0 v16) ==== 121+0+0 (secure 0 0 0) 0x7f9de40b8070 con 0x7f9ddc006e40 2024-09-11T00:13:54.642 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.640+0000 7f9de8a57640 1 -- 172.21.15.92:0/3208761898 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9ddc006e40 msgr2=0x7f9ddc04e4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:54.642 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.640+0000 7f9de8a57640 1 --2- 172.21.15.92:0/3208761898 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9ddc006e40 0x7f9ddc04e4e0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f9de406a990 tx=0x7f9de40008d0 comp rx=0 tx=0).stop 2024-09-11T00:13:54.642 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.640+0000 7f9de8a57640 1 -- 172.21.15.92:0/3208761898 shutdown_connections 2024-09-11T00:13:54.642 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.640+0000 7f9de8a57640 1 --2- 172.21.15.92:0/3208761898 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9ddc0debe0 0x7f9ddc048030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:54.642 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.640+0000 7f9de8a57640 1 --2- 172.21.15.92:0/3208761898 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9ddc006e40 0x7f9ddc04e4e0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:54.642 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.640+0000 7f9de8a57640 1 --2- 172.21.15.92:0/3208761898 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9dcc004800 0x7f9ddc04bfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:54.642 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.640+0000 7f9de8a57640 1 -- 172.21.15.92:0/3208761898 >> 172.21.15.92:0/3208761898 conn(0x7f9ddc01d7a0 msgr2=0x7f9ddc0054f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:13:54.642 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.640+0000 7f9de8a57640 1 -- 172.21.15.92:0/3208761898 shutdown_connections 2024-09-11T00:13:54.642 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.640+0000 7f9de8a57640 1 -- 172.21.15.92:0/3208761898 wait complete. 2024-09-11T00:13:54.646 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.644+0000 7f77c2ffd640 1 -- 172.21.15.92:0/647031401 <== mon.2 v2:172.21.15.145:3301/0 7 ==== mon_command_ack([{prefix=config set, name=osd_op_complaint_time}]=0 v17)=0 v17) ==== 121+0+0 (secure 0 0 0) 0x7f77c40193b0 con 0x7f77d40cf400 2024-09-11T00:13:54.647 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.646+0000 7f77d8e95640 1 -- 172.21.15.92:0/647031401 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f77d40cf400 msgr2=0x7f77d417a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:54.648 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.646+0000 7f77d8e95640 1 --2- 172.21.15.92:0/647031401 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f77d40cf400 0x7f77d417a8c0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f77c400b410 tx=0x7f77c400b8d0 comp rx=0 tx=0).stop 2024-09-11T00:13:54.648 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.646+0000 7f77d8e95640 1 -- 172.21.15.92:0/647031401 shutdown_connections 2024-09-11T00:13:54.648 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.646+0000 7f77d8e95640 1 --2- 172.21.15.92:0/647031401 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f77d40b3d50 0x7f77d40b41d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:54.648 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.646+0000 7f77d8e95640 1 --2- 172.21.15.92:0/647031401 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f77d41605f0 0x7f77d415fdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:54.648 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.646+0000 7f77d8e95640 1 --2- 172.21.15.92:0/647031401 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f77d40cf400 0x7f77d417a8c0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:54.648 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.646+0000 7f77d8e95640 1 -- 172.21.15.92:0/647031401 >> 172.21.15.92:0/647031401 conn(0x7f77d40af660 msgr2=0x7f77d41614c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:13:54.648 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.646+0000 7f77d8e95640 1 -- 172.21.15.92:0/647031401 shutdown_connections 2024-09-11T00:13:54.648 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.646+0000 7f77d8e95640 1 -- 172.21.15.92:0/647031401 wait complete. 2024-09-11T00:13:54.648 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.647+0000 7f1146ffd640 1 -- 172.21.15.92:0/621895507 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_osd_op_timeout}]=0 v18)=0 v18) ==== 120+0+0 (secure 0 0 0) 0x7f114c01c9f0 con 0x7f1148054860 2024-09-11T00:13:54.651 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.649+0000 7f11571e6640 1 -- 172.21.15.92:0/621895507 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1148054860 msgr2=0x7f11480da240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:54.651 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.649+0000 7f11571e6640 1 --2- 172.21.15.92:0/621895507 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1148054860 0x7f11480da240 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f114c00c3c0 tx=0x7f114c00c880 comp rx=0 tx=0).stop 2024-09-11T00:13:54.651 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.649+0000 7f11571e6640 1 -- 172.21.15.92:0/621895507 shutdown_connections 2024-09-11T00:13:54.651 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.649+0000 7f11571e6640 1 --2- 172.21.15.92:0/621895507 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1148054860 0x7f11480da240 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:54.651 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.649+0000 7f11571e6640 1 --2- 172.21.15.92:0/621895507 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1148034ba0 0x7f1148179560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:54.651 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.649+0000 7f11571e6640 1 --2- 172.21.15.92:0/621895507 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1148034650 0x7f11480334a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:54.651 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.649+0000 7f11571e6640 1 -- 172.21.15.92:0/621895507 >> 172.21.15.92:0/621895507 conn(0x7f114801e890 msgr2=0x7f1148004f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:13:54.651 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.649+0000 7f11571e6640 1 -- 172.21.15.92:0/621895507 shutdown_connections 2024-09-11T00:13:54.651 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.649+0000 7f11571e6640 1 -- 172.21.15.92:0/621895507 wait complete. 2024-09-11T00:13:54.652 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'rados_osd_op_timeout', '900'], check_status=True, hostname='smithi092') 2024-09-11T00:13:54.657 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.655+0000 7f2ffc2d6640 1 -- 172.21.15.92:0/3197440555 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_pool_no_app}] v 0) -- 0x7f2fec00dc10 con 0x7f2fec100710 2024-09-11T00:13:54.661 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.660+0000 7f2feaffd640 1 -- 172.21.15.92:0/3197440555 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_pool_no_app}]=0 v19)=0 v19) ==== 125+0+0 (secure 0 0 0) 0x7f2fe40129b0 con 0x7f2fec100710 2024-09-11T00:13:54.663 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mon', 'mon_op_complaint_time', '120'], check_status=True, hostname='smithi092') 2024-09-11T00:13:54.663 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mon', 'mon_warn_on_pool_no_app', 'False'], check_status=True, hostname='smithi092') 2024-09-11T00:13:54.663 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.661+0000 7f2ffc2d6640 1 -- 172.21.15.92:0/3197440555 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2fec100710 msgr2=0x7f2fec101a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:54.664 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.661+0000 7f2ffc2d6640 1 --2- 172.21.15.92:0/3197440555 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2fec100710 0x7f2fec101a80 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f2fe400c410 tx=0x7f2fe400c8d0 comp rx=0 tx=0).stop 2024-09-11T00:13:54.664 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.661+0000 7f2ffc2d6640 1 -- 172.21.15.92:0/3197440555 shutdown_connections 2024-09-11T00:13:54.664 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.661+0000 7f2ffc2d6640 1 --2- 172.21.15.92:0/3197440555 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2fec104a10 0x7f2fec100e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:54.664 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.661+0000 7f2ffc2d6640 1 --2- 172.21.15.92:0/3197440555 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2fec100710 0x7f2fec101a80 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:54.664 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.661+0000 7f2ffc2d6640 1 --2- 172.21.15.92:0/3197440555 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2fec054c90 0x7f2fec0ff570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:54.664 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.661+0000 7f2ffc2d6640 1 -- 172.21.15.92:0/3197440555 >> 172.21.15.92:0/3197440555 conn(0x7f2fec01d790 msgr2=0x7f2fec0049f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:13:54.665 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.661+0000 7f2ffc2d6640 1 -- 172.21.15.92:0/3197440555 shutdown_connections 2024-09-11T00:13:54.665 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.661+0000 7f2ffc2d6640 1 -- 172.21.15.92:0/3197440555 wait complete. 2024-09-11T00:13:54.674 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'osd', 'osd_op_complaint_time', '180'], check_status=True, hostname='smithi092') 2024-09-11T00:13:54.674 INFO:tasks.ceph:Setting crush tunables to default 2024-09-11T00:13:54.674 DEBUG:teuthology.orchestra.run.smithi092:> sudo ceph --cluster ceph osd crush tunables default 2024-09-11T00:13:54.815 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.813+0000 7f670670e640 1 -- 172.21.15.92:0/3280033171 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f66ec003a50 msgr2=0x7f66ec003e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:54.815 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.813+0000 7f670670e640 1 --2- 172.21.15.92:0/3280033171 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f66ec003a50 0x7f66ec003e90 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f66f0001eb0 tx=0x7f66ec005830 comp rx=0 tx=0).stop 2024-09-11T00:13:54.815 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.813+0000 7f6704cab640 1 -- 172.21.15.92:0/3280033171 reap_dead start 2024-09-11T00:13:54.815 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.813+0000 7f670670e640 1 -- 172.21.15.92:0/3280033171 shutdown_connections 2024-09-11T00:13:54.815 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.813+0000 7f670670e640 1 -- 172.21.15.92:0/3280033171 >> 172.21.15.92:0/3280033171 conn(0x7f670009aa20 msgr2=0x7f670009ae30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:13:54.815 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.813+0000 7f670670e640 1 -- 172.21.15.92:0/3280033171 shutdown_connections 2024-09-11T00:13:54.815 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.813+0000 7f670670e640 1 -- 172.21.15.92:0/3280033171 wait complete. 2024-09-11T00:13:54.818 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.814+0000 7f670670e640 1 Processor -- start 2024-09-11T00:13:54.818 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.814+0000 7f670670e640 1 -- start start 2024-09-11T00:13:54.818 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.815+0000 7f670670e640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f66ec003a50 0x7f67000c6840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:54.818 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.815+0000 7f670670e640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f67000c8ec0 0x7f67000b0070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:54.818 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.815+0000 7f670670e640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f67001556e0 0x7f67000b05b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:54.818 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.815+0000 7f670670e640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f67000b1440 con 0x7f67000c8ec0 2024-09-11T00:13:54.819 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.815+0000 7f670670e640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f67000d29d0 con 0x7f67001556e0 2024-09-11T00:13:54.819 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.815+0000 7f670670e640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f67000c93c0 con 0x7f66ec003a50 2024-09-11T00:13:54.819 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.815+0000 7f66ff7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f67000c8ec0 0x7f67000b0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:54.819 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.815+0000 7f66ff7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f67000c8ec0 0x7f67000b0070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:60602/0 (socket says 172.21.15.92:60602) 2024-09-11T00:13:54.819 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.815+0000 7f66ff7fe640 1 -- 172.21.15.92:0/3542857723 learned_addr learned my addr 172.21.15.92:0/3542857723 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-11T00:13:54.819 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.815+0000 7f66fffff640 1 --2- 172.21.15.92:0/3542857723 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f66ec003a50 0x7f67000c6840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:54.819 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.815+0000 7f6704cab640 1 --2- 172.21.15.92:0/3542857723 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f67001556e0 0x7f67000b05b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:54.819 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.815+0000 7f66ff7fe640 1 -- 172.21.15.92:0/3542857723 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f66ec003a50 msgr2=0x7f67000c6840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:54.819 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.815+0000 7f66ff7fe640 1 --2- 172.21.15.92:0/3542857723 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f66ec003a50 0x7f67000c6840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:54.819 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.815+0000 7f66ff7fe640 1 -- 172.21.15.92:0/3542857723 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f67001556e0 msgr2=0x7f67000b05b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:54.819 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.815+0000 7f66ff7fe640 1 --2- 172.21.15.92:0/3542857723 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f67001556e0 0x7f67000b05b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:54.819 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.815+0000 7f66ff7fe640 1 -- 172.21.15.92:0/3542857723 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67000c96a0 con 0x7f67000c8ec0 2024-09-11T00:13:54.820 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.815+0000 7f66ff7fe640 1 --2- 172.21.15.92:0/3542857723 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f67000c8ec0 0x7f67000b0070 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f66e8011ae0 tx=0x7f66e8009eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:13:54.820 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.816+0000 7f66fcff9640 1 -- 172.21.15.92:0/3542857723 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66e801e070 con 0x7f67000c8ec0 2024-09-11T00:13:54.820 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.816+0000 7f66fcff9640 1 -- 172.21.15.92:0/3542857723 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f66e800fc70 con 0x7f67000c8ec0 2024-09-11T00:13:54.820 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.816+0000 7f66fcff9640 1 -- 172.21.15.92:0/3542857723 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66e8019410 con 0x7f67000c8ec0 2024-09-11T00:13:54.820 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.816+0000 7f670670e640 1 -- 172.21.15.92:0/3542857723 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f67000c9980 con 0x7f67000c8ec0 2024-09-11T00:13:54.820 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.816+0000 7f670670e640 1 -- 172.21.15.92:0/3542857723 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67000c9f40 con 0x7f67000c8ec0 2024-09-11T00:13:54.820 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.816+0000 7f66fcff9640 1 -- 172.21.15.92:0/3542857723 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7f66e80195b0 con 0x7f67000c8ec0 2024-09-11T00:13:54.820 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.816+0000 7f66fcff9640 1 -- 172.21.15.92:0/3542857723 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f66e80239d0 con 0x7f67000c8ec0 2024-09-11T00:13:54.820 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.817+0000 7f670670e640 1 -- 172.21.15.92:0/3542857723 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f670015ed50 con 0x7f67000c8ec0 2024-09-11T00:13:54.821 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.820+0000 7f66fcff9640 1 -- 172.21.15.92:0/3542857723 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+76091 (secure 0 0 0) 0x7f66e8023440 con 0x7f67000c8ec0 2024-09-11T00:13:54.884 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.882+0000 7f670670e640 1 -- 172.21.15.92:0/3542857723 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7f67000b0f00 con 0x7f67000c8ec0 2024-09-11T00:13:54.885 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.884+0000 7f66fcff9640 1 -- 172.21.15.92:0/3542857723 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (secure 0 0 0) 0x7f66e8019a10 con 0x7f67000c8ec0 2024-09-11T00:13:54.885 INFO:teuthology.orchestra.run.smithi092.stderr:adjusted tunables profile to default 2024-09-11T00:13:54.886 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.885+0000 7f670670e640 1 -- 172.21.15.92:0/3542857723 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f67000c8ec0 msgr2=0x7f67000b0070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:54.887 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.885+0000 7f670670e640 1 --2- 172.21.15.92:0/3542857723 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f67000c8ec0 0x7f67000b0070 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f66e8011ae0 tx=0x7f66e8009eb0 comp rx=0 tx=0).stop 2024-09-11T00:13:54.887 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.885+0000 7f670670e640 1 -- 172.21.15.92:0/3542857723 shutdown_connections 2024-09-11T00:13:54.887 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.885+0000 7f670670e640 1 --2- 172.21.15.92:0/3542857723 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f67001556e0 0x7f67000b05b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:54.887 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.885+0000 7f670670e640 1 --2- 172.21.15.92:0/3542857723 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f67000c8ec0 0x7f67000b0070 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:54.887 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.885+0000 7f670670e640 1 --2- 172.21.15.92:0/3542857723 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f66ec003a50 0x7f67000c6840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:54.887 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.885+0000 7f670670e640 1 -- 172.21.15.92:0/3542857723 >> 172.21.15.92:0/3542857723 conn(0x7f670009aa20 msgr2=0x7f670015c230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:13:54.887 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.885+0000 7f670670e640 1 -- 172.21.15.92:0/3542857723 shutdown_connections 2024-09-11T00:13:54.887 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:54.885+0000 7f670670e640 1 -- 172.21.15.92:0/3542857723 wait complete. 2024-09-11T00:13:54.897 INFO:tasks.ceph:check_enable_crimson: False 2024-09-11T00:13:54.897 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-09-11T00:13:54.897 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2024-09-11T00:13:54.897 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-09-11T00:13:54.922 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2024-09-11T00:13:54.922 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-09-11T00:13:54.988 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2024-09-11T00:13:54.988 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-09-11T00:13:55.053 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2024-09-11T00:13:55.053 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-09-11T00:13:55.118 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2024-09-11T00:13:55.118 DEBUG:teuthology.orchestra.run.smithi145:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-09-11T00:13:55.143 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2024-09-11T00:13:55.143 DEBUG:teuthology.orchestra.run.smithi145:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-09-11T00:13:55.207 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2024-09-11T00:13:55.208 DEBUG:teuthology.orchestra.run.smithi145:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-09-11T00:13:55.273 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2024-09-11T00:13:55.274 DEBUG:teuthology.orchestra.run.smithi145:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-09-11T00:13:55.337 DEBUG:teuthology.orchestra.run.smithi145:> sudo ceph --cluster ceph osd new 538af0ea-96c9-4999-9ccc-bee55f80ff76 0 2024-09-11T00:13:55.491 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:55.489+0000 7fa8a7bc6640 1 -- 172.21.15.145:0/1338898286 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa8a00cd670 msgr2=0x7fa8a00cfa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:55.492 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:55.489+0000 7fa8a7bc6640 1 --2- 172.21.15.145:0/1338898286 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa8a00cd670 0x7fa8a00cfa00 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fa8a00b0c20 tx=0x7fa89802a8b0 comp rx=0 tx=0).stop 2024-09-11T00:13:55.492 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:55.489+0000 7fa8a7bc6640 1 -- 172.21.15.145:0/1338898286 shutdown_connections 2024-09-11T00:13:55.492 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:55.489+0000 7fa8a7bc6640 1 --2- 172.21.15.145:0/1338898286 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa8a00cd670 0x7fa8a00cfa00 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:55.492 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:55.489+0000 7fa8a7bc6640 1 --2- 172.21.15.145:0/1338898286 >> v2:172.21.15.92:3300/0 conn(0x7fa8a00cde70 0x7fa8a00ae930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:55.492 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:55.489+0000 7fa8a7bc6640 1 -- 172.21.15.145:0/1338898286 >> 172.21.15.145:0/1338898286 conn(0x7fa8a00d1c20 msgr2=0x7fa8a00d2030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:13:55.492 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:55.489+0000 7fa8a7bc6640 1 -- 172.21.15.145:0/1338898286 shutdown_connections 2024-09-11T00:13:55.492 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:55.489+0000 7fa8a7bc6640 1 -- 172.21.15.145:0/1338898286 wait complete. 2024-09-11T00:13:55.495 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:55.490+0000 7fa8a7bc6640 1 Processor -- start 2024-09-11T00:13:55.495 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:55.490+0000 7fa8a7bc6640 1 -- start start 2024-09-11T00:13:55.495 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:55.491+0000 7fa8a7bc6640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa8a00cd670 0x7fa8a01f8990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:55.495 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:55.491+0000 7fa8a7bc6640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa8a00cde70 0x7fa8a0071840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:55.495 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:55.491+0000 7fa8a7bc6640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa8a015f190 0x7fa8a015c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:55.495 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:55.491+0000 7fa8a7bc6640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fa8a00cff40 con 0x7fa8a015f190 2024-09-11T00:13:55.495 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:55.491+0000 7fa8a7bc6640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fa8a00cdc90 con 0x7fa8a00cd670 2024-09-11T00:13:55.495 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:55.491+0000 7fa8a7bc6640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7fa8a00d00c0 con 0x7fa8a00cde70 2024-09-11T00:13:55.495 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:55.491+0000 7fa8a5962640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa8a00cd670 0x7fa8a01f8990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:55.495 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:55.491+0000 7fa8a5161640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa8a00cde70 0x7fa8a0071840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:55.496 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:55.491+0000 7fa8a5962640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa8a00cd670 0x7fa8a01f8990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.145:54094/0 (socket says 172.21.15.145:54094) 2024-09-11T00:13:55.496 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:55.491+0000 7fa8a5962640 1 -- 172.21.15.145:0/431500850 learned_addr learned my addr 172.21.15.145:0/431500850 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T00:13:55.496 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:55.491+0000 7fa8a6163640 1 --2- 172.21.15.145:0/431500850 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa8a015f190 0x7fa8a015c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:55.496 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:55.491+0000 7fa8a5161640 1 -- 172.21.15.145:0/431500850 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa8a00cd670 msgr2=0x7fa8a01f8990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:55.496 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:55.491+0000 7fa8a5161640 1 --2- 172.21.15.145:0/431500850 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa8a00cd670 0x7fa8a01f8990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:55.496 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:55.491+0000 7fa8a5161640 1 -- 172.21.15.145:0/431500850 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa8a015f190 msgr2=0x7fa8a015c0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:55.496 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:55.491+0000 7fa8a5161640 1 --2- 172.21.15.145:0/431500850 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa8a015f190 0x7fa8a015c0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:55.496 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:55.491+0000 7fa8a5161640 1 -- 172.21.15.145:0/431500850 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8a0071fe0 con 0x7fa8a00cde70 2024-09-11T00:13:55.496 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:55.491+0000 7fa8a5962640 1 --2- 172.21.15.145:0/431500850 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa8a00cd670 0x7fa8a01f8990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:13:55.496 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:55.491+0000 7fa8a5161640 1 --2- 172.21.15.145:0/431500850 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa8a00cde70 0x7fa8a0071840 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fa89000d6d0 tx=0x7fa89000db90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:13:55.496 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:55.491+0000 7fa8967fc640 1 -- 172.21.15.145:0/431500850 <== mon.2 v2:172.21.15.145:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa890017070 con 0x7fa8a00cde70 2024-09-11T00:13:55.496 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:55.491+0000 7fa8967fc640 1 -- 172.21.15.145:0/431500850 <== mon.2 v2:172.21.15.145:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa890005310 con 0x7fa8a00cde70 2024-09-11T00:13:55.496 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:55.492+0000 7fa8a7bc6640 1 -- 172.21.15.145:0/431500850 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8a01f4a60 con 0x7fa8a00cde70 2024-09-11T00:13:55.497 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:55.492+0000 7fa8967fc640 1 -- 172.21.15.145:0/431500850 <== mon.2 v2:172.21.15.145:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa890009820 con 0x7fa8a00cde70 2024-09-11T00:13:55.497 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:55.492+0000 7fa8a7bc6640 1 -- 172.21.15.145:0/431500850 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8a01f5020 con 0x7fa8a00cde70 2024-09-11T00:13:55.497 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:55.492+0000 7fa8967fc640 1 -- 172.21.15.145:0/431500850 <== mon.2 v2:172.21.15.145:3301/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7fa890009bd0 con 0x7fa8a00cde70 2024-09-11T00:13:55.497 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:55.492+0000 7fa8967fc640 1 -- 172.21.15.145:0/431500850 <== mon.2 v2:172.21.15.145:3301/0 5 ==== osd_map(2..2 src has 1..2) ==== 725+0+0 (secure 0 0 0) 0x7fa8900108a0 con 0x7fa8a00cde70 2024-09-11T00:13:55.497 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:55.492+0000 7fa8a7bc6640 1 -- 172.21.15.145:0/431500850 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa8a00cfa00 con 0x7fa8a00cde70 2024-09-11T00:13:55.497 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:55.494+0000 7fa8967fc640 1 -- 172.21.15.145:0/431500850 <== mon.2 v2:172.21.15.145:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+76091 (secure 0 0 0) 0x7fa890010af0 con 0x7fa8a00cde70 2024-09-11T00:13:55.567 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:55.565+0000 7fa8a7bc6640 1 -- 172.21.15.145:0/431500850 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_command({"prefix": "osd new", "uuid": "538af0ea-96c9-4999-9ccc-bee55f80ff76", "id": 0} v 0) -- 0x7fa8a0072fd0 con 0x7fa8a00cde70 2024-09-11T00:13:55.570 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:55.568+0000 7fa8967fc640 1 -- 172.21.15.145:0/431500850 <== mon.2 v2:172.21.15.145:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "538af0ea-96c9-4999-9ccc-bee55f80ff76", "id": 0}]=0 v3) ==== 112+0+2 (secure 0 0 0) 0x7fa890010da0 con 0x7fa8a00cde70 2024-09-11T00:13:55.570 INFO:teuthology.orchestra.run.smithi145.stdout:0 2024-09-11T00:13:55.571 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:55.569+0000 7fa8a7bc6640 1 -- 172.21.15.145:0/431500850 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa8a00cde70 msgr2=0x7fa8a0071840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:55.572 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:55.569+0000 7fa8a7bc6640 1 --2- 172.21.15.145:0/431500850 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa8a00cde70 0x7fa8a0071840 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fa89000d6d0 tx=0x7fa89000db90 comp rx=0 tx=0).stop 2024-09-11T00:13:55.572 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:55.569+0000 7fa8a7bc6640 1 -- 172.21.15.145:0/431500850 shutdown_connections 2024-09-11T00:13:55.572 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:55.569+0000 7fa8a7bc6640 1 --2- 172.21.15.145:0/431500850 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa8a015f190 0x7fa8a015c0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:55.572 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:55.569+0000 7fa8a7bc6640 1 --2- 172.21.15.145:0/431500850 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa8a00cde70 0x7fa8a0071840 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:55.572 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:55.569+0000 7fa8a7bc6640 1 --2- 172.21.15.145:0/431500850 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa8a00cd670 0x7fa8a01f8990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:55.572 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:55.569+0000 7fa8a7bc6640 1 -- 172.21.15.145:0/431500850 >> 172.21.15.145:0/431500850 conn(0x7fa8a00d1c20 msgr2=0x7fa8a00b0050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:13:55.572 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:55.569+0000 7fa8a7bc6640 1 -- 172.21.15.145:0/431500850 shutdown_connections 2024-09-11T00:13:55.572 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:55.569+0000 7fa8a7bc6640 1 -- 172.21.15.145:0/431500850 wait complete. 2024-09-11T00:13:55.581 DEBUG:teuthology.orchestra.run.smithi145:> sudo ceph --cluster ceph osd new f9214f2c-ffe6-4447-9a13-9549a36e0537 1 2024-09-11T00:13:55.684 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:55.681+0000 7f233432b640 1 -- 172.21.15.145:0/2909602689 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f232c071e40 msgr2=0x7f232c0738e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:55.684 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:55.681+0000 7f233432b640 1 --2- 172.21.15.145:0/2909602689 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f232c071e40 0x7f232c0738e0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f2328009860 tx=0x7f232802a510 comp rx=0 tx=0).stop 2024-09-11T00:13:55.684 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:55.681+0000 7f233432b640 1 -- 172.21.15.145:0/2909602689 shutdown_connections 2024-09-11T00:13:55.684 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:55.681+0000 7f233432b640 1 --2- 172.21.15.145:0/2909602689 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f232c071e40 0x7f232c0738e0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:55.684 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:55.681+0000 7f233432b640 1 -- 172.21.15.145:0/2909602689 >> 172.21.15.145:0/2909602689 conn(0x7f232c0b2ad0 msgr2=0x7f232c0b2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:13:55.684 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:55.681+0000 7f233432b640 1 -- 172.21.15.145:0/2909602689 shutdown_connections 2024-09-11T00:13:55.684 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:55.681+0000 7f233432b640 1 -- 172.21.15.145:0/2909602689 wait complete. 2024-09-11T00:13:55.687 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:55.682+0000 7f233432b640 1 Processor -- start 2024-09-11T00:13:55.687 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:55.682+0000 7f233432b640 1 -- start start 2024-09-11T00:13:55.687 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:55.683+0000 7f233432b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f232c06d1c0 0x7f232c0af6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:55.687 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:55.683+0000 7f233432b640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f232c070140 0x7f232c0cf5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:55.687 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:55.683+0000 7f233432b640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f232c071e40 0x7f232c151610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:55.687 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:55.683+0000 7f233432b640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f232c15c880 con 0x7f232c06d1c0 2024-09-11T00:13:55.687 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:55.683+0000 7f233432b640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f232c15c700 con 0x7f232c070140 2024-09-11T00:13:55.688 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:55.683+0000 7f233432b640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f232c15ca00 con 0x7f232c071e40 2024-09-11T00:13:55.688 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:55.683+0000 7f23318c6640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f232c070140 0x7f232c0cf5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:55.688 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:55.683+0000 7f23328c8640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f232c071e40 0x7f232c151610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:55.688 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:55.683+0000 7f23318c6640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f232c070140 0x7f232c0cf5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.145:54096/0 (socket says 172.21.15.145:54096) 2024-09-11T00:13:55.688 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:55.683+0000 7f23318c6640 1 -- 172.21.15.145:0/4278094099 learned_addr learned my addr 172.21.15.145:0/4278094099 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T00:13:55.688 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:55.683+0000 7f23320c7640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f232c06d1c0 0x7f232c0af6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:55.688 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:55.683+0000 7f23318c6640 1 -- 172.21.15.145:0/4278094099 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f232c071e40 msgr2=0x7f232c151610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:55.688 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:55.683+0000 7f23318c6640 1 --2- 172.21.15.145:0/4278094099 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f232c071e40 0x7f232c151610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:55.688 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:55.683+0000 7f23318c6640 1 -- 172.21.15.145:0/4278094099 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f232c06d1c0 msgr2=0x7f232c0af6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:55.688 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:55.683+0000 7f23318c6640 1 --2- 172.21.15.145:0/4278094099 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f232c06d1c0 0x7f232c0af6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:55.688 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:55.683+0000 7f23318c6640 1 -- 172.21.15.145:0/4278094099 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f232c0afc30 con 0x7f232c070140 2024-09-11T00:13:55.688 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:55.683+0000 7f23328c8640 1 --2- 172.21.15.145:0/4278094099 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f232c071e40 0x7f232c151610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:13:55.689 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:55.683+0000 7f23318c6640 1 --2- 172.21.15.145:0/4278094099 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f232c070140 0x7f232c0cf5b0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f231c00c410 tx=0x7f231c00c8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:13:55.689 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:55.684+0000 7f2322ffd640 1 -- 172.21.15.145:0/4278094099 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f231c017070 con 0x7f232c070140 2024-09-11T00:13:55.689 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:55.684+0000 7f2322ffd640 1 -- 172.21.15.145:0/4278094099 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f231c0035f0 con 0x7f232c070140 2024-09-11T00:13:55.689 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:55.684+0000 7f233432b640 1 -- 172.21.15.145:0/4278094099 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f232c1f50f0 con 0x7f232c070140 2024-09-11T00:13:55.689 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:55.684+0000 7f2322ffd640 1 -- 172.21.15.145:0/4278094099 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f231c003a80 con 0x7f232c070140 2024-09-11T00:13:55.689 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:55.684+0000 7f233432b640 1 -- 172.21.15.145:0/4278094099 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f232c0cedb0 con 0x7f232c070140 2024-09-11T00:13:55.689 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:55.684+0000 7f2322ffd640 1 -- 172.21.15.145:0/4278094099 <== mon.1 v2:172.21.15.145:3300/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7f231c003c20 con 0x7f232c070140 2024-09-11T00:13:55.689 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:55.684+0000 7f2322ffd640 1 -- 172.21.15.145:0/4278094099 <== mon.1 v2:172.21.15.145:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 840+0+0 (secure 0 0 0) 0x7f231c0128e0 con 0x7f232c070140 2024-09-11T00:13:55.690 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:55.685+0000 7f233432b640 1 -- 172.21.15.145:0/4278094099 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f232c0738e0 con 0x7f232c070140 2024-09-11T00:13:55.690 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:55.687+0000 7f2322ffd640 1 -- 172.21.15.145:0/4278094099 <== mon.1 v2:172.21.15.145:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+76091 (secure 0 0 0) 0x7f231c021030 con 0x7f232c070140 2024-09-11T00:13:55.800 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:55.798+0000 7f233432b640 1 -- 172.21.15.145:0/4278094099 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_command({"prefix": "osd new", "uuid": "f9214f2c-ffe6-4447-9a13-9549a36e0537", "id": 1} v 0) -- 0x7f232c0b0a70 con 0x7f232c070140 2024-09-11T00:13:55.804 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:55.802+0000 7f2322ffd640 1 -- 172.21.15.145:0/4278094099 <== mon.1 v2:172.21.15.145:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "f9214f2c-ffe6-4447-9a13-9549a36e0537", "id": 1}]=0 v4) ==== 112+0+2 (secure 0 0 0) 0x7f232c0afc30 con 0x7f232c070140 2024-09-11T00:13:55.805 INFO:teuthology.orchestra.run.smithi145.stdout:1 2024-09-11T00:13:55.806 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:55.803+0000 7f233432b640 1 -- 172.21.15.145:0/4278094099 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f232c070140 msgr2=0x7f232c0cf5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:55.806 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:55.803+0000 7f233432b640 1 --2- 172.21.15.145:0/4278094099 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f232c070140 0x7f232c0cf5b0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f231c00c410 tx=0x7f231c00c8d0 comp rx=0 tx=0).stop 2024-09-11T00:13:55.806 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:55.803+0000 7f233432b640 1 -- 172.21.15.145:0/4278094099 shutdown_connections 2024-09-11T00:13:55.806 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:55.803+0000 7f233432b640 1 --2- 172.21.15.145:0/4278094099 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f232c071e40 0x7f232c151610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:55.806 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:55.803+0000 7f233432b640 1 --2- 172.21.15.145:0/4278094099 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f232c070140 0x7f232c0cf5b0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:55.806 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:55.803+0000 7f233432b640 1 --2- 172.21.15.145:0/4278094099 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f232c06d1c0 0x7f232c0af6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:55.806 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:55.803+0000 7f233432b640 1 -- 172.21.15.145:0/4278094099 >> 172.21.15.145:0/4278094099 conn(0x7f232c0b2ad0 msgr2=0x7f232c15f570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:13:55.806 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:55.803+0000 7f233432b640 1 -- 172.21.15.145:0/4278094099 shutdown_connections 2024-09-11T00:13:55.806 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:55.803+0000 7f233432b640 1 -- 172.21.15.145:0/4278094099 wait complete. 2024-09-11T00:13:55.816 DEBUG:teuthology.orchestra.run.smithi145:> sudo ceph --cluster ceph osd new b44dd849-fb85-42b1-8a1a-b6681bb1f467 2 2024-09-11T00:13:55.919 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:55.916+0000 7fcb21da3640 1 -- 172.21.15.145:0/3190333941 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fcb1c0b6a50 msgr2=0x7fcb1c070320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:55.919 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:55.916+0000 7fcb21da3640 1 --2- 172.21.15.145:0/3190333941 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fcb1c0b6a50 0x7fcb1c070320 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fcb10005fd0 tx=0x7fcb1002a5d0 comp rx=0 tx=0).stop 2024-09-11T00:13:55.919 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:55.916+0000 7fcb21da3640 1 -- 172.21.15.145:0/3190333941 shutdown_connections 2024-09-11T00:13:55.919 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:55.916+0000 7fcb21da3640 1 --2- 172.21.15.145:0/3190333941 >> v2:172.21.15.92:3300/0 conn(0x7fcb1c073ff0 0x7fcb1c0cf010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:55.919 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:55.916+0000 7fcb21da3640 1 --2- 172.21.15.145:0/3190333941 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fcb1c0b6a50 0x7fcb1c070320 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:55.919 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:55.916+0000 7fcb21da3640 1 -- 172.21.15.145:0/3190333941 >> 172.21.15.145:0/3190333941 conn(0x7fcb1c0b2ad0 msgr2=0x7fcb1c0b2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:13:55.919 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:55.916+0000 7fcb21da3640 1 -- 172.21.15.145:0/3190333941 shutdown_connections 2024-09-11T00:13:55.919 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:55.916+0000 7fcb21da3640 1 -- 172.21.15.145:0/3190333941 wait complete. 2024-09-11T00:13:55.922 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:55.917+0000 7fcb21da3640 1 Processor -- start 2024-09-11T00:13:55.922 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:55.917+0000 7fcb21da3640 1 -- start start 2024-09-11T00:13:55.922 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:55.918+0000 7fcb21da3640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcb1c073ff0 0x7fcb1c1f2c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:55.922 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:55.918+0000 7fcb21da3640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fcb1c0b6a50 0x7fcb1c150750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:55.922 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:55.918+0000 7fcb21da3640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fcb1c15b080 0x7fcb1c1f56b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:55.922 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:55.918+0000 7fcb21da3640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fcb1c0cf9c0 con 0x7fcb1c073ff0 2024-09-11T00:13:55.922 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:55.918+0000 7fcb21da3640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fcb1c0cf840 con 0x7fcb1c15b080 2024-09-11T00:13:55.922 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:55.918+0000 7fcb21da3640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7fcb1c0cfb40 con 0x7fcb1c0b6a50 2024-09-11T00:13:55.922 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:55.918+0000 7fcb1bfff640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fcb1c15b080 0x7fcb1c1f56b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:55.922 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:55.918+0000 7fcb1affd640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fcb1c0b6a50 0x7fcb1c150750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:55.922 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:55.918+0000 7fcb1bfff640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fcb1c15b080 0x7fcb1c1f56b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.145:54110/0 (socket says 172.21.15.145:54110) 2024-09-11T00:13:55.922 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:55.918+0000 7fcb1bfff640 1 -- 172.21.15.145:0/2431465086 learned_addr learned my addr 172.21.15.145:0/2431465086 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T00:13:55.923 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:55.918+0000 7fcb1b7fe640 1 --2- 172.21.15.145:0/2431465086 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcb1c073ff0 0x7fcb1c1f2c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:55.923 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:55.918+0000 7fcb1bfff640 1 -- 172.21.15.145:0/2431465086 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fcb1c0b6a50 msgr2=0x7fcb1c150750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:55.923 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:55.918+0000 7fcb1bfff640 1 --2- 172.21.15.145:0/2431465086 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fcb1c0b6a50 0x7fcb1c150750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:55.923 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:55.918+0000 7fcb1bfff640 1 -- 172.21.15.145:0/2431465086 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcb1c073ff0 msgr2=0x7fcb1c1f2c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:55.923 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:55.918+0000 7fcb1bfff640 1 --2- 172.21.15.145:0/2431465086 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcb1c073ff0 0x7fcb1c1f2c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:55.923 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:55.918+0000 7fcb1bfff640 1 -- 172.21.15.145:0/2431465086 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb1c1f6220 con 0x7fcb1c15b080 2024-09-11T00:13:55.923 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:55.919+0000 7fcb1bfff640 1 --2- 172.21.15.145:0/2431465086 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fcb1c15b080 0x7fcb1c1f56b0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fcb1400eb40 tx=0x7fcb1400c2d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:13:55.923 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:55.919+0000 7fcb03fff640 1 -- 172.21.15.145:0/2431465086 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb14004b20 con 0x7fcb1c15b080 2024-09-11T00:13:55.923 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:55.919+0000 7fcb03fff640 1 -- 172.21.15.145:0/2431465086 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcb14004db0 con 0x7fcb1c15b080 2024-09-11T00:13:55.923 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:55.919+0000 7fcb03fff640 1 -- 172.21.15.145:0/2431465086 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb14005280 con 0x7fcb1c15b080 2024-09-11T00:13:55.923 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:55.919+0000 7fcb21da3640 1 -- 172.21.15.145:0/2431465086 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb1c1f6500 con 0x7fcb1c15b080 2024-09-11T00:13:55.923 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:55.919+0000 7fcb21da3640 1 -- 172.21.15.145:0/2431465086 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb1c0c68b0 con 0x7fcb1c15b080 2024-09-11T00:13:55.924 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:55.919+0000 7fcb03fff640 1 -- 172.21.15.145:0/2431465086 <== mon.1 v2:172.21.15.145:3300/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7fcb140057b0 con 0x7fcb1c15b080 2024-09-11T00:13:55.924 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:55.919+0000 7fcb03fff640 1 -- 172.21.15.145:0/2431465086 <== mon.1 v2:172.21.15.145:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 955+0+0 (secure 0 0 0) 0x7fcb14018890 con 0x7fcb1c15b080 2024-09-11T00:13:55.924 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:55.920+0000 7fcb21da3640 1 -- 172.21.15.145:0/2431465086 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcb1c1f2520 con 0x7fcb1c15b080 2024-09-11T00:13:55.925 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:55.923+0000 7fcb03fff640 1 -- 172.21.15.145:0/2431465086 <== mon.1 v2:172.21.15.145:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+76091 (secure 0 0 0) 0x7fcb14018bb0 con 0x7fcb1c15b080 2024-09-11T00:13:55.997 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:55.995+0000 7fcb21da3640 1 -- 172.21.15.145:0/2431465086 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_command({"prefix": "osd new", "uuid": "b44dd849-fb85-42b1-8a1a-b6681bb1f467", "id": 2} v 0) -- 0x7fcb1c0d0060 con 0x7fcb1c15b080 2024-09-11T00:13:56.001 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:55.999+0000 7fcb03fff640 1 -- 172.21.15.145:0/2431465086 <== mon.1 v2:172.21.15.145:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "b44dd849-fb85-42b1-8a1a-b6681bb1f467", "id": 2}]=0 v5) ==== 112+0+2 (secure 0 0 0) 0x7fcb14018470 con 0x7fcb1c15b080 2024-09-11T00:13:56.002 INFO:teuthology.orchestra.run.smithi145.stdout:2 2024-09-11T00:13:56.003 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:56.000+0000 7fcb21da3640 1 -- 172.21.15.145:0/2431465086 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fcb1c15b080 msgr2=0x7fcb1c1f56b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:56.003 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:56.000+0000 7fcb21da3640 1 --2- 172.21.15.145:0/2431465086 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fcb1c15b080 0x7fcb1c1f56b0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fcb1400eb40 tx=0x7fcb1400c2d0 comp rx=0 tx=0).stop 2024-09-11T00:13:56.003 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:56.000+0000 7fcb21da3640 1 -- 172.21.15.145:0/2431465086 shutdown_connections 2024-09-11T00:13:56.003 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:56.000+0000 7fcb21da3640 1 --2- 172.21.15.145:0/2431465086 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fcb1c15b080 0x7fcb1c1f56b0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:56.003 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:56.000+0000 7fcb21da3640 1 --2- 172.21.15.145:0/2431465086 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fcb1c0b6a50 0x7fcb1c150750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:56.003 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:56.000+0000 7fcb21da3640 1 --2- 172.21.15.145:0/2431465086 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcb1c073ff0 0x7fcb1c1f2c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:56.003 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:56.000+0000 7fcb21da3640 1 -- 172.21.15.145:0/2431465086 >> 172.21.15.145:0/2431465086 conn(0x7fcb1c0b2ad0 msgr2=0x7fcb1c0b2eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:13:56.003 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:56.000+0000 7fcb21da3640 1 -- 172.21.15.145:0/2431465086 shutdown_connections 2024-09-11T00:13:56.003 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:56.000+0000 7fcb21da3640 1 -- 172.21.15.145:0/2431465086 wait complete. 2024-09-11T00:13:56.013 DEBUG:teuthology.orchestra.run.smithi145:> sudo ceph --cluster ceph osd new 05a49d87-23b9-48dd-962c-d5c2686e7a32 3 2024-09-11T00:13:56.115 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:56.112+0000 7fbfb3f05640 1 -- 172.21.15.145:0/2197849235 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbfac0d0460 msgr2=0x7fbfac0af670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:56.115 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:56.112+0000 7fbfb3f05640 1 --2- 172.21.15.145:0/2197849235 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbfac0d0460 0x7fbfac0af670 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fbfac072920 tx=0x7fbfa802a530 comp rx=0 tx=0).stop 2024-09-11T00:13:56.115 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:56.112+0000 7fbfb3f05640 1 -- 172.21.15.145:0/2197849235 shutdown_connections 2024-09-11T00:13:56.115 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:56.112+0000 7fbfb3f05640 1 --2- 172.21.15.145:0/2197849235 >> v2:172.21.15.92:3300/0 conn(0x7fbfac06ca50 0x7fbfac0b09e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:56.115 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:56.112+0000 7fbfb3f05640 1 --2- 172.21.15.145:0/2197849235 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fbfac0b5010 0x7fbfac0d0840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:56.115 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:56.112+0000 7fbfb3f05640 1 --2- 172.21.15.145:0/2197849235 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbfac0d0460 0x7fbfac0af670 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:56.115 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:56.112+0000 7fbfb3f05640 1 -- 172.21.15.145:0/2197849235 >> 172.21.15.145:0/2197849235 conn(0x7fbfac0b3d30 msgr2=0x7fbfac074190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:13:56.116 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:56.112+0000 7fbfb3f05640 1 -- 172.21.15.145:0/2197849235 shutdown_connections 2024-09-11T00:13:56.116 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:56.112+0000 7fbfb3f05640 1 -- 172.21.15.145:0/2197849235 wait complete. 2024-09-11T00:13:56.118 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:56.113+0000 7fbfb3f05640 1 Processor -- start 2024-09-11T00:13:56.118 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:56.113+0000 7fbfb3f05640 1 -- start start 2024-09-11T00:13:56.118 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:56.114+0000 7fbfb3f05640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbfac06ca50 0x7fbfac0cf7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:56.118 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:56.114+0000 7fbfb3f05640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbfac0b5010 0x7fbfac15b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:56.118 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:56.114+0000 7fbfb3f05640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fbfac0d0460 0x7fbfac155fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:56.118 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:56.114+0000 7fbfb3f05640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fbfac0b10a0 con 0x7fbfac06ca50 2024-09-11T00:13:56.118 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:56.114+0000 7fbfb3f05640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fbfac0b0f20 con 0x7fbfac0b5010 2024-09-11T00:13:56.119 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:56.114+0000 7fbfb3f05640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7fbfac0b1220 con 0x7fbfac0d0460 2024-09-11T00:13:56.119 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:56.114+0000 7fbfb14a0640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbfac0b5010 0x7fbfac15b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:56.119 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:56.114+0000 7fbfb24a2640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fbfac0d0460 0x7fbfac155fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:56.119 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:56.114+0000 7fbfb14a0640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbfac0b5010 0x7fbfac15b3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.145:54134/0 (socket says 172.21.15.145:54134) 2024-09-11T00:13:56.119 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:56.114+0000 7fbfb14a0640 1 -- 172.21.15.145:0/3848782642 learned_addr learned my addr 172.21.15.145:0/3848782642 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T00:13:56.119 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:56.114+0000 7fbfb1ca1640 1 --2- 172.21.15.145:0/3848782642 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbfac06ca50 0x7fbfac0cf7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:56.119 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:56.114+0000 7fbfb14a0640 1 -- 172.21.15.145:0/3848782642 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fbfac0d0460 msgr2=0x7fbfac155fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:56.119 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:56.114+0000 7fbfb14a0640 1 --2- 172.21.15.145:0/3848782642 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fbfac0d0460 0x7fbfac155fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:56.119 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:56.114+0000 7fbfb14a0640 1 -- 172.21.15.145:0/3848782642 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbfac06ca50 msgr2=0x7fbfac0cf7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:56.119 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:56.114+0000 7fbfb14a0640 1 --2- 172.21.15.145:0/3848782642 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbfac06ca50 0x7fbfac0cf7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:56.119 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:56.114+0000 7fbfb14a0640 1 -- 172.21.15.145:0/3848782642 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbfac15cad0 con 0x7fbfac0b5010 2024-09-11T00:13:56.119 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:56.115+0000 7fbfb24a2640 1 --2- 172.21.15.145:0/3848782642 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fbfac0d0460 0x7fbfac155fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:13:56.119 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:56.115+0000 7fbfb14a0640 1 --2- 172.21.15.145:0/3848782642 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbfac0b5010 0x7fbfac15b3c0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fbfa000e980 tx=0x7fbfa000ed80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:13:56.119 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:56.115+0000 7fbf9e7fc640 1 -- 172.21.15.145:0/3848782642 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfa000ccc0 con 0x7fbfac0b5010 2024-09-11T00:13:56.120 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:56.115+0000 7fbf9e7fc640 1 -- 172.21.15.145:0/3848782642 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbfa0010430 con 0x7fbfac0b5010 2024-09-11T00:13:56.120 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:56.115+0000 7fbfb3f05640 1 -- 172.21.15.145:0/3848782642 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbfac15cdb0 con 0x7fbfac0b5010 2024-09-11T00:13:56.120 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:56.115+0000 7fbf9e7fc640 1 -- 172.21.15.145:0/3848782642 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfa0010880 con 0x7fbfac0b5010 2024-09-11T00:13:56.120 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:56.115+0000 7fbfb3f05640 1 -- 172.21.15.145:0/3848782642 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbfac15d370 con 0x7fbfac0b5010 2024-09-11T00:13:56.120 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:56.115+0000 7fbf9e7fc640 1 -- 172.21.15.145:0/3848782642 <== mon.1 v2:172.21.15.145:3300/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7fbfa0010a20 con 0x7fbfac0b5010 2024-09-11T00:13:56.120 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:56.115+0000 7fbf9e7fc640 1 -- 172.21.15.145:0/3848782642 <== mon.1 v2:172.21.15.145:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1070+0+0 (secure 0 0 0) 0x7fbfa0004d40 con 0x7fbfac0b5010 2024-09-11T00:13:56.120 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:56.116+0000 7fbfb3f05640 1 -- 172.21.15.145:0/3848782642 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbfac15d7b0 con 0x7fbfac0b5010 2024-09-11T00:13:56.121 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:56.119+0000 7fbf9e7fc640 1 -- 172.21.15.145:0/3848782642 <== mon.1 v2:172.21.15.145:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+76091 (secure 0 0 0) 0x7fbfa0026070 con 0x7fbfac0b5010 2024-09-11T00:13:56.193 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:56.191+0000 7fbfb3f05640 1 -- 172.21.15.145:0/3848782642 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_command({"prefix": "osd new", "uuid": "05a49d87-23b9-48dd-962c-d5c2686e7a32", "id": 3} v 0) -- 0x7fbfac0b09e0 con 0x7fbfac0b5010 2024-09-11T00:13:56.198 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:56.195+0000 7fbf9e7fc640 1 -- 172.21.15.145:0/3848782642 <== mon.1 v2:172.21.15.145:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "05a49d87-23b9-48dd-962c-d5c2686e7a32", "id": 3}]=0 v6) ==== 112+0+2 (secure 0 0 0) 0x7fbfa00048b0 con 0x7fbfac0b5010 2024-09-11T00:13:56.198 INFO:teuthology.orchestra.run.smithi145.stdout:3 2024-09-11T00:13:56.199 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:56.196+0000 7fbfb3f05640 1 -- 172.21.15.145:0/3848782642 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbfac0b5010 msgr2=0x7fbfac15b3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:56.199 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:56.196+0000 7fbfb3f05640 1 --2- 172.21.15.145:0/3848782642 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbfac0b5010 0x7fbfac15b3c0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fbfa000e980 tx=0x7fbfa000ed80 comp rx=0 tx=0).stop 2024-09-11T00:13:56.199 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:56.196+0000 7fbfb3f05640 1 -- 172.21.15.145:0/3848782642 shutdown_connections 2024-09-11T00:13:56.199 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:56.196+0000 7fbfb3f05640 1 --2- 172.21.15.145:0/3848782642 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fbfac0d0460 0x7fbfac155fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:56.199 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:56.196+0000 7fbfb3f05640 1 --2- 172.21.15.145:0/3848782642 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbfac0b5010 0x7fbfac15b3c0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:56.199 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:56.196+0000 7fbfb3f05640 1 --2- 172.21.15.145:0/3848782642 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbfac06ca50 0x7fbfac0cf7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:56.200 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:56.196+0000 7fbfb3f05640 1 -- 172.21.15.145:0/3848782642 >> 172.21.15.145:0/3848782642 conn(0x7fbfac0b3d30 msgr2=0x7fbfac0c62d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:13:56.200 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:56.196+0000 7fbfb3f05640 1 -- 172.21.15.145:0/3848782642 shutdown_connections 2024-09-11T00:13:56.200 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:56.196+0000 7fbfb3f05640 1 -- 172.21.15.145:0/3848782642 wait complete. 2024-09-11T00:13:56.209 DEBUG:teuthology.orchestra.run.smithi145:> sudo ceph --cluster ceph osd new cf52b087-afe0-4f43-a4e7-db2ebc158815 4 2024-09-11T00:13:56.319 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:56.309+0000 7fb815403640 1 -- 172.21.15.145:0/189678829 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb81015b6d0 msgr2=0x7fb81006ffb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:56.319 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:56.309+0000 7fb815403640 1 --2- 172.21.15.145:0/189678829 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb81015b6d0 0x7fb81006ffb0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fb8100733b0 tx=0x7fb80802aac0 comp rx=0 tx=0).stop 2024-09-11T00:13:56.319 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:56.309+0000 7fb815403640 1 -- 172.21.15.145:0/189678829 shutdown_connections 2024-09-11T00:13:56.319 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:56.309+0000 7fb815403640 1 --2- 172.21.15.145:0/189678829 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb81015b6d0 0x7fb81006ffb0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:56.319 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:56.309+0000 7fb815403640 1 --2- 172.21.15.145:0/189678829 >> v2:172.21.15.92:3300/0 conn(0x7fb810155090 0x7fb81006fa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:56.319 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:56.309+0000 7fb815403640 1 -- 172.21.15.145:0/189678829 >> 172.21.15.145:0/189678829 conn(0x7fb8100d0970 msgr2=0x7fb8100d0d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:13:56.319 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:56.309+0000 7fb815403640 1 -- 172.21.15.145:0/189678829 shutdown_connections 2024-09-11T00:13:56.319 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:56.309+0000 7fb815403640 1 -- 172.21.15.145:0/189678829 wait complete. 2024-09-11T00:13:56.319 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:56.310+0000 7fb815403640 1 Processor -- start 2024-09-11T00:13:56.319 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:56.310+0000 7fb815403640 1 -- start start 2024-09-11T00:13:56.320 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:56.311+0000 7fb815403640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb8100ce870 0x7fb8101492f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:56.320 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:56.311+0000 7fb815403640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb810155090 0x7fb8100c9ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:56.320 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:56.311+0000 7fb815403640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb81015b6d0 0x7fb8100ca1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:56.320 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:56.311+0000 7fb815403640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fb8100cc590 con 0x7fb8100ce870 2024-09-11T00:13:56.320 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:56.311+0000 7fb815403640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fb8100cc410 con 0x7fb810155090 2024-09-11T00:13:56.320 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:56.311+0000 7fb815403640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7fb8100cc710 con 0x7fb81015b6d0 2024-09-11T00:13:56.320 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:56.311+0000 7fb807fff640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb810155090 0x7fb8100c9ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:56.320 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:56.311+0000 7fb807fff640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb810155090 0x7fb8100c9ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.145:54154/0 (socket says 172.21.15.145:54154) 2024-09-11T00:13:56.320 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:56.311+0000 7fb807fff640 1 -- 172.21.15.145:0/565140231 learned_addr learned my addr 172.21.15.145:0/565140231 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T00:13:56.320 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:56.311+0000 7fb80f7fe640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb81015b6d0 0x7fb8100ca1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:56.320 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:56.311+0000 7fb80effd640 1 --2- 172.21.15.145:0/565140231 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb8100ce870 0x7fb8101492f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:56.320 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:56.311+0000 7fb807fff640 1 -- 172.21.15.145:0/565140231 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb81015b6d0 msgr2=0x7fb8100ca1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:56.320 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:56.311+0000 7fb807fff640 1 --2- 172.21.15.145:0/565140231 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb81015b6d0 0x7fb8100ca1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:56.321 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:56.311+0000 7fb807fff640 1 -- 172.21.15.145:0/565140231 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb8100ce870 msgr2=0x7fb8101492f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:56.321 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:56.311+0000 7fb807fff640 1 --2- 172.21.15.145:0/565140231 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb8100ce870 0x7fb8101492f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:56.321 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:56.311+0000 7fb807fff640 1 -- 172.21.15.145:0/565140231 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8101f9210 con 0x7fb810155090 2024-09-11T00:13:56.321 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:56.311+0000 7fb807fff640 1 --2- 172.21.15.145:0/565140231 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb810155090 0x7fb8100c9ca0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fb7f800c420 tx=0x7fb7f800c8e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:13:56.321 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:56.312+0000 7fb8077fe640 1 -- 172.21.15.145:0/565140231 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7f8017070 con 0x7fb810155090 2024-09-11T00:13:56.321 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:56.312+0000 7fb8077fe640 1 -- 172.21.15.145:0/565140231 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb7f80053c0 con 0x7fb810155090 2024-09-11T00:13:56.321 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:56.312+0000 7fb815403640 1 -- 172.21.15.145:0/565140231 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8101f8450 con 0x7fb810155090 2024-09-11T00:13:56.322 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:56.312+0000 7fb8077fe640 1 -- 172.21.15.145:0/565140231 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7f8003850 con 0x7fb810155090 2024-09-11T00:13:56.322 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:56.312+0000 7fb815403640 1 -- 172.21.15.145:0/565140231 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8101f8a10 con 0x7fb810155090 2024-09-11T00:13:56.322 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:56.312+0000 7fb8077fe640 1 -- 172.21.15.145:0/565140231 <== mon.1 v2:172.21.15.145:3300/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7fb7f80039f0 con 0x7fb810155090 2024-09-11T00:13:56.322 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:56.312+0000 7fb8077fe640 1 -- 172.21.15.145:0/565140231 <== mon.1 v2:172.21.15.145:3300/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7fb7f8012930 con 0x7fb810155090 2024-09-11T00:13:56.322 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:56.313+0000 7fb815403640 1 -- 172.21.15.145:0/565140231 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb8100ccc60 con 0x7fb810155090 2024-09-11T00:13:56.322 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:56.315+0000 7fb8077fe640 1 -- 172.21.15.145:0/565140231 <== mon.1 v2:172.21.15.145:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+76091 (secure 0 0 0) 0x7fb7f8021070 con 0x7fb810155090 2024-09-11T00:13:56.389 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:56.386+0000 7fb815403640 1 -- 172.21.15.145:0/565140231 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_command({"prefix": "osd new", "uuid": "cf52b087-afe0-4f43-a4e7-db2ebc158815", "id": 4} v 0) -- 0x7fb8100701e0 con 0x7fb810155090 2024-09-11T00:13:56.392 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:56.389+0000 7fb8077fe640 1 -- 172.21.15.145:0/565140231 <== mon.1 v2:172.21.15.145:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "cf52b087-afe0-4f43-a4e7-db2ebc158815", "id": 4}]=0 v7) ==== 112+0+2 (secure 0 0 0) 0x7fb7f8012bc0 con 0x7fb810155090 2024-09-11T00:13:56.392 INFO:teuthology.orchestra.run.smithi145.stdout:4 2024-09-11T00:13:56.394 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:56.391+0000 7fb815403640 1 -- 172.21.15.145:0/565140231 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb810155090 msgr2=0x7fb8100c9ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:56.394 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:56.391+0000 7fb815403640 1 --2- 172.21.15.145:0/565140231 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb810155090 0x7fb8100c9ca0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fb7f800c420 tx=0x7fb7f800c8e0 comp rx=0 tx=0).stop 2024-09-11T00:13:56.394 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:56.391+0000 7fb815403640 1 -- 172.21.15.145:0/565140231 shutdown_connections 2024-09-11T00:13:56.394 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:56.391+0000 7fb815403640 1 --2- 172.21.15.145:0/565140231 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb81015b6d0 0x7fb8100ca1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:56.394 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:56.391+0000 7fb815403640 1 --2- 172.21.15.145:0/565140231 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb810155090 0x7fb8100c9ca0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:56.394 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:56.391+0000 7fb815403640 1 --2- 172.21.15.145:0/565140231 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb8100ce870 0x7fb8101492f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:56.394 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:56.391+0000 7fb815403640 1 -- 172.21.15.145:0/565140231 >> 172.21.15.145:0/565140231 conn(0x7fb8100d0970 msgr2=0x7fb8100cee30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:13:56.394 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:56.391+0000 7fb815403640 1 -- 172.21.15.145:0/565140231 shutdown_connections 2024-09-11T00:13:56.394 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:56.391+0000 7fb815403640 1 -- 172.21.15.145:0/565140231 wait complete. 2024-09-11T00:13:56.408 DEBUG:teuthology.orchestra.run.smithi145:> sudo ceph --cluster ceph osd new 0e54adcd-2d1d-49fb-bf97-3dd7e9addd30 5 2024-09-11T00:13:56.511 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:56.508+0000 7f748cde2640 1 -- 172.21.15.145:0/4032445315 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f74880d0460 msgr2=0x7f74880af670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:56.511 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:56.508+0000 7f748cde2640 1 --2- 172.21.15.145:0/4032445315 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f74880d0460 0x7f74880af670 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f7478009830 tx=0x7f747802a5a0 comp rx=0 tx=0).stop 2024-09-11T00:13:56.511 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:56.508+0000 7f748cde2640 1 -- 172.21.15.145:0/4032445315 shutdown_connections 2024-09-11T00:13:56.511 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:56.508+0000 7f748cde2640 1 --2- 172.21.15.145:0/4032445315 >> v2:172.21.15.92:3300/0 conn(0x7f74880b5010 0x7f74880d0840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:56.512 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:56.508+0000 7f748cde2640 1 --2- 172.21.15.145:0/4032445315 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f74880d0460 0x7f74880af670 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:56.512 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:56.508+0000 7f748cde2640 1 -- 172.21.15.145:0/4032445315 >> 172.21.15.145:0/4032445315 conn(0x7f74880b3d30 msgr2=0x7f7488074190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:13:56.512 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:56.508+0000 7f748cde2640 1 -- 172.21.15.145:0/4032445315 shutdown_connections 2024-09-11T00:13:56.512 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:56.508+0000 7f748cde2640 1 -- 172.21.15.145:0/4032445315 wait complete. 2024-09-11T00:13:56.512 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:56.510+0000 7f748cde2640 1 Processor -- start 2024-09-11T00:13:56.512 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:56.510+0000 7f748cde2640 1 -- start start 2024-09-11T00:13:56.515 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:56.511+0000 7f748cde2640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f748806ca50 0x7f748815b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:56.515 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:56.511+0000 7f748cde2640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f74880b5010 0x7f74881f2b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:56.515 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:56.511+0000 7f748cde2640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f74880d0460 0x7f74880ae720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:56.515 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:56.511+0000 7f748cde2640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f748806d0f0 con 0x7f74880b5010 2024-09-11T00:13:56.515 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:56.511+0000 7f748cde2640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f74880b1300 con 0x7f74880d0460 2024-09-11T00:13:56.515 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:56.511+0000 7f748cde2640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f748815fea0 con 0x7f748806ca50 2024-09-11T00:13:56.515 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:56.511+0000 7f748659c640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f748806ca50 0x7f748815b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:56.515 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:56.511+0000 7f748659c640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f748806ca50 0x7f748815b5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3301/0 says I am v2:172.21.15.145:40656/0 (socket says 172.21.15.145:40656) 2024-09-11T00:13:56.515 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:56.511+0000 7f748659c640 1 -- 172.21.15.145:0/4058513858 learned_addr learned my addr 172.21.15.145:0/4058513858 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T00:13:56.515 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:56.511+0000 7f7486d9d640 1 --2- 172.21.15.145:0/4058513858 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f74880d0460 0x7f74880ae720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:56.515 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:56.511+0000 7f747dd9b640 1 --2- 172.21.15.145:0/4058513858 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f74880b5010 0x7f74881f2b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:56.515 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:56.511+0000 7f748659c640 1 -- 172.21.15.145:0/4058513858 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f74880d0460 msgr2=0x7f74880ae720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:56.516 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:56.511+0000 7f748659c640 1 --2- 172.21.15.145:0/4058513858 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f74880d0460 0x7f74880ae720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:56.516 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:56.511+0000 7f748659c640 1 -- 172.21.15.145:0/4058513858 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f74880b5010 msgr2=0x7f74881f2b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:56.516 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:56.511+0000 7f748659c640 1 --2- 172.21.15.145:0/4058513858 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f74880b5010 0x7f74881f2b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:56.516 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:56.511+0000 7f748659c640 1 -- 172.21.15.145:0/4058513858 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74881f63e0 con 0x7f748806ca50 2024-09-11T00:13:56.516 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:56.511+0000 7f747dd9b640 1 --2- 172.21.15.145:0/4058513858 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f74880b5010 0x7f74881f2b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:13:56.516 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:56.511+0000 7f748659c640 1 --2- 172.21.15.145:0/4058513858 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f748806ca50 0x7f748815b5b0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f7478000c00 tx=0x7f7478033c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:13:56.516 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:56.511+0000 7f747f7fe640 1 -- 172.21.15.145:0/4058513858 <== mon.2 v2:172.21.15.145:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7478031d60 con 0x7f748806ca50 2024-09-11T00:13:56.516 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:56.512+0000 7f747f7fe640 1 -- 172.21.15.145:0/4058513858 <== mon.2 v2:172.21.15.145:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7478033e10 con 0x7f748806ca50 2024-09-11T00:13:56.516 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:56.512+0000 7f748cde2640 1 -- 172.21.15.145:0/4058513858 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f74881f66c0 con 0x7f748806ca50 2024-09-11T00:13:56.516 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:56.512+0000 7f747f7fe640 1 -- 172.21.15.145:0/4058513858 <== mon.2 v2:172.21.15.145:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7478033310 con 0x7f748806ca50 2024-09-11T00:13:56.516 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:56.512+0000 7f748cde2640 1 -- 172.21.15.145:0/4058513858 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f74881f2630 con 0x7f748806ca50 2024-09-11T00:13:56.516 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:56.512+0000 7f747f7fe640 1 -- 172.21.15.145:0/4058513858 <== mon.2 v2:172.21.15.145:3301/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7f747804b030 con 0x7f748806ca50 2024-09-11T00:13:56.516 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:56.512+0000 7f747f7fe640 1 -- 172.21.15.145:0/4058513858 <== mon.2 v2:172.21.15.145:3301/0 5 ==== osd_map(7..7 src has 1..7) ==== 1300+0+0 (secure 0 0 0) 0x7f74780035f0 con 0x7f748806ca50 2024-09-11T00:13:56.517 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:56.513+0000 7f748cde2640 1 -- 172.21.15.145:0/4058513858 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f74880d0840 con 0x7f748806ca50 2024-09-11T00:13:56.518 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:56.516+0000 7f747f7fe640 1 -- 172.21.15.145:0/4058513858 <== mon.2 v2:172.21.15.145:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+76091 (secure 0 0 0) 0x7f747803f030 con 0x7f748806ca50 2024-09-11T00:13:56.588 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:56.586+0000 7f748cde2640 1 -- 172.21.15.145:0/4058513858 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_command({"prefix": "osd new", "uuid": "0e54adcd-2d1d-49fb-bf97-3dd7e9addd30", "id": 5} v 0) -- 0x7f748815c6a0 con 0x7f748806ca50 2024-09-11T00:13:56.592 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:56.590+0000 7f747f7fe640 1 -- 172.21.15.145:0/4058513858 <== mon.2 v2:172.21.15.145:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "0e54adcd-2d1d-49fb-bf97-3dd7e9addd30", "id": 5}]=0 v8) ==== 112+0+2 (secure 0 0 0) 0x7f74780334b0 con 0x7f748806ca50 2024-09-11T00:13:56.592 INFO:teuthology.orchestra.run.smithi145.stdout:5 2024-09-11T00:13:56.593 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:56.591+0000 7f748cde2640 1 -- 172.21.15.145:0/4058513858 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f748806ca50 msgr2=0x7f748815b5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:56.593 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:56.591+0000 7f748cde2640 1 --2- 172.21.15.145:0/4058513858 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f748806ca50 0x7f748815b5b0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f7478000c00 tx=0x7f7478033c20 comp rx=0 tx=0).stop 2024-09-11T00:13:56.593 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:56.591+0000 7f748cde2640 1 -- 172.21.15.145:0/4058513858 shutdown_connections 2024-09-11T00:13:56.594 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:56.591+0000 7f748cde2640 1 --2- 172.21.15.145:0/4058513858 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f74880d0460 0x7f74880ae720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:56.594 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:56.591+0000 7f748cde2640 1 --2- 172.21.15.145:0/4058513858 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f74880b5010 0x7f74881f2b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:56.594 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:56.591+0000 7f748cde2640 1 --2- 172.21.15.145:0/4058513858 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f748806ca50 0x7f748815b5b0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:56.594 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:56.591+0000 7f748cde2640 1 -- 172.21.15.145:0/4058513858 >> 172.21.15.145:0/4058513858 conn(0x7f74880b3d30 msgr2=0x7f748806fc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:13:56.594 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:56.591+0000 7f748cde2640 1 -- 172.21.15.145:0/4058513858 shutdown_connections 2024-09-11T00:13:56.594 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:56.591+0000 7f748cde2640 1 -- 172.21.15.145:0/4058513858 wait complete. 2024-09-11T00:13:56.604 DEBUG:teuthology.orchestra.run.smithi145:> sudo ceph --cluster ceph osd new 4d5ae7a8-b3df-4c7a-9124-290f239f5b57 6 2024-09-11T00:13:56.706 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:56.703+0000 7f8af619b640 1 -- 172.21.15.145:0/1690718976 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8af015e060 msgr2=0x7f8af00b6dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:56.706 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:56.703+0000 7f8af619b640 1 --2- 172.21.15.145:0/1690718976 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8af015e060 0x7f8af00b6dc0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f8ae0005fd0 tx=0x7f8ae002a540 comp rx=0 tx=0).stop 2024-09-11T00:13:56.706 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:56.703+0000 7f8af619b640 1 -- 172.21.15.145:0/1690718976 shutdown_connections 2024-09-11T00:13:56.706 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:56.703+0000 7f8af619b640 1 --2- 172.21.15.145:0/1690718976 >> v2:172.21.15.145:3300/0 conn(0x7f8af00d4af0 0x7f8af00cea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:56.706 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:56.703+0000 7f8af619b640 1 --2- 172.21.15.145:0/1690718976 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8af015e060 0x7f8af00b6dc0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:56.706 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:56.703+0000 7f8af619b640 1 -- 172.21.15.145:0/1690718976 >> 172.21.15.145:0/1690718976 conn(0x7f8af00d3f70 msgr2=0x7f8af00d4350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:13:56.707 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:56.703+0000 7f8af619b640 1 -- 172.21.15.145:0/1690718976 shutdown_connections 2024-09-11T00:13:56.707 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:56.703+0000 7f8af619b640 1 -- 172.21.15.145:0/1690718976 wait complete. 2024-09-11T00:13:56.709 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:56.704+0000 7f8af619b640 1 Processor -- start 2024-09-11T00:13:56.709 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:56.704+0000 7f8af619b640 1 -- start start 2024-09-11T00:13:56.709 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:56.705+0000 7f8af619b640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8af00d4af0 0x7f8af01f5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:56.709 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:56.705+0000 7f8af619b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8af015e060 0x7f8af00ccf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:56.709 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:56.705+0000 7f8af619b640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8af00cd490 0x7f8af00cb040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:56.709 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:56.705+0000 7f8af619b640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f8af00cef80 con 0x7f8af015e060 2024-09-11T00:13:56.709 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:56.705+0000 7f8af619b640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f8af00d2eb0 con 0x7f8af00cd490 2024-09-11T00:13:56.709 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:56.705+0000 7f8af619b640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f8af00cf100 con 0x7f8af00d4af0 2024-09-11T00:13:56.710 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:56.705+0000 7f8aef7fe640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8af00d4af0 0x7f8af01f5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:56.710 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:56.705+0000 7f8aef7fe640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8af00d4af0 0x7f8af01f5050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3301/0 says I am v2:172.21.15.145:40674/0 (socket says 172.21.15.145:40674) 2024-09-11T00:13:56.710 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:56.705+0000 7f8aef7fe640 1 -- 172.21.15.145:0/2818571002 learned_addr learned my addr 172.21.15.145:0/2818571002 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T00:13:56.710 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:56.705+0000 7f8aeffff640 1 --2- 172.21.15.145:0/2818571002 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8af00cd490 0x7f8af00cb040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:56.710 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:56.705+0000 7f8ae7fff640 1 --2- 172.21.15.145:0/2818571002 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8af015e060 0x7f8af00ccf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:56.710 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:56.706+0000 7f8aef7fe640 1 -- 172.21.15.145:0/2818571002 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8af00cd490 msgr2=0x7f8af00cb040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:56.710 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:56.706+0000 7f8aef7fe640 1 --2- 172.21.15.145:0/2818571002 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8af00cd490 0x7f8af00cb040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:56.710 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:56.706+0000 7f8aef7fe640 1 -- 172.21.15.145:0/2818571002 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8af015e060 msgr2=0x7f8af00ccf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:56.710 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:56.706+0000 7f8aef7fe640 1 --2- 172.21.15.145:0/2818571002 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8af015e060 0x7f8af00ccf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:56.710 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:56.706+0000 7f8aef7fe640 1 -- 172.21.15.145:0/2818571002 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8af00cdab0 con 0x7f8af00d4af0 2024-09-11T00:13:56.710 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:56.706+0000 7f8aef7fe640 1 --2- 172.21.15.145:0/2818571002 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8af00d4af0 0x7f8af01f5050 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f8ae0034040 tx=0x7f8ae00038a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:13:56.710 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:56.706+0000 7f8aecff9640 1 -- 172.21.15.145:0/2818571002 <== mon.2 v2:172.21.15.145:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ae003e030 con 0x7f8af00d4af0 2024-09-11T00:13:56.710 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:56.706+0000 7f8aecff9640 1 -- 172.21.15.145:0/2818571002 <== mon.2 v2:172.21.15.145:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8ae0003ca0 con 0x7f8af00d4af0 2024-09-11T00:13:56.710 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:56.706+0000 7f8aecff9640 1 -- 172.21.15.145:0/2818571002 <== mon.2 v2:172.21.15.145:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ae0035040 con 0x7f8af00d4af0 2024-09-11T00:13:56.711 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:56.706+0000 7f8af619b640 1 -- 172.21.15.145:0/2818571002 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8af00cdd90 con 0x7f8af00d4af0 2024-09-11T00:13:56.711 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:56.706+0000 7f8af619b640 1 -- 172.21.15.145:0/2818571002 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f8af01f47e0 con 0x7f8af00d4af0 2024-09-11T00:13:56.711 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:56.706+0000 7f8aecff9640 1 -- 172.21.15.145:0/2818571002 <== mon.2 v2:172.21.15.145:3301/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7f8ae0004d90 con 0x7f8af00d4af0 2024-09-11T00:13:56.711 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:56.706+0000 7f8aecff9640 1 -- 172.21.15.145:0/2818571002 <== mon.2 v2:172.21.15.145:3301/0 5 ==== osd_map(8..8 src has 1..8) ==== 1415+0+0 (secure 0 0 0) 0x7f8ae0031400 con 0x7f8af00d4af0 2024-09-11T00:13:56.711 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:56.707+0000 7f8af619b640 1 -- 172.21.15.145:0/2818571002 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8af00cea40 con 0x7f8af00d4af0 2024-09-11T00:13:56.712 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:56.710+0000 7f8aecff9640 1 -- 172.21.15.145:0/2818571002 <== mon.2 v2:172.21.15.145:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+76091 (secure 0 0 0) 0x7f8ae0043410 con 0x7f8af00d4af0 2024-09-11T00:13:56.784 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:56.782+0000 7f8af619b640 1 -- 172.21.15.145:0/2818571002 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_command({"prefix": "osd new", "uuid": "4d5ae7a8-b3df-4c7a-9124-290f239f5b57", "id": 6} v 0) -- 0x7f8af015f620 con 0x7f8af00d4af0 2024-09-11T00:13:56.788 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:56.786+0000 7f8aecff9640 1 -- 172.21.15.145:0/2818571002 <== mon.2 v2:172.21.15.145:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "4d5ae7a8-b3df-4c7a-9124-290f239f5b57", "id": 6}]=0 v9) ==== 112+0+2 (secure 0 0 0) 0x7f8ae00051f0 con 0x7f8af00d4af0 2024-09-11T00:13:56.788 INFO:teuthology.orchestra.run.smithi145.stdout:6 2024-09-11T00:13:56.789 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:56.786+0000 7f8af619b640 1 -- 172.21.15.145:0/2818571002 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8af00d4af0 msgr2=0x7f8af01f5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:56.789 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:56.786+0000 7f8af619b640 1 --2- 172.21.15.145:0/2818571002 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8af00d4af0 0x7f8af01f5050 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f8ae0034040 tx=0x7f8ae00038a0 comp rx=0 tx=0).stop 2024-09-11T00:13:56.789 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:56.787+0000 7f8af619b640 1 -- 172.21.15.145:0/2818571002 shutdown_connections 2024-09-11T00:13:56.789 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:56.787+0000 7f8af619b640 1 --2- 172.21.15.145:0/2818571002 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8af00cd490 0x7f8af00cb040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:56.789 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:56.787+0000 7f8af619b640 1 --2- 172.21.15.145:0/2818571002 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8af015e060 0x7f8af00ccf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:56.789 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:56.787+0000 7f8af619b640 1 --2- 172.21.15.145:0/2818571002 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8af00d4af0 0x7f8af01f5050 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:56.790 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:56.787+0000 7f8af619b640 1 -- 172.21.15.145:0/2818571002 >> 172.21.15.145:0/2818571002 conn(0x7f8af00d3f70 msgr2=0x7f8af00b7780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:13:56.790 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:56.787+0000 7f8af619b640 1 -- 172.21.15.145:0/2818571002 shutdown_connections 2024-09-11T00:13:56.790 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:56.787+0000 7f8af619b640 1 -- 172.21.15.145:0/2818571002 wait complete. 2024-09-11T00:13:56.799 DEBUG:teuthology.orchestra.run.smithi145:> sudo ceph --cluster ceph osd new d7e36444-6e3f-4372-81d3-88e7b4e993f7 7 2024-09-11T00:13:56.901 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:56.898+0000 7fc7525f3640 1 -- 172.21.15.145:0/2624196912 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc74c0b5ee0 msgr2=0x7fc74c0cccc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:56.902 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:56.898+0000 7fc7525f3640 1 --2- 172.21.15.145:0/2624196912 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc74c0b5ee0 0x7fc74c0cccc0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fc74c0b2e90 tx=0x7fc74402a780 comp rx=0 tx=0).stop 2024-09-11T00:13:56.902 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:56.898+0000 7fc7525f3640 1 -- 172.21.15.145:0/2624196912 shutdown_connections 2024-09-11T00:13:56.902 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:56.898+0000 7fc7525f3640 1 --2- 172.21.15.145:0/2624196912 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc74c0b5ee0 0x7fc74c0cccc0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:56.902 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:56.898+0000 7fc7525f3640 1 --2- 172.21.15.145:0/2624196912 >> v2:172.21.15.92:3300/0 conn(0x7fc74c069480 0x7fc74c0b59a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:56.902 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:56.898+0000 7fc7525f3640 1 --2- 172.21.15.145:0/2624196912 >> v2:172.21.15.145:3300/0 conn(0x7fc74c15f1d0 0x7fc74c06ca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:56.902 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:56.898+0000 7fc7525f3640 1 -- 172.21.15.145:0/2624196912 >> 172.21.15.145:0/2624196912 conn(0x7fc74c074170 msgr2=0x7fc74c074580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:13:56.902 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:56.898+0000 7fc7525f3640 1 -- 172.21.15.145:0/2624196912 shutdown_connections 2024-09-11T00:13:56.902 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:56.898+0000 7fc7525f3640 1 -- 172.21.15.145:0/2624196912 wait complete. 2024-09-11T00:13:56.905 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:56.900+0000 7fc7525f3640 1 Processor -- start 2024-09-11T00:13:56.905 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:56.900+0000 7fc7525f3640 1 -- start start 2024-09-11T00:13:56.905 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:56.900+0000 7fc7525f3640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc74c069480 0x7fc74c1f3f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:56.905 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:56.900+0000 7fc7525f3640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc74c0b5ee0 0x7fc74c0cbe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:56.905 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:56.900+0000 7fc7525f3640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc74c15f1d0 0x7fc74c0c6050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:56.905 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:56.900+0000 7fc7525f3640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fc74c0cd380 con 0x7fc74c069480 2024-09-11T00:13:56.905 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:56.900+0000 7fc7525f3640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fc74c0cd200 con 0x7fc74c15f1d0 2024-09-11T00:13:56.906 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:56.900+0000 7fc7525f3640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7fc74c0cd500 con 0x7fc74c0b5ee0 2024-09-11T00:13:56.906 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:56.901+0000 7fc74b7fe640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc74c0b5ee0 0x7fc74c0cbe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:56.906 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:56.901+0000 7fc750b90640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc74c15f1d0 0x7fc74c0c6050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:56.906 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:56.901+0000 7fc74b7fe640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc74c0b5ee0 0x7fc74c0cbe10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3301/0 says I am v2:172.21.15.145:40684/0 (socket says 172.21.15.145:40684) 2024-09-11T00:13:56.906 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:56.901+0000 7fc74b7fe640 1 -- 172.21.15.145:0/1945048962 learned_addr learned my addr 172.21.15.145:0/1945048962 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T00:13:56.906 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:56.901+0000 7fc74bfff640 1 --2- 172.21.15.145:0/1945048962 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc74c069480 0x7fc74c1f3f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:56.906 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:56.901+0000 7fc74b7fe640 1 -- 172.21.15.145:0/1945048962 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc74c15f1d0 msgr2=0x7fc74c0c6050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:56.906 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:56.901+0000 7fc74b7fe640 1 --2- 172.21.15.145:0/1945048962 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc74c15f1d0 0x7fc74c0c6050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:56.906 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:56.901+0000 7fc74b7fe640 1 -- 172.21.15.145:0/1945048962 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc74c069480 msgr2=0x7fc74c1f3f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:56.906 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:56.901+0000 7fc74b7fe640 1 --2- 172.21.15.145:0/1945048962 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc74c069480 0x7fc74c1f3f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:56.906 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:56.901+0000 7fc74b7fe640 1 -- 172.21.15.145:0/1945048962 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc74c0cae10 con 0x7fc74c0b5ee0 2024-09-11T00:13:56.906 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:56.901+0000 7fc750b90640 1 --2- 172.21.15.145:0/1945048962 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc74c15f1d0 0x7fc74c0c6050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:13:56.906 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:56.901+0000 7fc74b7fe640 1 --2- 172.21.15.145:0/1945048962 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc74c0b5ee0 0x7fc74c0cbe10 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fc74000ea20 tx=0x7fc74000eee0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:13:56.907 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:56.901+0000 7fc748ff9640 1 -- 172.21.15.145:0/1945048962 <== mon.2 v2:172.21.15.145:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc74000cd80 con 0x7fc74c0b5ee0 2024-09-11T00:13:56.907 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:56.901+0000 7fc748ff9640 1 -- 172.21.15.145:0/1945048962 <== mon.2 v2:172.21.15.145:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc740010430 con 0x7fc74c0b5ee0 2024-09-11T00:13:56.907 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:56.901+0000 7fc7525f3640 1 -- 172.21.15.145:0/1945048962 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc74c0cb0f0 con 0x7fc74c0b5ee0 2024-09-11T00:13:56.907 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:56.901+0000 7fc748ff9640 1 -- 172.21.15.145:0/1945048962 <== mon.2 v2:172.21.15.145:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc740010840 con 0x7fc74c0b5ee0 2024-09-11T00:13:56.907 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:56.901+0000 7fc7525f3640 1 -- 172.21.15.145:0/1945048962 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fc74c0cb6b0 con 0x7fc74c0b5ee0 2024-09-11T00:13:56.907 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:56.902+0000 7fc748ff9640 1 -- 172.21.15.145:0/1945048962 <== mon.2 v2:172.21.15.145:3301/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7fc7400109e0 con 0x7fc74c0b5ee0 2024-09-11T00:13:56.907 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:56.902+0000 7fc748ff9640 1 -- 172.21.15.145:0/1945048962 <== mon.2 v2:172.21.15.145:3301/0 5 ==== osd_map(9..9 src has 1..9) ==== 1530+0+0 (secure 0 0 0) 0x7fc740018d80 con 0x7fc74c0b5ee0 2024-09-11T00:13:56.907 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:56.902+0000 7fc7525f3640 1 -- 172.21.15.145:0/1945048962 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc74c0cda20 con 0x7fc74c0b5ee0 2024-09-11T00:13:56.910 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:56.908+0000 7fc748ff9640 1 -- 172.21.15.145:0/1945048962 <== mon.2 v2:172.21.15.145:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+76091 (secure 0 0 0) 0x7fc7400213f0 con 0x7fc74c0b5ee0 2024-09-11T00:13:56.983 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:56.979+0000 7fc7525f3640 1 -- 172.21.15.145:0/1945048962 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_command({"prefix": "osd new", "uuid": "d7e36444-6e3f-4372-81d3-88e7b4e993f7", "id": 7} v 0) -- 0x7fc74c09a2a0 con 0x7fc74c0b5ee0 2024-09-11T00:13:56.985 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:56.983+0000 7fc748ff9640 1 -- 172.21.15.145:0/1945048962 <== mon.2 v2:172.21.15.145:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "d7e36444-6e3f-4372-81d3-88e7b4e993f7", "id": 7}]=0 v10) ==== 112+0+2 (secure 0 0 0) 0x7fc7400215d0 con 0x7fc74c0b5ee0 2024-09-11T00:13:56.986 INFO:teuthology.orchestra.run.smithi145.stdout:7 2024-09-11T00:13:56.987 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:56.984+0000 7fc7525f3640 1 -- 172.21.15.145:0/1945048962 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc74c0b5ee0 msgr2=0x7fc74c0cbe10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:56.987 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:56.984+0000 7fc7525f3640 1 --2- 172.21.15.145:0/1945048962 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc74c0b5ee0 0x7fc74c0cbe10 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fc74000ea20 tx=0x7fc74000eee0 comp rx=0 tx=0).stop 2024-09-11T00:13:56.987 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:56.984+0000 7fc7525f3640 1 -- 172.21.15.145:0/1945048962 shutdown_connections 2024-09-11T00:13:56.987 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:56.984+0000 7fc7525f3640 1 --2- 172.21.15.145:0/1945048962 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc74c15f1d0 0x7fc74c0c6050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:56.987 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:56.984+0000 7fc7525f3640 1 --2- 172.21.15.145:0/1945048962 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc74c0b5ee0 0x7fc74c0cbe10 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:56.987 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:56.984+0000 7fc7525f3640 1 --2- 172.21.15.145:0/1945048962 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc74c069480 0x7fc74c1f3f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:56.987 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:56.984+0000 7fc7525f3640 1 -- 172.21.15.145:0/1945048962 >> 172.21.15.145:0/1945048962 conn(0x7fc74c074170 msgr2=0x7fc74c15e400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:13:56.987 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:56.985+0000 7fc7525f3640 1 -- 172.21.15.145:0/1945048962 shutdown_connections 2024-09-11T00:13:56.988 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:13:56.985+0000 7fc7525f3640 1 -- 172.21.15.145:0/1945048962 wait complete. 2024-09-11T00:13:56.997 INFO:tasks.ceph.osd.0:Restarting daemon 2024-09-11T00:13:56.998 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-09-11T00:13:57.000 INFO:tasks.ceph.osd.0:Started 2024-09-11T00:13:57.000 INFO:tasks.ceph.osd.1:Restarting daemon 2024-09-11T00:13:57.000 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-09-11T00:13:57.002 INFO:tasks.ceph.osd.1:Started 2024-09-11T00:13:57.002 INFO:tasks.ceph.osd.2:Restarting daemon 2024-09-11T00:13:57.003 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-09-11T00:13:57.005 INFO:tasks.ceph.osd.2:Started 2024-09-11T00:13:57.005 INFO:tasks.ceph.osd.3:Restarting daemon 2024-09-11T00:13:57.005 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-09-11T00:13:57.007 INFO:tasks.ceph.osd.3:Started 2024-09-11T00:13:57.007 INFO:tasks.ceph.osd.4:Restarting daemon 2024-09-11T00:13:57.007 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-09-11T00:13:57.009 INFO:tasks.ceph.osd.4:Started 2024-09-11T00:13:57.009 INFO:tasks.ceph.osd.5:Restarting daemon 2024-09-11T00:13:57.010 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-09-11T00:13:57.011 INFO:tasks.ceph.osd.5:Started 2024-09-11T00:13:57.012 INFO:tasks.ceph.osd.6:Restarting daemon 2024-09-11T00:13:57.012 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-09-11T00:13:57.014 INFO:tasks.ceph.osd.6:Started 2024-09-11T00:13:57.014 INFO:tasks.ceph.osd.7:Restarting daemon 2024-09-11T00:13:57.014 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-09-11T00:13:57.016 INFO:tasks.ceph.osd.7:Started 2024-09-11T00:13:57.016 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T00:13:57.147 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:57.143+0000 7fd72f764640 1 -- 172.21.15.92:0/3575038669 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd72815e060 msgr2=0x7fd7280b6dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:57.147 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:57.143+0000 7fd72f764640 1 --2- 172.21.15.92:0/3575038669 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd72815e060 0x7fd7280b6dc0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fd71c009830 tx=0x7fd71c02a510 comp rx=0 tx=0).stop 2024-09-11T00:13:57.147 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:57.143+0000 7fd72f764640 1 -- 172.21.15.92:0/3575038669 shutdown_connections 2024-09-11T00:13:57.147 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:57.143+0000 7fd72f764640 1 --2- 172.21.15.92:0/3575038669 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd7280d4af0 0x7fd7280cea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:57.147 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:57.143+0000 7fd72f764640 1 --2- 172.21.15.92:0/3575038669 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd72815e060 0x7fd7280b6dc0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:57.148 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:57.143+0000 7fd72f764640 1 -- 172.21.15.92:0/3575038669 >> 172.21.15.92:0/3575038669 conn(0x7fd7280d3f70 msgr2=0x7fd7280d4350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:13:57.148 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:57.143+0000 7fd72f764640 1 -- 172.21.15.92:0/3575038669 shutdown_connections 2024-09-11T00:13:57.148 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:57.144+0000 7fd72f764640 1 -- 172.21.15.92:0/3575038669 wait complete. 2024-09-11T00:13:57.150 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:57.145+0000 7fd72f764640 1 Processor -- start 2024-09-11T00:13:57.150 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:57.145+0000 7fd72f764640 1 -- start start 2024-09-11T00:13:57.150 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:57.146+0000 7fd72f764640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd7280d4af0 0x7fd728161370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:57.151 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:57.146+0000 7fd72f764640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd72815e060 0x7fd728152f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:57.151 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:57.146+0000 7fd72f764640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd72815efe0 0x7fd7280cc890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:57.151 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:57.146+0000 7fd72f764640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fd7280cef80 con 0x7fd72815efe0 2024-09-11T00:13:57.151 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:57.146+0000 7fd72f764640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fd7280d2eb0 con 0x7fd7280d4af0 2024-09-11T00:13:57.151 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:57.146+0000 7fd72f764640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7fd7280cf100 con 0x7fd72815e060 2024-09-11T00:13:57.151 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:57.146+0000 7fd72dd01640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd72815efe0 0x7fd7280cc890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:57.151 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:57.146+0000 7fd72d500640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd7280d4af0 0x7fd728161370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:57.151 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:57.146+0000 7fd72d500640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd7280d4af0 0x7fd728161370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.92:43248/0 (socket says 172.21.15.92:43248) 2024-09-11T00:13:57.151 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:57.146+0000 7fd72d500640 1 -- 172.21.15.92:0/557835931 learned_addr learned my addr 172.21.15.92:0/557835931 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-11T00:13:57.151 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:57.146+0000 7fd72ccff640 1 --2- 172.21.15.92:0/557835931 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd72815e060 0x7fd728152f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:57.151 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:57.146+0000 7fd72d500640 1 -- 172.21.15.92:0/557835931 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd72815e060 msgr2=0x7fd728152f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:57.151 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:57.146+0000 7fd72d500640 1 --2- 172.21.15.92:0/557835931 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd72815e060 0x7fd728152f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:57.151 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:57.146+0000 7fd72d500640 1 -- 172.21.15.92:0/557835931 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd72815efe0 msgr2=0x7fd7280cc890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:57.152 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:57.146+0000 7fd72d500640 1 --2- 172.21.15.92:0/557835931 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd72815efe0 0x7fd7280cc890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:57.152 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:57.146+0000 7fd72d500640 1 -- 172.21.15.92:0/557835931 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd72815f7c0 con 0x7fd7280d4af0 2024-09-11T00:13:57.152 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:57.146+0000 7fd72dd01640 1 --2- 172.21.15.92:0/557835931 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd72815efe0 0x7fd7280cc890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:13:57.152 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:57.146+0000 7fd72d500640 1 --2- 172.21.15.92:0/557835931 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd7280d4af0 0x7fd728161370 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fd71c000c00 tx=0x7fd71c033c20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:13:57.152 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:57.147+0000 7fd719ffb640 1 -- 172.21.15.92:0/557835931 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd71c031d60 con 0x7fd7280d4af0 2024-09-11T00:13:57.152 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:57.147+0000 7fd719ffb640 1 -- 172.21.15.92:0/557835931 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd71c033e10 con 0x7fd7280d4af0 2024-09-11T00:13:57.152 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:57.147+0000 7fd719ffb640 1 -- 172.21.15.92:0/557835931 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd71c033310 con 0x7fd7280d4af0 2024-09-11T00:13:57.152 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:57.147+0000 7fd72f764640 1 -- 172.21.15.92:0/557835931 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd72815faa0 con 0x7fd7280d4af0 2024-09-11T00:13:57.152 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:57.147+0000 7fd72f764640 1 -- 172.21.15.92:0/557835931 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7280c92b0 con 0x7fd7280d4af0 2024-09-11T00:13:57.152 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:57.147+0000 7fd719ffb640 1 -- 172.21.15.92:0/557835931 <== mon.1 v2:172.21.15.145:3300/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7fd71c0334b0 con 0x7fd7280d4af0 2024-09-11T00:13:57.152 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:57.147+0000 7fd719ffb640 1 -- 172.21.15.92:0/557835931 <== mon.1 v2:172.21.15.145:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7fd71c003cd0 con 0x7fd7280d4af0 2024-09-11T00:13:57.152 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:57.148+0000 7fd72f764640 1 -- 172.21.15.92:0/557835931 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd7280cea40 con 0x7fd7280d4af0 2024-09-11T00:13:57.153 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:57.150+0000 7fd719ffb640 1 -- 172.21.15.92:0/557835931 <== mon.1 v2:172.21.15.145:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+76091 (secure 0 0 0) 0x7fd71c052080 con 0x7fd7280d4af0 2024-09-11T00:13:57.213 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:57.211+0000 7fd72f764640 1 -- 172.21.15.92:0/557835931 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd7280c9480 con 0x7fd7280d4af0 2024-09-11T00:13:57.214 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:57.211+0000 7fd719ffb640 1 -- 172.21.15.92:0/557835931 <== mon.1 v2:172.21.15.145:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7fd71c03f030 con 0x7fd7280d4af0 2024-09-11T00:13:57.214 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:13:57.214 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":10,"fsid":"47039cb3-5d2a-46bf-9066-8055b5dfc583","created":"2024-09-11T00:13:53.889939+0000","modified":"2024-09-11T00:13:56.982537+0000","last_up_change":"0.000000","last_in_change":"2024-09-11T00:13:56.982537+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"538af0ea-96c9-4999-9ccc-bee55f80ff76","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"f9214f2c-ffe6-4447-9a13-9549a36e0537","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"b44dd849-fb85-42b1-8a1a-b6681bb1f467","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"05a49d87-23b9-48dd-962c-d5c2686e7a32","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"cf52b087-afe0-4f43-a4e7-db2ebc158815","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"0e54adcd-2d1d-49fb-bf97-3dd7e9addd30","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"4d5ae7a8-b3df-4c7a-9124-290f239f5b57","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"d7e36444-6e3f-4372-81d3-88e7b4e993f7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T00:13:57.215 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:57.212+0000 7fd72f764640 1 -- 172.21.15.92:0/557835931 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd7280d4af0 msgr2=0x7fd728161370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:57.216 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:57.212+0000 7fd72f764640 1 --2- 172.21.15.92:0/557835931 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd7280d4af0 0x7fd728161370 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fd71c000c00 tx=0x7fd71c033c20 comp rx=0 tx=0).stop 2024-09-11T00:13:57.216 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:57.212+0000 7fd72f764640 1 -- 172.21.15.92:0/557835931 shutdown_connections 2024-09-11T00:13:57.216 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:57.212+0000 7fd72f764640 1 --2- 172.21.15.92:0/557835931 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd72815efe0 0x7fd7280cc890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:57.216 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:57.212+0000 7fd72f764640 1 --2- 172.21.15.92:0/557835931 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd72815e060 0x7fd728152f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:57.216 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:57.212+0000 7fd72f764640 1 --2- 172.21.15.92:0/557835931 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd7280d4af0 0x7fd728161370 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:57.216 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:57.212+0000 7fd72f764640 1 -- 172.21.15.92:0/557835931 >> 172.21.15.92:0/557835931 conn(0x7fd7280d3f70 msgr2=0x7fd7280b77e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:13:57.216 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:57.213+0000 7fd72f764640 1 -- 172.21.15.92:0/557835931 shutdown_connections 2024-09-11T00:13:57.216 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:13:57.213+0000 7fd72f764640 1 -- 172.21.15.92:0/557835931 wait complete. 2024-09-11T00:13:57.225 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-09-11T00:13:57.225 INFO:tasks.ceph:Waiting for OSDs to come up 2024-09-11T00:13:58.033 DEBUG:teuthology.orchestra.run.smithi092:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-11T00:13:58.127 INFO:teuthology.misc.health.smithi092.stderr:2024-09-11T00:13:58.124+0000 7fa1de08c640 1 -- 172.21.15.92:0/2483943594 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa1d8071dc0 msgr2=0x7fa1d80712b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:58.127 INFO:teuthology.misc.health.smithi092.stderr:2024-09-11T00:13:58.124+0000 7fa1de08c640 1 --2- 172.21.15.92:0/2483943594 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa1d8071dc0 0x7fa1d80712b0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fa1c0009830 tx=0x7fa1c002a5c0 comp rx=0 tx=0).stop 2024-09-11T00:13:58.127 INFO:teuthology.misc.health.smithi092.stderr:2024-09-11T00:13:58.124+0000 7fa1de08c640 1 -- 172.21.15.92:0/2483943594 shutdown_connections 2024-09-11T00:13:58.127 INFO:teuthology.misc.health.smithi092.stderr:2024-09-11T00:13:58.124+0000 7fa1de08c640 1 --2- 172.21.15.92:0/2483943594 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa1d8071dc0 0x7fa1d80712b0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:58.127 INFO:teuthology.misc.health.smithi092.stderr:2024-09-11T00:13:58.124+0000 7fa1de08c640 1 -- 172.21.15.92:0/2483943594 >> 172.21.15.92:0/2483943594 conn(0x7fa1d80d0c00 msgr2=0x7fa1d80d1010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:13:58.127 INFO:teuthology.misc.health.smithi092.stderr:2024-09-11T00:13:58.124+0000 7fa1de08c640 1 -- 172.21.15.92:0/2483943594 shutdown_connections 2024-09-11T00:13:58.127 INFO:teuthology.misc.health.smithi092.stderr:2024-09-11T00:13:58.124+0000 7fa1de08c640 1 -- 172.21.15.92:0/2483943594 wait complete. 2024-09-11T00:13:58.130 INFO:teuthology.misc.health.smithi092.stderr:2024-09-11T00:13:58.125+0000 7fa1de08c640 1 Processor -- start 2024-09-11T00:13:58.130 INFO:teuthology.misc.health.smithi092.stderr:2024-09-11T00:13:58.125+0000 7fa1de08c640 1 -- start start 2024-09-11T00:13:58.130 INFO:teuthology.misc.health.smithi092.stderr:2024-09-11T00:13:58.126+0000 7fa1de08c640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa1d80717f0 0x7fa1d814feb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:58.130 INFO:teuthology.misc.health.smithi092.stderr:2024-09-11T00:13:58.126+0000 7fa1de08c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa1d8071dc0 0x7fa1d8152020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:58.130 INFO:teuthology.misc.health.smithi092.stderr:2024-09-11T00:13:58.126+0000 7fa1de08c640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa1d815e0e0 0x7fa1d813f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:58.130 INFO:teuthology.misc.health.smithi092.stderr:2024-09-11T00:13:58.126+0000 7fa1de08c640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fa1d815edf0 con 0x7fa1d8071dc0 2024-09-11T00:13:58.130 INFO:teuthology.misc.health.smithi092.stderr:2024-09-11T00:13:58.126+0000 7fa1de08c640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fa1d815ef70 con 0x7fa1d80717f0 2024-09-11T00:13:58.130 INFO:teuthology.misc.health.smithi092.stderr:2024-09-11T00:13:58.126+0000 7fa1de08c640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7fa1d815f0f0 con 0x7fa1d815e0e0 2024-09-11T00:13:58.130 INFO:teuthology.misc.health.smithi092.stderr:2024-09-11T00:13:58.126+0000 7fa1cffff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa1d8071dc0 0x7fa1d8152020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:58.130 INFO:teuthology.misc.health.smithi092.stderr:2024-09-11T00:13:58.126+0000 7fa1cffff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa1d8071dc0 0x7fa1d8152020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:60660/0 (socket says 172.21.15.92:60660) 2024-09-11T00:13:58.130 INFO:teuthology.misc.health.smithi092.stderr:2024-09-11T00:13:58.126+0000 7fa1cffff640 1 -- 172.21.15.92:0/2988959735 learned_addr learned my addr 172.21.15.92:0/2988959735 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-11T00:13:58.131 INFO:teuthology.misc.health.smithi092.stderr:2024-09-11T00:13:58.126+0000 7fa1d77fe640 1 --2- 172.21.15.92:0/2988959735 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa1d80717f0 0x7fa1d814feb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:58.131 INFO:teuthology.misc.health.smithi092.stderr:2024-09-11T00:13:58.126+0000 7fa1d7fff640 1 --2- 172.21.15.92:0/2988959735 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa1d815e0e0 0x7fa1d813f2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:58.131 INFO:teuthology.misc.health.smithi092.stderr:2024-09-11T00:13:58.126+0000 7fa1cffff640 1 -- 172.21.15.92:0/2988959735 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa1d815e0e0 msgr2=0x7fa1d813f2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:58.131 INFO:teuthology.misc.health.smithi092.stderr:2024-09-11T00:13:58.126+0000 7fa1cffff640 1 --2- 172.21.15.92:0/2988959735 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa1d815e0e0 0x7fa1d813f2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:58.131 INFO:teuthology.misc.health.smithi092.stderr:2024-09-11T00:13:58.126+0000 7fa1cffff640 1 -- 172.21.15.92:0/2988959735 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa1d80717f0 msgr2=0x7fa1d814feb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:58.131 INFO:teuthology.misc.health.smithi092.stderr:2024-09-11T00:13:58.126+0000 7fa1cffff640 1 --2- 172.21.15.92:0/2988959735 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa1d80717f0 0x7fa1d814feb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:58.132 INFO:teuthology.misc.health.smithi092.stderr:2024-09-11T00:13:58.126+0000 7fa1cffff640 1 -- 172.21.15.92:0/2988959735 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1d814f3f0 con 0x7fa1d8071dc0 2024-09-11T00:13:58.132 INFO:teuthology.misc.health.smithi092.stderr:2024-09-11T00:13:58.126+0000 7fa1cffff640 1 --2- 172.21.15.92:0/2988959735 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa1d8071dc0 0x7fa1d8152020 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fa1c0009950 tx=0x7fa1c0032d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:13:58.132 INFO:teuthology.misc.health.smithi092.stderr:2024-09-11T00:13:58.126+0000 7fa1d4ff9640 1 -- 172.21.15.92:0/2988959735 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1c0040070 con 0x7fa1d8071dc0 2024-09-11T00:13:58.132 INFO:teuthology.misc.health.smithi092.stderr:2024-09-11T00:13:58.126+0000 7fa1d4ff9640 1 -- 172.21.15.92:0/2988959735 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa1c0003af0 con 0x7fa1d8071dc0 2024-09-11T00:13:58.132 INFO:teuthology.misc.health.smithi092.stderr:2024-09-11T00:13:58.126+0000 7fa1de08c640 1 -- 172.21.15.92:0/2988959735 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1d813fe40 con 0x7fa1d8071dc0 2024-09-11T00:13:58.133 INFO:teuthology.misc.health.smithi092.stderr:2024-09-11T00:13:58.126+0000 7fa1d4ff9640 1 -- 172.21.15.92:0/2988959735 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1c0045460 con 0x7fa1d8071dc0 2024-09-11T00:13:58.133 INFO:teuthology.misc.health.smithi092.stderr:2024-09-11T00:13:58.127+0000 7fa1de08c640 1 -- 172.21.15.92:0/2988959735 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1d814f6b0 con 0x7fa1d8071dc0 2024-09-11T00:13:58.133 INFO:teuthology.misc.health.smithi092.stderr:2024-09-11T00:13:58.127+0000 7fa1d4ff9640 1 -- 172.21.15.92:0/2988959735 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7fa1c0045600 con 0x7fa1d8071dc0 2024-09-11T00:13:58.133 INFO:teuthology.misc.health.smithi092.stderr:2024-09-11T00:13:58.127+0000 7fa1d4ff9640 1 -- 172.21.15.92:0/2988959735 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7fa1c003cd20 con 0x7fa1d8071dc0 2024-09-11T00:13:58.133 INFO:teuthology.misc.health.smithi092.stderr:2024-09-11T00:13:58.127+0000 7fa1de08c640 1 -- 172.21.15.92:0/2988959735 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa1d80712b0 con 0x7fa1d8071dc0 2024-09-11T00:13:58.134 INFO:teuthology.misc.health.smithi092.stderr:2024-09-11T00:13:58.129+0000 7fa1d4ff9640 1 -- 172.21.15.92:0/2988959735 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+76091 (secure 0 0 0) 0x7fa1c004c030 con 0x7fa1d8071dc0 2024-09-11T00:13:58.192 INFO:teuthology.misc.health.smithi092.stderr:2024-09-11T00:13:58.189+0000 7fa1de08c640 1 -- 172.21.15.92:0/2988959735 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa1d8074840 con 0x7fa1d8071dc0 2024-09-11T00:13:58.192 INFO:teuthology.misc.health.smithi092.stderr:2024-09-11T00:13:58.189+0000 7fa1d4ff9640 1 -- 172.21.15.92:0/2988959735 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7fa1c0045ab0 con 0x7fa1d8071dc0 2024-09-11T00:13:58.192 INFO:teuthology.misc.health.smithi092.stdout: 2024-09-11T00:13:58.192 INFO:teuthology.misc.health.smithi092.stdout:{"epoch":10,"fsid":"47039cb3-5d2a-46bf-9066-8055b5dfc583","created":"2024-09-11T00:13:53.889939+0000","modified":"2024-09-11T00:13:56.982537+0000","last_up_change":"0.000000","last_in_change":"2024-09-11T00:13:56.982537+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"538af0ea-96c9-4999-9ccc-bee55f80ff76","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"f9214f2c-ffe6-4447-9a13-9549a36e0537","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"b44dd849-fb85-42b1-8a1a-b6681bb1f467","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"05a49d87-23b9-48dd-962c-d5c2686e7a32","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"cf52b087-afe0-4f43-a4e7-db2ebc158815","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"0e54adcd-2d1d-49fb-bf97-3dd7e9addd30","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"4d5ae7a8-b3df-4c7a-9124-290f239f5b57","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"d7e36444-6e3f-4372-81d3-88e7b4e993f7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T00:13:58.193 INFO:teuthology.misc.health.smithi092.stderr:2024-09-11T00:13:58.190+0000 7fa1de08c640 1 -- 172.21.15.92:0/2988959735 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa1d8071dc0 msgr2=0x7fa1d8152020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:58.194 INFO:teuthology.misc.health.smithi092.stderr:2024-09-11T00:13:58.190+0000 7fa1de08c640 1 --2- 172.21.15.92:0/2988959735 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa1d8071dc0 0x7fa1d8152020 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fa1c0009950 tx=0x7fa1c0032d50 comp rx=0 tx=0).stop 2024-09-11T00:13:58.194 INFO:teuthology.misc.health.smithi092.stderr:2024-09-11T00:13:58.190+0000 7fa1de08c640 1 -- 172.21.15.92:0/2988959735 shutdown_connections 2024-09-11T00:13:58.194 INFO:teuthology.misc.health.smithi092.stderr:2024-09-11T00:13:58.190+0000 7fa1de08c640 1 --2- 172.21.15.92:0/2988959735 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa1d815e0e0 0x7fa1d813f2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:58.194 INFO:teuthology.misc.health.smithi092.stderr:2024-09-11T00:13:58.190+0000 7fa1de08c640 1 --2- 172.21.15.92:0/2988959735 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa1d8071dc0 0x7fa1d8152020 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:58.194 INFO:teuthology.misc.health.smithi092.stderr:2024-09-11T00:13:58.190+0000 7fa1de08c640 1 --2- 172.21.15.92:0/2988959735 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa1d80717f0 0x7fa1d814feb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:58.194 INFO:teuthology.misc.health.smithi092.stderr:2024-09-11T00:13:58.190+0000 7fa1de08c640 1 -- 172.21.15.92:0/2988959735 >> 172.21.15.92:0/2988959735 conn(0x7fa1d80d0c00 msgr2=0x7fa1d80addd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:13:58.194 INFO:teuthology.misc.health.smithi092.stderr:2024-09-11T00:13:58.190+0000 7fa1de08c640 1 -- 172.21.15.92:0/2988959735 shutdown_connections 2024-09-11T00:13:58.195 INFO:teuthology.misc.health.smithi092.stderr:2024-09-11T00:13:58.190+0000 7fa1de08c640 1 -- 172.21.15.92:0/2988959735 wait complete. 2024-09-11T00:13:58.202 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-09-11T00:13:58.209 INFO:tasks.ceph.osd.0.smithi092.stderr:2024-09-11T00:13:58.207+0000 7f828c189640 -1 Falling back to public interface 2024-09-11T00:13:58.465 INFO:tasks.ceph.osd.2.smithi092.stderr:2024-09-11T00:13:58.463+0000 7f645dc30640 -1 Falling back to public interface 2024-09-11T00:13:58.473 INFO:tasks.ceph.osd.6.smithi145.stderr:2024-09-11T00:13:58.470+0000 7f127781c640 -1 Falling back to public interface 2024-09-11T00:13:58.495 INFO:tasks.ceph.osd.5.smithi145.stderr:2024-09-11T00:13:58.492+0000 7f3a0ba0f640 -1 Falling back to public interface 2024-09-11T00:13:58.716 INFO:tasks.ceph.osd.1.smithi092.stderr:2024-09-11T00:13:58.714+0000 7f1c33a24640 -1 Falling back to public interface 2024-09-11T00:13:58.734 INFO:tasks.ceph.osd.7.smithi145.stderr:2024-09-11T00:13:58.731+0000 7f2472723640 -1 Falling back to public interface 2024-09-11T00:13:58.744 INFO:tasks.ceph.osd.4.smithi145.stderr:2024-09-11T00:13:58.742+0000 7f87ea81e640 -1 Falling back to public interface 2024-09-11T00:13:58.974 INFO:tasks.ceph.osd.3.smithi092.stderr:2024-09-11T00:13:58.972+0000 7fc703f1b640 -1 Falling back to public interface 2024-09-11T00:13:59.277 INFO:tasks.ceph.mgr.x.smithi145.stderr:2024-09-11T00:13:59.275+0000 7fd580a38640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-09-11T00:13:59.280 INFO:tasks.ceph.mgr.x.smithi145.stderr:2024-09-11T00:13:59.278+0000 7fd580a38640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-09-11T00:14:02.030 INFO:tasks.ceph.osd.6.smithi145.stderr:2024-09-11T00:14:02.027+0000 7f127781c640 -1 osd.6 0 log_to_monitors true 2024-09-11T00:14:02.037 INFO:tasks.ceph.osd.2.smithi092.stderr:2024-09-11T00:14:02.035+0000 7f645dc30640 -1 osd.2 0 log_to_monitors true 2024-09-11T00:14:02.277 INFO:tasks.ceph.osd.0.smithi092.stderr:2024-09-11T00:14:02.276+0000 7f828c189640 -1 osd.0 0 log_to_monitors true 2024-09-11T00:14:02.736 INFO:tasks.ceph.osd.7.smithi145.stderr:2024-09-11T00:14:02.734+0000 7f2472723640 -1 osd.7 0 log_to_monitors true 2024-09-11T00:14:02.742 INFO:tasks.ceph.osd.3.smithi092.stderr:2024-09-11T00:14:02.741+0000 7fc703f1b640 -1 osd.3 0 log_to_monitors true 2024-09-11T00:14:02.790 INFO:tasks.ceph.osd.5.smithi145.stderr:2024-09-11T00:14:02.787+0000 7f3a0ba0f640 -1 osd.5 0 log_to_monitors true 2024-09-11T00:14:03.019 INFO:tasks.ceph.osd.1.smithi092.stderr:2024-09-11T00:14:03.018+0000 7f1c33a24640 -1 osd.1 0 log_to_monitors true 2024-09-11T00:14:03.380 INFO:tasks.ceph.osd.4.smithi145.stderr:2024-09-11T00:14:03.378+0000 7f87ea81e640 -1 osd.4 0 log_to_monitors true 2024-09-11T00:14:04.060 INFO:tasks.ceph.osd.6.smithi145.stderr:2024-09-11T00:14:04.059+0000 7f12739b5640 -1 osd.6 0 waiting for initial osdmap 2024-09-11T00:14:04.075 INFO:tasks.ceph.osd.6.smithi145.stderr:2024-09-11T00:14:04.074+0000 7f126afc0640 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-11T00:14:04.892 INFO:tasks.ceph.osd.2.smithi092.stderr:2024-09-11T00:14:04.891+0000 7f6459172640 -1 osd.2 0 waiting for initial osdmap 2024-09-11T00:14:05.008 DEBUG:teuthology.orchestra.run.smithi092:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-11T00:14:05.108 INFO:teuthology.misc.health.smithi092.stderr:2024-09-11T00:14:05.106+0000 7f6f0a317640 1 -- 172.21.15.92:0/216173010 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6f040b0c30 msgr2=0x7f6f040b1180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:05.108 INFO:teuthology.misc.health.smithi092.stderr:2024-09-11T00:14:05.106+0000 7f6f0a317640 1 --2- 172.21.15.92:0/216173010 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6f040b0c30 0x7f6f040b1180 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f6f04071920 tx=0x7f6ef802a5f0 comp rx=0 tx=0).stop 2024-09-11T00:14:05.109 INFO:teuthology.misc.health.smithi092.stderr:2024-09-11T00:14:05.107+0000 7f6f0a317640 1 -- 172.21.15.92:0/216173010 shutdown_connections 2024-09-11T00:14:05.109 INFO:teuthology.misc.health.smithi092.stderr:2024-09-11T00:14:05.107+0000 7f6f0a317640 1 --2- 172.21.15.92:0/216173010 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6f040b0c30 0x7f6f040b1180 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:05.109 INFO:teuthology.misc.health.smithi092.stderr:2024-09-11T00:14:05.107+0000 7f6f0a317640 1 --2- 172.21.15.92:0/216173010 >> v2:172.21.15.145:3300/0 conn(0x7f6f040cffd0 0x7f6f04071c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:05.109 INFO:teuthology.misc.health.smithi092.stderr:2024-09-11T00:14:05.107+0000 7f6f0a317640 1 -- 172.21.15.92:0/216173010 >> 172.21.15.92:0/216173010 conn(0x7f6f040b3880 msgr2=0x7f6f040b3c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:14:05.109 INFO:teuthology.misc.health.smithi092.stderr:2024-09-11T00:14:05.107+0000 7f6f0a317640 1 -- 172.21.15.92:0/216173010 shutdown_connections 2024-09-11T00:14:05.109 INFO:teuthology.misc.health.smithi092.stderr:2024-09-11T00:14:05.107+0000 7f6f0a317640 1 -- 172.21.15.92:0/216173010 wait complete. 2024-09-11T00:14:05.109 INFO:teuthology.misc.health.smithi092.stderr:2024-09-11T00:14:05.108+0000 7f6f0a317640 1 Processor -- start 2024-09-11T00:14:05.110 INFO:teuthology.misc.health.smithi092.stderr:2024-09-11T00:14:05.108+0000 7f6f0a317640 1 -- start start 2024-09-11T00:14:05.111 INFO:teuthology.misc.health.smithi092.stderr:2024-09-11T00:14:05.109+0000 7f6f0a317640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6f040b0c30 0x7f6f041f33e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:05.111 INFO:teuthology.misc.health.smithi092.stderr:2024-09-11T00:14:05.109+0000 7f6f0a317640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6f040cffd0 0x7f6f0415ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:05.111 INFO:teuthology.misc.health.smithi092.stderr:2024-09-11T00:14:05.109+0000 7f6f0a317640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6f040d03b0 0x7f6f0414d010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:05.112 INFO:teuthology.misc.health.smithi092.stderr:2024-09-11T00:14:05.109+0000 7f6f0a317640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f6f040cd2c0 con 0x7f6f040d03b0 2024-09-11T00:14:05.112 INFO:teuthology.misc.health.smithi092.stderr:2024-09-11T00:14:05.109+0000 7f6f0a317640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f6f040cd140 con 0x7f6f040cffd0 2024-09-11T00:14:05.112 INFO:teuthology.misc.health.smithi092.stderr:2024-09-11T00:14:05.109+0000 7f6f0a317640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f6f040cd440 con 0x7f6f040b0c30 2024-09-11T00:14:05.112 INFO:teuthology.misc.health.smithi092.stderr:2024-09-11T00:14:05.109+0000 7f6f088b4640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6f040d03b0 0x7f6f0414d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:05.112 INFO:teuthology.misc.health.smithi092.stderr:2024-09-11T00:14:05.109+0000 7f6f037fe640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6f040cffd0 0x7f6f0415ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:05.112 INFO:teuthology.misc.health.smithi092.stderr:2024-09-11T00:14:05.109+0000 7f6f088b4640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6f040d03b0 0x7f6f0414d010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:55192/0 (socket says 172.21.15.92:55192) 2024-09-11T00:14:05.112 INFO:teuthology.misc.health.smithi092.stderr:2024-09-11T00:14:05.109+0000 7f6f088b4640 1 -- 172.21.15.92:0/1031508598 learned_addr learned my addr 172.21.15.92:0/1031508598 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-11T00:14:05.112 INFO:teuthology.misc.health.smithi092.stderr:2024-09-11T00:14:05.109+0000 7f6f03fff640 1 --2- 172.21.15.92:0/1031508598 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6f040b0c30 0x7f6f041f33e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:05.112 INFO:teuthology.misc.health.smithi092.stderr:2024-09-11T00:14:05.109+0000 7f6f088b4640 1 -- 172.21.15.92:0/1031508598 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6f040b0c30 msgr2=0x7f6f041f33e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:05.112 INFO:teuthology.misc.health.smithi092.stderr:2024-09-11T00:14:05.109+0000 7f6f088b4640 1 --2- 172.21.15.92:0/1031508598 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6f040b0c30 0x7f6f041f33e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:05.112 INFO:teuthology.misc.health.smithi092.stderr:2024-09-11T00:14:05.109+0000 7f6f088b4640 1 -- 172.21.15.92:0/1031508598 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6f040cffd0 msgr2=0x7f6f0415ef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:05.112 INFO:teuthology.misc.health.smithi092.stderr:2024-09-11T00:14:05.109+0000 7f6f088b4640 1 --2- 172.21.15.92:0/1031508598 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6f040cffd0 0x7f6f0415ef90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:05.112 INFO:teuthology.misc.health.smithi092.stderr:2024-09-11T00:14:05.109+0000 7f6f088b4640 1 -- 172.21.15.92:0/1031508598 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f0415def0 con 0x7f6f040d03b0 2024-09-11T00:14:05.113 INFO:teuthology.misc.health.smithi092.stderr:2024-09-11T00:14:05.109+0000 7f6f037fe640 1 --2- 172.21.15.92:0/1031508598 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6f040cffd0 0x7f6f0415ef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:14:05.113 INFO:teuthology.misc.health.smithi092.stderr:2024-09-11T00:14:05.109+0000 7f6f088b4640 1 --2- 172.21.15.92:0/1031508598 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6f040d03b0 0x7f6f0414d010 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f6efc00c700 tx=0x7f6efc00cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:14:05.113 INFO:teuthology.misc.health.smithi092.stderr:2024-09-11T00:14:05.110+0000 7f6f00ff9640 1 -- 172.21.15.92:0/1031508598 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6efc003b70 con 0x7f6f040d03b0 2024-09-11T00:14:05.113 INFO:teuthology.misc.health.smithi092.stderr:2024-09-11T00:14:05.110+0000 7f6f00ff9640 1 -- 172.21.15.92:0/1031508598 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6efc003d10 con 0x7f6f040d03b0 2024-09-11T00:14:05.113 INFO:teuthology.misc.health.smithi092.stderr:2024-09-11T00:14:05.110+0000 7f6f00ff9640 1 -- 172.21.15.92:0/1031508598 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6efc00aab0 con 0x7f6f040d03b0 2024-09-11T00:14:05.113 INFO:teuthology.misc.health.smithi092.stderr:2024-09-11T00:14:05.110+0000 7f6f0a317640 1 -- 172.21.15.92:0/1031508598 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f0415e1d0 con 0x7f6f040d03b0 2024-09-11T00:14:05.114 INFO:teuthology.misc.health.smithi092.stderr:2024-09-11T00:14:05.110+0000 7f6f0a317640 1 -- 172.21.15.92:0/1031508598 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f0415e790 con 0x7f6f040d03b0 2024-09-11T00:14:05.114 INFO:teuthology.misc.health.smithi092.stderr:2024-09-11T00:14:05.111+0000 7f6f00ff9640 1 -- 172.21.15.92:0/1031508598 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 4) ==== 100545+0+0 (secure 0 0 0) 0x7f6efc00ac50 con 0x7f6f040d03b0 2024-09-11T00:14:05.114 INFO:teuthology.misc.health.smithi092.stderr:2024-09-11T00:14:05.112+0000 7f6f0a317640 1 -- 172.21.15.92:0/1031508598 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6f040b1400 con 0x7f6f040d03b0 2024-09-11T00:14:05.114 INFO:teuthology.misc.health.smithi092.stderr:2024-09-11T00:14:05.112+0000 7f6f00ff9640 1 --2- 172.21.15.92:0/1031508598 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f6ef0077ee0 0x7f6ef007a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:05.114 INFO:teuthology.misc.health.smithi092.stderr:2024-09-11T00:14:05.112+0000 7f6f00ff9640 1 -- 172.21.15.92:0/1031508598 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(13..13 src has 1..13) ==== 2495+0+0 (secure 0 0 0) 0x7f6efc098c80 con 0x7f6f040d03b0 2024-09-11T00:14:05.114 INFO:teuthology.misc.health.smithi092.stderr:2024-09-11T00:14:05.112+0000 7f6f03fff640 1 --2- 172.21.15.92:0/1031508598 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f6ef0077ee0 0x7f6ef007a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:05.114 INFO:teuthology.misc.health.smithi092.stderr:2024-09-11T00:14:05.113+0000 7f6f03fff640 1 --2- 172.21.15.92:0/1031508598 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f6ef0077ee0 0x7f6ef007a3a0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f6f040b7b00 tx=0x7f6ef4005f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:14:05.118 INFO:teuthology.misc.health.smithi092.stderr:2024-09-11T00:14:05.117+0000 7f6f00ff9640 1 -- 172.21.15.92:0/1031508598 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f6f040b1400 con 0x7f6f040d03b0 2024-09-11T00:14:05.169 INFO:tasks.ceph.osd.2.smithi092.stderr:2024-09-11T00:14:05.168+0000 7f6450f91640 -1 osd.2 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-11T00:14:05.323 INFO:teuthology.misc.health.smithi092.stderr:2024-09-11T00:14:05.322+0000 7f6f0a317640 1 -- 172.21.15.92:0/1031508598 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6f040b1180 con 0x7f6f040d03b0 2024-09-11T00:14:05.326 INFO:teuthology.misc.health.smithi092.stderr:2024-09-11T00:14:05.325+0000 7f6f00ff9640 1 -- 172.21.15.92:0/1031508598 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v13) ==== 74+0+7567 (secure 0 0 0) 0x7f6efc061ea0 con 0x7f6f040d03b0 2024-09-11T00:14:05.327 INFO:teuthology.misc.health.smithi092.stdout: 2024-09-11T00:14:05.327 INFO:teuthology.misc.health.smithi092.stdout:{"epoch":13,"fsid":"47039cb3-5d2a-46bf-9066-8055b5dfc583","created":"2024-09-11T00:13:53.889939+0000","modified":"2024-09-11T00:14:04.284752+0000","last_up_change":"2024-09-11T00:14:04.284752+0000","last_in_change":"2024-09-11T00:13:56.982537+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"538af0ea-96c9-4999-9ccc-bee55f80ff76","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"f9214f2c-ffe6-4447-9a13-9549a36e0537","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"b44dd849-fb85-42b1-8a1a-b6681bb1f467","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"05a49d87-23b9-48dd-962c-d5c2686e7a32","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"cf52b087-afe0-4f43-a4e7-db2ebc158815","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"0e54adcd-2d1d-49fb-bf97-3dd7e9addd30","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"4d5ae7a8-b3df-4c7a-9124-290f239f5b57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6802","nonce":4192380792},{"type":"v1","addr":"172.21.15.145:6803","nonce":4192380792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6804","nonce":4192380792},{"type":"v1","addr":"172.21.15.145:6805","nonce":4192380792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6808","nonce":4192380792},{"type":"v1","addr":"172.21.15.145:6809","nonce":4192380792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6806","nonce":4192380792},{"type":"v1","addr":"172.21.15.145:6807","nonce":4192380792}]},"public_addr":"172.21.15.145:6803/4192380792","cluster_addr":"172.21.15.145:6805/4192380792","heartbeat_back_addr":"172.21.15.145:6809/4192380792","heartbeat_front_addr":"172.21.15.145:6807/4192380792","state":["exists","up"]},{"osd":7,"uuid":"d7e36444-6e3f-4372-81d3-88e7b4e993f7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T00:14:05.329 INFO:teuthology.misc.health.smithi092.stderr:2024-09-11T00:14:05.327+0000 7f6f0a317640 1 -- 172.21.15.92:0/1031508598 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f6ef0077ee0 msgr2=0x7f6ef007a3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:05.329 INFO:teuthology.misc.health.smithi092.stderr:2024-09-11T00:14:05.327+0000 7f6f0a317640 1 --2- 172.21.15.92:0/1031508598 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f6ef0077ee0 0x7f6ef007a3a0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f6f040b7b00 tx=0x7f6ef4005f90 comp rx=0 tx=0).stop 2024-09-11T00:14:05.329 INFO:teuthology.misc.health.smithi092.stderr:2024-09-11T00:14:05.327+0000 7f6f0a317640 1 -- 172.21.15.92:0/1031508598 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6f040d03b0 msgr2=0x7f6f0414d010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:05.330 INFO:teuthology.misc.health.smithi092.stderr:2024-09-11T00:14:05.327+0000 7f6f0a317640 1 --2- 172.21.15.92:0/1031508598 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6f040d03b0 0x7f6f0414d010 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f6efc00c700 tx=0x7f6efc00cbc0 comp rx=0 tx=0).stop 2024-09-11T00:14:05.330 INFO:teuthology.misc.health.smithi092.stderr:2024-09-11T00:14:05.327+0000 7f6f0a317640 1 -- 172.21.15.92:0/1031508598 shutdown_connections 2024-09-11T00:14:05.330 INFO:teuthology.misc.health.smithi092.stderr:2024-09-11T00:14:05.327+0000 7f6f0a317640 1 --2- 172.21.15.92:0/1031508598 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f6ef0077ee0 0x7f6ef007a3a0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:05.330 INFO:teuthology.misc.health.smithi092.stderr:2024-09-11T00:14:05.327+0000 7f6f0a317640 1 --2- 172.21.15.92:0/1031508598 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6f040d03b0 0x7f6f0414d010 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:05.330 INFO:teuthology.misc.health.smithi092.stderr:2024-09-11T00:14:05.327+0000 7f6f0a317640 1 --2- 172.21.15.92:0/1031508598 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6f040cffd0 0x7f6f0415ef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:05.330 INFO:teuthology.misc.health.smithi092.stderr:2024-09-11T00:14:05.327+0000 7f6f0a317640 1 --2- 172.21.15.92:0/1031508598 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6f040b0c30 0x7f6f041f33e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:05.330 INFO:teuthology.misc.health.smithi092.stderr:2024-09-11T00:14:05.327+0000 7f6f0a317640 1 -- 172.21.15.92:0/1031508598 >> 172.21.15.92:0/1031508598 conn(0x7f6f040b3880 msgr2=0x7f6f040b0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:14:05.330 INFO:teuthology.misc.health.smithi092.stderr:2024-09-11T00:14:05.327+0000 7f6f0a317640 1 -- 172.21.15.92:0/1031508598 shutdown_connections 2024-09-11T00:14:05.330 INFO:teuthology.misc.health.smithi092.stderr:2024-09-11T00:14:05.327+0000 7f6f0a317640 1 -- 172.21.15.92:0/1031508598 wait complete. 2024-09-11T00:14:05.338 DEBUG:teuthology.misc:1 of 8 OSDs are up 2024-09-11T00:14:05.560 INFO:tasks.ceph.osd.7.smithi145.stderr:2024-09-11T00:14:05.559+0000 7f246e6b2640 -1 osd.7 0 waiting for initial osdmap 2024-09-11T00:14:05.575 INFO:tasks.ceph.osd.7.smithi145.stderr:2024-09-11T00:14:05.574+0000 7f24664d1640 -1 osd.7 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-11T00:14:05.585 INFO:tasks.ceph.osd.5.smithi145.stderr:2024-09-11T00:14:05.584+0000 7f3a07b01640 -1 osd.5 0 waiting for initial osdmap 2024-09-11T00:14:05.595 INFO:tasks.ceph.osd.5.smithi145.stderr:2024-09-11T00:14:05.594+0000 7f39ff10c640 -1 osd.5 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-11T00:14:05.930 INFO:tasks.ceph.osd.0.smithi092.stderr:2024-09-11T00:14:05.928+0000 7f8288118640 -1 osd.0 0 waiting for initial osdmap 2024-09-11T00:14:05.947 INFO:tasks.ceph.osd.0.smithi092.stderr:2024-09-11T00:14:05.946+0000 7f827ff37640 -1 osd.0 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-11T00:14:05.982 INFO:tasks.ceph.osd.3.smithi092.stderr:2024-09-11T00:14:05.981+0000 7fc6ffeaa640 -1 osd.3 0 waiting for initial osdmap 2024-09-11T00:14:05.991 INFO:tasks.ceph.osd.3.smithi092.stderr:2024-09-11T00:14:05.990+0000 7fc6f7cc9640 -1 osd.3 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-11T00:14:06.015 INFO:tasks.ceph.osd.1.smithi092.stderr:2024-09-11T00:14:06.013+0000 7f1c2f40f640 -1 osd.1 0 waiting for initial osdmap 2024-09-11T00:14:06.026 INFO:tasks.ceph.osd.1.smithi092.stderr:2024-09-11T00:14:06.025+0000 7f1c2722e640 -1 osd.1 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-11T00:14:06.141 INFO:tasks.ceph.osd.4.smithi145.stderr:2024-09-11T00:14:06.140+0000 7f87e6111640 -1 osd.4 0 waiting for initial osdmap 2024-09-11T00:14:06.155 INFO:tasks.ceph.osd.4.smithi145.stderr:2024-09-11T00:14:06.154+0000 7f87ddf30640 -1 osd.4 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-11T00:14:12.147 DEBUG:teuthology.orchestra.run.smithi092:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-11T00:14:12.248 INFO:teuthology.misc.health.smithi092.stderr:2024-09-11T00:14:12.246+0000 7f2c5000f640 1 -- 172.21.15.92:0/315779826 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2c30005210 msgr2=0x7f2c3000b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:12.248 INFO:teuthology.misc.health.smithi092.stderr:2024-09-11T00:14:12.246+0000 7f2c5000f640 1 --2- 172.21.15.92:0/315779826 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2c30005210 0x7f2c3000b9c0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f2c380013d0 tx=0x7f2c30005830 comp rx=0 tx=0).stop 2024-09-11T00:14:12.248 INFO:teuthology.misc.health.smithi092.stderr:2024-09-11T00:14:12.246+0000 7f2c5000f640 1 -- 172.21.15.92:0/315779826 shutdown_connections 2024-09-11T00:14:12.248 INFO:teuthology.misc.health.smithi092.stderr:2024-09-11T00:14:12.246+0000 7f2c5000f640 1 --2- 172.21.15.92:0/315779826 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2c30005210 0x7f2c3000b9c0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:12.248 INFO:teuthology.misc.health.smithi092.stderr:2024-09-11T00:14:12.246+0000 7f2c5000f640 1 -- 172.21.15.92:0/315779826 >> 172.21.15.92:0/315779826 conn(0x7f2c4809aa00 msgr2=0x7f2c4809ae10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:14:12.248 INFO:teuthology.misc.health.smithi092.stderr:2024-09-11T00:14:12.246+0000 7f2c5000f640 1 -- 172.21.15.92:0/315779826 shutdown_connections 2024-09-11T00:14:12.248 INFO:teuthology.misc.health.smithi092.stderr:2024-09-11T00:14:12.246+0000 7f2c5000f640 1 -- 172.21.15.92:0/315779826 wait complete. 2024-09-11T00:14:12.249 INFO:teuthology.misc.health.smithi092.stderr:2024-09-11T00:14:12.247+0000 7f2c5000f640 1 Processor -- start 2024-09-11T00:14:12.249 INFO:teuthology.misc.health.smithi092.stderr:2024-09-11T00:14:12.247+0000 7f2c5000f640 1 -- start start 2024-09-11T00:14:12.250 INFO:teuthology.misc.health.smithi092.stderr:2024-09-11T00:14:12.248+0000 7f2c5000f640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2c30005210 0x7f2c4815ec60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:12.251 INFO:teuthology.misc.health.smithi092.stderr:2024-09-11T00:14:12.248+0000 7f2c5000f640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2c480b4af0 0x7f2c480cd670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:12.251 INFO:teuthology.misc.health.smithi092.stderr:2024-09-11T00:14:12.248+0000 7f2c5000f640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2c480cdbb0 0x7f2c480ce020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:12.251 INFO:teuthology.misc.health.smithi092.stderr:2024-09-11T00:14:12.248+0000 7f2c5000f640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f2c480d1f20 con 0x7f2c480cdbb0 2024-09-11T00:14:12.251 INFO:teuthology.misc.health.smithi092.stderr:2024-09-11T00:14:12.248+0000 7f2c5000f640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f2c480cfab0 con 0x7f2c480b4af0 2024-09-11T00:14:12.251 INFO:teuthology.misc.health.smithi092.stderr:2024-09-11T00:14:12.248+0000 7f2c5000f640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f2c480d20a0 con 0x7f2c30005210 2024-09-11T00:14:12.251 INFO:teuthology.misc.health.smithi092.stderr:2024-09-11T00:14:12.248+0000 7f2c4e5ac640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2c480cdbb0 0x7f2c480ce020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:12.251 INFO:teuthology.misc.health.smithi092.stderr:2024-09-11T00:14:12.248+0000 7f2c4e5ac640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2c480cdbb0 0x7f2c480ce020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:55210/0 (socket says 172.21.15.92:55210) 2024-09-11T00:14:12.251 INFO:teuthology.misc.health.smithi092.stderr:2024-09-11T00:14:12.248+0000 7f2c4e5ac640 1 -- 172.21.15.92:0/884368578 learned_addr learned my addr 172.21.15.92:0/884368578 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-11T00:14:12.251 INFO:teuthology.misc.health.smithi092.stderr:2024-09-11T00:14:12.248+0000 7f2c4d5aa640 1 --2- 172.21.15.92:0/884368578 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2c480b4af0 0x7f2c480cd670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:12.251 INFO:teuthology.misc.health.smithi092.stderr:2024-09-11T00:14:12.248+0000 7f2c4e5ac640 1 -- 172.21.15.92:0/884368578 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2c30005210 msgr2=0x7f2c4815ec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:12.251 INFO:teuthology.misc.health.smithi092.stderr:2024-09-11T00:14:12.248+0000 7f2c4e5ac640 1 --2- 172.21.15.92:0/884368578 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2c30005210 0x7f2c4815ec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:12.251 INFO:teuthology.misc.health.smithi092.stderr:2024-09-11T00:14:12.248+0000 7f2c4e5ac640 1 -- 172.21.15.92:0/884368578 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2c480b4af0 msgr2=0x7f2c480cd670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:12.252 INFO:teuthology.misc.health.smithi092.stderr:2024-09-11T00:14:12.248+0000 7f2c4e5ac640 1 --2- 172.21.15.92:0/884368578 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2c480b4af0 0x7f2c480cd670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:12.252 INFO:teuthology.misc.health.smithi092.stderr:2024-09-11T00:14:12.248+0000 7f2c4e5ac640 1 -- 172.21.15.92:0/884368578 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c4815f1a0 con 0x7f2c480cdbb0 2024-09-11T00:14:12.252 INFO:teuthology.misc.health.smithi092.stderr:2024-09-11T00:14:12.248+0000 7f2c4e5ac640 1 --2- 172.21.15.92:0/884368578 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2c480cdbb0 0x7f2c480ce020 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f2c380013d0 tx=0x7f2c38003c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:14:12.252 INFO:teuthology.misc.health.smithi092.stderr:2024-09-11T00:14:12.248+0000 7f2c467fc640 1 -- 172.21.15.92:0/884368578 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c3802bbb0 con 0x7f2c480cdbb0 2024-09-11T00:14:12.252 INFO:teuthology.misc.health.smithi092.stderr:2024-09-11T00:14:12.248+0000 7f2c467fc640 1 -- 172.21.15.92:0/884368578 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2c3803a070 con 0x7f2c480cdbb0 2024-09-11T00:14:12.252 INFO:teuthology.misc.health.smithi092.stderr:2024-09-11T00:14:12.249+0000 7f2c467fc640 1 -- 172.21.15.92:0/884368578 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c3802be60 con 0x7f2c480cdbb0 2024-09-11T00:14:12.252 INFO:teuthology.misc.health.smithi092.stderr:2024-09-11T00:14:12.249+0000 7f2c5000f640 1 -- 172.21.15.92:0/884368578 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c480b78d0 con 0x7f2c480cdbb0 2024-09-11T00:14:12.252 INFO:teuthology.misc.health.smithi092.stderr:2024-09-11T00:14:12.249+0000 7f2c5000f640 1 -- 172.21.15.92:0/884368578 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c4815c7f0 con 0x7f2c480cdbb0 2024-09-11T00:14:12.253 INFO:teuthology.misc.health.smithi092.stderr:2024-09-11T00:14:12.249+0000 7f2c5000f640 1 -- 172.21.15.92:0/884368578 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2c48160080 con 0x7f2c480cdbb0 2024-09-11T00:14:12.253 INFO:teuthology.misc.health.smithi092.stderr:2024-09-11T00:14:12.250+0000 7f2c467fc640 1 -- 172.21.15.92:0/884368578 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f2c38006280 con 0x7f2c480cdbb0 2024-09-11T00:14:12.253 INFO:teuthology.misc.health.smithi092.stderr:2024-09-11T00:14:12.251+0000 7f2c467fc640 1 --2- 172.21.15.92:0/884368578 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f2c34077f70 0x7f2c3407a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:12.253 INFO:teuthology.misc.health.smithi092.stderr:2024-09-11T00:14:12.251+0000 7f2c467fc640 1 -- 172.21.15.92:0/884368578 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7f2c380b9480 con 0x7f2c480cdbb0 2024-09-11T00:14:12.253 INFO:teuthology.misc.health.smithi092.stderr:2024-09-11T00:14:12.251+0000 7f2c4ddab640 1 --2- 172.21.15.92:0/884368578 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f2c34077f70 0x7f2c3407a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:12.253 INFO:teuthology.misc.health.smithi092.stderr:2024-09-11T00:14:12.252+0000 7f2c4ddab640 1 --2- 172.21.15.92:0/884368578 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f2c34077f70 0x7f2c3407a430 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f2c480b7d10 tx=0x7f2c40006a10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:14:12.256 INFO:teuthology.misc.health.smithi092.stderr:2024-09-11T00:14:12.255+0000 7f2c467fc640 1 -- 172.21.15.92:0/884368578 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f2c380822d0 con 0x7f2c480cdbb0 2024-09-11T00:14:12.435 INFO:teuthology.misc.health.smithi092.stderr:2024-09-11T00:14:12.434+0000 7f2c5000f640 1 -- 172.21.15.92:0/884368578 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2c480d2ac0 con 0x7f2c480cdbb0 2024-09-11T00:14:12.436 INFO:teuthology.misc.health.smithi092.stderr:2024-09-11T00:14:12.435+0000 7f2c467fc640 1 -- 172.21.15.92:0/884368578 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) ==== 74+0+12920 (secure 0 0 0) 0x7f2c38081bd0 con 0x7f2c480cdbb0 2024-09-11T00:14:12.436 INFO:teuthology.misc.health.smithi092.stdout: 2024-09-11T00:14:12.436 INFO:teuthology.misc.health.smithi092.stdout:{"epoch":17,"fsid":"47039cb3-5d2a-46bf-9066-8055b5dfc583","created":"2024-09-11T00:13:53.889939+0000","modified":"2024-09-11T00:14:08.582388+0000","last_up_change":"2024-09-11T00:14:06.563107+0000","last_in_change":"2024-09-11T00:13:56.982537+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T00:14:06.287223+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"538af0ea-96c9-4999-9ccc-bee55f80ff76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":2860560077},{"type":"v1","addr":"172.21.15.92:6801","nonce":2860560077}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":2860560077},{"type":"v1","addr":"172.21.15.92:6803","nonce":2860560077}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":2860560077},{"type":"v1","addr":"172.21.15.92:6807","nonce":2860560077}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":2860560077},{"type":"v1","addr":"172.21.15.92:6805","nonce":2860560077}]},"public_addr":"172.21.15.92:6801/2860560077","cluster_addr":"172.21.15.92:6803/2860560077","heartbeat_back_addr":"172.21.15.92:6807/2860560077","heartbeat_front_addr":"172.21.15.92:6805/2860560077","state":["exists","up"]},{"osd":1,"uuid":"f9214f2c-ffe6-4447-9a13-9549a36e0537","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":2600417443},{"type":"v1","addr":"172.21.15.92:6817","nonce":2600417443}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6818","nonce":2600417443},{"type":"v1","addr":"172.21.15.92:6819","nonce":2600417443}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6822","nonce":2600417443},{"type":"v1","addr":"172.21.15.92:6823","nonce":2600417443}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":2600417443},{"type":"v1","addr":"172.21.15.92:6821","nonce":2600417443}]},"public_addr":"172.21.15.92:6817/2600417443","cluster_addr":"172.21.15.92:6819/2600417443","heartbeat_back_addr":"172.21.15.92:6823/2600417443","heartbeat_front_addr":"172.21.15.92:6821/2600417443","state":["exists","up"]},{"osd":2,"uuid":"b44dd849-fb85-42b1-8a1a-b6681bb1f467","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":3143892898},{"type":"v1","addr":"172.21.15.92:6809","nonce":3143892898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":3143892898},{"type":"v1","addr":"172.21.15.92:6811","nonce":3143892898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":3143892898},{"type":"v1","addr":"172.21.15.92:6815","nonce":3143892898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":3143892898},{"type":"v1","addr":"172.21.15.92:6813","nonce":3143892898}]},"public_addr":"172.21.15.92:6809/3143892898","cluster_addr":"172.21.15.92:6811/3143892898","heartbeat_back_addr":"172.21.15.92:6815/3143892898","heartbeat_front_addr":"172.21.15.92:6813/3143892898","state":["exists","up"]},{"osd":3,"uuid":"05a49d87-23b9-48dd-962c-d5c2686e7a32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":3913961488},{"type":"v1","addr":"172.21.15.92:6825","nonce":3913961488}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6826","nonce":3913961488},{"type":"v1","addr":"172.21.15.92:6827","nonce":3913961488}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":3913961488},{"type":"v1","addr":"172.21.15.92:6831","nonce":3913961488}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":3913961488},{"type":"v1","addr":"172.21.15.92:6829","nonce":3913961488}]},"public_addr":"172.21.15.92:6825/3913961488","cluster_addr":"172.21.15.92:6827/3913961488","heartbeat_back_addr":"172.21.15.92:6831/3913961488","heartbeat_front_addr":"172.21.15.92:6829/3913961488","state":["exists","up"]},{"osd":4,"uuid":"cf52b087-afe0-4f43-a4e7-db2ebc158815","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6826","nonce":2206798907},{"type":"v1","addr":"172.21.15.145:6827","nonce":2206798907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6828","nonce":2206798907},{"type":"v1","addr":"172.21.15.145:6829","nonce":2206798907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6832","nonce":2206798907},{"type":"v1","addr":"172.21.15.145:6833","nonce":2206798907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6830","nonce":2206798907},{"type":"v1","addr":"172.21.15.145:6831","nonce":2206798907}]},"public_addr":"172.21.15.145:6827/2206798907","cluster_addr":"172.21.15.145:6829/2206798907","heartbeat_back_addr":"172.21.15.145:6833/2206798907","heartbeat_front_addr":"172.21.15.145:6831/2206798907","state":["exists","up"]},{"osd":5,"uuid":"0e54adcd-2d1d-49fb-bf97-3dd7e9addd30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6810","nonce":2599548493},{"type":"v1","addr":"172.21.15.145:6811","nonce":2599548493}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6812","nonce":2599548493},{"type":"v1","addr":"172.21.15.145:6813","nonce":2599548493}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6816","nonce":2599548493},{"type":"v1","addr":"172.21.15.145:6817","nonce":2599548493}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6814","nonce":2599548493},{"type":"v1","addr":"172.21.15.145:6815","nonce":2599548493}]},"public_addr":"172.21.15.145:6811/2599548493","cluster_addr":"172.21.15.145:6813/2599548493","heartbeat_back_addr":"172.21.15.145:6817/2599548493","heartbeat_front_addr":"172.21.15.145:6815/2599548493","state":["exists","up"]},{"osd":6,"uuid":"4d5ae7a8-b3df-4c7a-9124-290f239f5b57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6802","nonce":4192380792},{"type":"v1","addr":"172.21.15.145:6803","nonce":4192380792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6804","nonce":4192380792},{"type":"v1","addr":"172.21.15.145:6805","nonce":4192380792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6808","nonce":4192380792},{"type":"v1","addr":"172.21.15.145:6809","nonce":4192380792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6806","nonce":4192380792},{"type":"v1","addr":"172.21.15.145:6807","nonce":4192380792}]},"public_addr":"172.21.15.145:6803/4192380792","cluster_addr":"172.21.15.145:6805/4192380792","heartbeat_back_addr":"172.21.15.145:6809/4192380792","heartbeat_front_addr":"172.21.15.145:6807/4192380792","state":["exists","up"]},{"osd":7,"uuid":"d7e36444-6e3f-4372-81d3-88e7b4e993f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6818","nonce":3010598400},{"type":"v1","addr":"172.21.15.145:6819","nonce":3010598400}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6820","nonce":3010598400},{"type":"v1","addr":"172.21.15.145:6821","nonce":3010598400}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6824","nonce":3010598400},{"type":"v1","addr":"172.21.15.145:6825","nonce":3010598400}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6822","nonce":3010598400},{"type":"v1","addr":"172.21.15.145:6823","nonce":3010598400}]},"public_addr":"172.21.15.145:6819/3010598400","cluster_addr":"172.21.15.145:6821/3010598400","heartbeat_back_addr":"172.21.15.145:6825/3010598400","heartbeat_front_addr":"172.21.15.145:6823/3010598400","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:14:03.281892+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:14:04.039021+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:14:03.045775+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:14:03.708856+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:14:04.425520+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:14:03.839369+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:14:03.029834+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:14:03.707529+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T00:14:12.439 INFO:teuthology.misc.health.smithi092.stderr:2024-09-11T00:14:12.437+0000 7f2c5000f640 1 -- 172.21.15.92:0/884368578 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f2c34077f70 msgr2=0x7f2c3407a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:12.439 INFO:teuthology.misc.health.smithi092.stderr:2024-09-11T00:14:12.437+0000 7f2c5000f640 1 --2- 172.21.15.92:0/884368578 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f2c34077f70 0x7f2c3407a430 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f2c480b7d10 tx=0x7f2c40006a10 comp rx=0 tx=0).stop 2024-09-11T00:14:12.439 INFO:teuthology.misc.health.smithi092.stderr:2024-09-11T00:14:12.437+0000 7f2c5000f640 1 -- 172.21.15.92:0/884368578 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2c480cdbb0 msgr2=0x7f2c480ce020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:12.439 INFO:teuthology.misc.health.smithi092.stderr:2024-09-11T00:14:12.437+0000 7f2c5000f640 1 --2- 172.21.15.92:0/884368578 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2c480cdbb0 0x7f2c480ce020 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f2c380013d0 tx=0x7f2c38003c20 comp rx=0 tx=0).stop 2024-09-11T00:14:12.439 INFO:teuthology.misc.health.smithi092.stderr:2024-09-11T00:14:12.437+0000 7f2c5000f640 1 -- 172.21.15.92:0/884368578 shutdown_connections 2024-09-11T00:14:12.439 INFO:teuthology.misc.health.smithi092.stderr:2024-09-11T00:14:12.437+0000 7f2c5000f640 1 --2- 172.21.15.92:0/884368578 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f2c34077f70 0x7f2c3407a430 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:12.439 INFO:teuthology.misc.health.smithi092.stderr:2024-09-11T00:14:12.437+0000 7f2c5000f640 1 --2- 172.21.15.92:0/884368578 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2c480cdbb0 0x7f2c480ce020 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:12.440 INFO:teuthology.misc.health.smithi092.stderr:2024-09-11T00:14:12.437+0000 7f2c5000f640 1 --2- 172.21.15.92:0/884368578 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2c480b4af0 0x7f2c480cd670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:12.440 INFO:teuthology.misc.health.smithi092.stderr:2024-09-11T00:14:12.437+0000 7f2c5000f640 1 --2- 172.21.15.92:0/884368578 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2c30005210 0x7f2c4815ec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:12.440 INFO:teuthology.misc.health.smithi092.stderr:2024-09-11T00:14:12.437+0000 7f2c5000f640 1 -- 172.21.15.92:0/884368578 >> 172.21.15.92:0/884368578 conn(0x7f2c4809aa00 msgr2=0x7f2c480c7f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:14:12.440 INFO:teuthology.misc.health.smithi092.stderr:2024-09-11T00:14:12.437+0000 7f2c5000f640 1 -- 172.21.15.92:0/884368578 shutdown_connections 2024-09-11T00:14:12.440 INFO:teuthology.misc.health.smithi092.stderr:2024-09-11T00:14:12.437+0000 7f2c5000f640 1 -- 172.21.15.92:0/884368578 wait complete. 2024-09-11T00:14:12.448 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-09-11T00:14:12.448 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-09-11T00:14:12.449 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-11T00:14:12.449 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-11T00:14:12.451 INFO:tasks.ceph.mds.a:Started 2024-09-11T00:14:12.451 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-11T00:14:12.451 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-11T00:14:12.453 INFO:tasks.ceph.mds.c:Started 2024-09-11T00:14:12.453 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-11T00:14:12.454 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-11T00:14:12.456 INFO:tasks.ceph.mds.b:Started 2024-09-11T00:14:12.457 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-11T00:14:12.457 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-11T00:14:12.459 INFO:tasks.ceph.mds.d:Started 2024-09-11T00:14:12.459 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-09-11T00:14:12.459 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T00:14:12.525 INFO:tasks.ceph.mds.a.smithi092.stdout:starting mds.a at 2024-09-11T00:14:12.526 INFO:tasks.ceph.mds.c.smithi092.stdout:starting mds.c at 2024-09-11T00:14:12.541 INFO:tasks.ceph.mds.d.smithi145.stdout:starting mds.d at 2024-09-11T00:14:12.542 INFO:tasks.ceph.mds.b.smithi145.stdout:starting mds.b at 2024-09-11T00:14:12.566 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:12.564+0000 7f5e181df640 1 -- 172.21.15.92:0/767843970 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5dfc004d90 msgr2=0x7f5dfc005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:12.566 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:12.564+0000 7f5e181df640 1 --2- 172.21.15.92:0/767843970 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5dfc004d90 0x7f5dfc005210 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f5e08001d90 tx=0x7f5dfc005830 comp rx=0 tx=0).stop 2024-09-11T00:14:12.566 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:12.564+0000 7f5e1677c640 1 -- 172.21.15.92:0/767843970 reap_dead start 2024-09-11T00:14:12.566 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:12.564+0000 7f5e181df640 1 -- 172.21.15.92:0/767843970 shutdown_connections 2024-09-11T00:14:12.566 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:12.564+0000 7f5e181df640 1 -- 172.21.15.92:0/767843970 >> 172.21.15.92:0/767843970 conn(0x7f5e100d3f70 msgr2=0x7f5e100d4350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:14:12.566 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:12.564+0000 7f5e181df640 1 -- 172.21.15.92:0/767843970 shutdown_connections 2024-09-11T00:14:12.566 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:12.564+0000 7f5e181df640 1 -- 172.21.15.92:0/767843970 wait complete. 2024-09-11T00:14:12.567 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:12.565+0000 7f5e181df640 1 Processor -- start 2024-09-11T00:14:12.567 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:12.565+0000 7f5e181df640 1 -- start start 2024-09-11T00:14:12.569 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:12.566+0000 7f5e181df640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f5dfc004d90 0x7f5e101f48c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:12.569 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:12.566+0000 7f5e181df640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5e100ce010 0x7f5e10151350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:12.569 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:12.566+0000 7f5e181df640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5e1015f840 0x7f5e1015b250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:12.569 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:12.566+0000 7f5e181df640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f5e100d2660 con 0x7f5e100ce010 2024-09-11T00:14:12.569 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:12.566+0000 7f5e181df640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f5e100d24e0 con 0x7f5e1015f840 2024-09-11T00:14:12.569 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:12.566+0000 7f5e181df640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f5e100d27e0 con 0x7f5dfc004d90 2024-09-11T00:14:12.570 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:12.566+0000 7f5e1577a640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5e100ce010 0x7f5e10151350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:12.570 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:12.566+0000 7f5e1577a640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5e100ce010 0x7f5e10151350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:55248/0 (socket says 172.21.15.92:55248) 2024-09-11T00:14:12.570 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:12.566+0000 7f5e1577a640 1 -- 172.21.15.92:0/3943108078 learned_addr learned my addr 172.21.15.92:0/3943108078 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-11T00:14:12.570 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:12.566+0000 7f5e1677c640 1 --2- 172.21.15.92:0/3943108078 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5e1015f840 0x7f5e1015b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:12.570 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:12.566+0000 7f5e15f7b640 1 --2- 172.21.15.92:0/3943108078 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f5dfc004d90 0x7f5e101f48c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:12.570 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:12.566+0000 7f5e1577a640 1 -- 172.21.15.92:0/3943108078 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f5dfc004d90 msgr2=0x7f5e101f48c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:12.570 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:12.566+0000 7f5e1577a640 1 --2- 172.21.15.92:0/3943108078 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f5dfc004d90 0x7f5e101f48c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:12.570 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:12.566+0000 7f5e1577a640 1 -- 172.21.15.92:0/3943108078 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5e1015f840 msgr2=0x7f5e1015b250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:12.570 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:12.566+0000 7f5e1577a640 1 --2- 172.21.15.92:0/3943108078 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5e1015f840 0x7f5e1015b250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:12.570 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:12.566+0000 7f5e1577a640 1 -- 172.21.15.92:0/3943108078 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e101f4eb0 con 0x7f5e100ce010 2024-09-11T00:14:12.570 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:12.566+0000 7f5e1677c640 1 --2- 172.21.15.92:0/3943108078 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5e1015f840 0x7f5e1015b250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:14:12.570 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:12.567+0000 7f5e1577a640 1 --2- 172.21.15.92:0/3943108078 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5e100ce010 0x7f5e10151350 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f5e00004650 tx=0x7f5e0000ba40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:14:12.570 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:12.567+0000 7f5e067fc640 1 -- 172.21.15.92:0/3943108078 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e00010850 con 0x7f5e100ce010 2024-09-11T00:14:12.570 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:12.567+0000 7f5e067fc640 1 -- 172.21.15.92:0/3943108078 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5e000109f0 con 0x7f5e100ce010 2024-09-11T00:14:12.571 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:12.567+0000 7f5e067fc640 1 -- 172.21.15.92:0/3943108078 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e00010e20 con 0x7f5e100ce010 2024-09-11T00:14:12.571 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:12.567+0000 7f5e181df640 1 -- 172.21.15.92:0/3943108078 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e101f5190 con 0x7f5e100ce010 2024-09-11T00:14:12.571 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:12.567+0000 7f5e181df640 1 -- 172.21.15.92:0/3943108078 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e101f5750 con 0x7f5e100ce010 2024-09-11T00:14:12.572 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:12.568+0000 7f5e181df640 1 -- 172.21.15.92:0/3943108078 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5e100cea40 con 0x7f5e100ce010 2024-09-11T00:14:12.572 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:12.568+0000 7f5e067fc640 1 -- 172.21.15.92:0/3943108078 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f5e00023440 con 0x7f5e100ce010 2024-09-11T00:14:12.572 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:12.569+0000 7f5e067fc640 1 --2- 172.21.15.92:0/3943108078 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f5df4077f70 0x7f5df407a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:12.572 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:12.569+0000 7f5e067fc640 1 -- 172.21.15.92:0/3943108078 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7f5e0009a6f0 con 0x7f5e100ce010 2024-09-11T00:14:12.572 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:12.569+0000 7f5e15f7b640 1 --2- 172.21.15.92:0/3943108078 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f5df4077f70 0x7f5df407a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:12.572 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:12.570+0000 7f5e15f7b640 1 --2- 172.21.15.92:0/3943108078 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f5df4077f70 0x7f5df407a430 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f5e1015c4c0 tx=0x7f5e0c006720 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:14:12.574 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:12.573+0000 7f5e067fc640 1 -- 172.21.15.92:0/3943108078 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f5e00063550 con 0x7f5e100ce010 2024-09-11T00:14:12.784 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:12.782+0000 7f5e181df640 1 -- 172.21.15.92:0/3943108078 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5e1008dfa0 con 0x7f5e100ce010 2024-09-11T00:14:12.784 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:12.783+0000 7f5e067fc640 1 -- 172.21.15.92:0/3943108078 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1434 (secure 0 0 0) 0x7f5e00062e50 con 0x7f5e100ce010 2024-09-11T00:14:12.784 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:14:12.785 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":2,"btime":"2024-09-11T00:14:12:529054+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4356,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6833/3149311196","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":3149311196},{"type":"v1","addr":"172.21.15.92:6833","nonce":3149311196}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-11T00:14:12.785 INFO:teuthology.orchestra.run.smithi092.stderr:dumped fsmap epoch 2 2024-09-11T00:14:12.787 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:12.785+0000 7f5e181df640 1 -- 172.21.15.92:0/3943108078 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f5df4077f70 msgr2=0x7f5df407a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:12.787 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:12.785+0000 7f5e181df640 1 --2- 172.21.15.92:0/3943108078 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f5df4077f70 0x7f5df407a430 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f5e1015c4c0 tx=0x7f5e0c006720 comp rx=0 tx=0).stop 2024-09-11T00:14:12.787 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:12.785+0000 7f5e181df640 1 -- 172.21.15.92:0/3943108078 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5e100ce010 msgr2=0x7f5e10151350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:12.787 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:12.785+0000 7f5e181df640 1 --2- 172.21.15.92:0/3943108078 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5e100ce010 0x7f5e10151350 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f5e00004650 tx=0x7f5e0000ba40 comp rx=0 tx=0).stop 2024-09-11T00:14:12.787 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:12.785+0000 7f5e181df640 1 -- 172.21.15.92:0/3943108078 shutdown_connections 2024-09-11T00:14:12.787 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:12.785+0000 7f5e181df640 1 --2- 172.21.15.92:0/3943108078 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f5df4077f70 0x7f5df407a430 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:12.787 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:12.785+0000 7f5e181df640 1 --2- 172.21.15.92:0/3943108078 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5e1015f840 0x7f5e1015b250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:12.787 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:12.785+0000 7f5e181df640 1 --2- 172.21.15.92:0/3943108078 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5e100ce010 0x7f5e10151350 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:12.787 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:12.785+0000 7f5e181df640 1 --2- 172.21.15.92:0/3943108078 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f5dfc004d90 0x7f5e101f48c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:12.787 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:12.785+0000 7f5e181df640 1 -- 172.21.15.92:0/3943108078 >> 172.21.15.92:0/3943108078 conn(0x7f5e100d3f70 msgr2=0x7f5e100b6f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:14:12.787 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:12.785+0000 7f5e181df640 1 -- 172.21.15.92:0/3943108078 shutdown_connections 2024-09-11T00:14:12.787 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:12.785+0000 7f5e181df640 1 -- 172.21.15.92:0/3943108078 wait complete. 2024-09-11T00:14:14.797 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T00:14:14.913 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:14.911+0000 7f2b65f6b640 1 -- 172.21.15.92:0/2992991100 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2b6006f140 msgr2=0x7f2b6006f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:14.913 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:14.911+0000 7f2b65f6b640 1 --2- 172.21.15.92:0/2992991100 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2b6006f140 0x7f2b6006f5d0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f2b58009830 tx=0x7f2b5802a510 comp rx=0 tx=0).stop 2024-09-11T00:14:14.913 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:14.911+0000 7f2b65f6b640 1 -- 172.21.15.92:0/2992991100 shutdown_connections 2024-09-11T00:14:14.913 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:14.911+0000 7f2b65f6b640 1 --2- 172.21.15.92:0/2992991100 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2b6006f140 0x7f2b6006f5d0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:14.913 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:14.911+0000 7f2b65f6b640 1 --2- 172.21.15.92:0/2992991100 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2b6015c470 0x7f2b6015c8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:14.914 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:14.911+0000 7f2b65f6b640 1 -- 172.21.15.92:0/2992991100 >> 172.21.15.92:0/2992991100 conn(0x7f2b600b1760 msgr2=0x7f2b600b1b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:14:14.914 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:14.911+0000 7f2b65f6b640 1 -- 172.21.15.92:0/2992991100 shutdown_connections 2024-09-11T00:14:14.914 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:14.911+0000 7f2b65f6b640 1 -- 172.21.15.92:0/2992991100 wait complete. 2024-09-11T00:14:14.914 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:14.912+0000 7f2b65f6b640 1 Processor -- start 2024-09-11T00:14:14.914 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:14.913+0000 7f2b65f6b640 1 -- start start 2024-09-11T00:14:14.916 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:14.913+0000 7f2b65f6b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2b6006f140 0x7f2b60131000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:14.916 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:14.913+0000 7f2b65f6b640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2b60073780 0x7f2b60131540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:14.916 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:14.913+0000 7f2b65f6b640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2b6015c470 0x7f2b601f2b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:14.916 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:14.913+0000 7f2b65f6b640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f2b6006fc90 con 0x7f2b6006f140 2024-09-11T00:14:14.916 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:14.913+0000 7f2b65f6b640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f2b6006fb10 con 0x7f2b6015c470 2024-09-11T00:14:14.917 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:14.913+0000 7f2b65f6b640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f2b6006fe10 con 0x7f2b60073780 2024-09-11T00:14:14.917 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:14.913+0000 7f2b5f7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2b6006f140 0x7f2b60131000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:14.917 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:14.914+0000 7f2b5f7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2b6006f140 0x7f2b60131000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:57740/0 (socket says 172.21.15.92:57740) 2024-09-11T00:14:14.917 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:14.914+0000 7f2b5f7fe640 1 -- 172.21.15.92:0/2904861965 learned_addr learned my addr 172.21.15.92:0/2904861965 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-11T00:14:14.917 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:14.914+0000 7f2b5effd640 1 --2- 172.21.15.92:0/2904861965 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2b60073780 0x7f2b60131540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:14.917 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:14.914+0000 7f2b5ffff640 1 --2- 172.21.15.92:0/2904861965 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2b6015c470 0x7f2b601f2b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:14.917 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:14.914+0000 7f2b5f7fe640 1 -- 172.21.15.92:0/2904861965 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2b60073780 msgr2=0x7f2b60131540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:14.917 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:14.914+0000 7f2b5f7fe640 1 --2- 172.21.15.92:0/2904861965 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2b60073780 0x7f2b60131540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:14.917 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:14.914+0000 7f2b5f7fe640 1 -- 172.21.15.92:0/2904861965 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2b6015c470 msgr2=0x7f2b601f2b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:14.918 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:14.914+0000 7f2b5f7fe640 1 --2- 172.21.15.92:0/2904861965 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2b6015c470 0x7f2b601f2b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:14.918 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:14.914+0000 7f2b5f7fe640 1 -- 172.21.15.92:0/2904861965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b601535f0 con 0x7f2b6006f140 2024-09-11T00:14:14.918 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:14.914+0000 7f2b5f7fe640 1 --2- 172.21.15.92:0/2904861965 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2b6006f140 0x7f2b60131000 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f2b5000c7f0 tx=0x7f2b5000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:14:14.918 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:14.914+0000 7f2b47fff640 1 -- 172.21.15.92:0/2904861965 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b50017070 con 0x7f2b6006f140 2024-09-11T00:14:14.918 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:14.914+0000 7f2b47fff640 1 -- 172.21.15.92:0/2904861965 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2b50005070 con 0x7f2b6006f140 2024-09-11T00:14:14.918 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:14.914+0000 7f2b65f6b640 1 -- 172.21.15.92:0/2904861965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b601538d0 con 0x7f2b6006f140 2024-09-11T00:14:14.918 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:14.914+0000 7f2b47fff640 1 -- 172.21.15.92:0/2904861965 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b500054c0 con 0x7f2b6006f140 2024-09-11T00:14:14.918 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:14.914+0000 7f2b65f6b640 1 -- 172.21.15.92:0/2904861965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b60156510 con 0x7f2b6006f140 2024-09-11T00:14:14.919 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:14.915+0000 7f2b65f6b640 1 -- 172.21.15.92:0/2904861965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2b6006f5d0 con 0x7f2b6006f140 2024-09-11T00:14:14.919 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:14.916+0000 7f2b47fff640 1 -- 172.21.15.92:0/2904861965 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f2b50005660 con 0x7f2b6006f140 2024-09-11T00:14:14.919 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:14.916+0000 7f2b47fff640 1 --2- 172.21.15.92:0/2904861965 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f2b4c077f70 0x7f2b4c07a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:14.919 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:14.917+0000 7f2b47fff640 1 -- 172.21.15.92:0/2904861965 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7f2b50099340 con 0x7f2b6006f140 2024-09-11T00:14:14.919 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:14.917+0000 7f2b5effd640 1 --2- 172.21.15.92:0/2904861965 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f2b4c077f70 0x7f2b4c07a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:14.919 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:14.917+0000 7f2b5effd640 1 --2- 172.21.15.92:0/2904861965 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f2b4c077f70 0x7f2b4c07a430 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f2b600cd1c0 tx=0x7f2b54009060 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:14:14.922 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:14.921+0000 7f2b47fff640 1 -- 172.21.15.92:0/2904861965 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f2b50061b40 con 0x7f2b6006f140 2024-09-11T00:14:15.132 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:15.131+0000 7f2b65f6b640 1 -- 172.21.15.92:0/2904861965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2b600cd6d0 con 0x7f2b6006f140 2024-09-11T00:14:15.133 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:15.132+0000 7f2b47fff640 1 -- 172.21.15.92:0/2904861965 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+3912 (secure 0 0 0) 0x7f2b50066570 con 0x7f2b6006f140 2024-09-11T00:14:15.133 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:14:15.133 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":3,"btime":"2024-09-11T00:14:13:530026+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4286,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/2051794804","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":2051794804},{"type":"v1","addr":"172.21.15.92:6835","nonce":2051794804}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4295,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6835/1341143168","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6834","nonce":1341143168},{"type":"v1","addr":"172.21.15.145:6835","nonce":1341143168}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4356,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6833/3149311196","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":3149311196},{"type":"v1","addr":"172.21.15.92:6833","nonce":3149311196}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4374,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6837/3236563974","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6836","nonce":3236563974},{"type":"v1","addr":"172.21.15.145:6837","nonce":3236563974}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-09-11T00:14:15.134 INFO:teuthology.orchestra.run.smithi092.stderr:dumped fsmap epoch 3 2024-09-11T00:14:15.136 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:15.134+0000 7f2b65f6b640 1 -- 172.21.15.92:0/2904861965 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f2b4c077f70 msgr2=0x7f2b4c07a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:15.137 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:15.134+0000 7f2b65f6b640 1 --2- 172.21.15.92:0/2904861965 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f2b4c077f70 0x7f2b4c07a430 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f2b600cd1c0 tx=0x7f2b54009060 comp rx=0 tx=0).stop 2024-09-11T00:14:15.137 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:15.134+0000 7f2b65f6b640 1 -- 172.21.15.92:0/2904861965 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2b6006f140 msgr2=0x7f2b60131000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:15.137 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:15.134+0000 7f2b65f6b640 1 --2- 172.21.15.92:0/2904861965 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2b6006f140 0x7f2b60131000 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f2b5000c7f0 tx=0x7f2b5000ccb0 comp rx=0 tx=0).stop 2024-09-11T00:14:15.137 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:15.134+0000 7f2b65f6b640 1 -- 172.21.15.92:0/2904861965 shutdown_connections 2024-09-11T00:14:15.137 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:15.134+0000 7f2b65f6b640 1 --2- 172.21.15.92:0/2904861965 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f2b4c077f70 0x7f2b4c07a430 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:15.137 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:15.134+0000 7f2b65f6b640 1 --2- 172.21.15.92:0/2904861965 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2b6015c470 0x7f2b601f2b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:15.137 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:15.134+0000 7f2b65f6b640 1 --2- 172.21.15.92:0/2904861965 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2b60073780 0x7f2b60131540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:15.137 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:15.134+0000 7f2b65f6b640 1 --2- 172.21.15.92:0/2904861965 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2b6006f140 0x7f2b60131000 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:15.137 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:15.134+0000 7f2b65f6b640 1 -- 172.21.15.92:0/2904861965 >> 172.21.15.92:0/2904861965 conn(0x7f2b600b1760 msgr2=0x7f2b600b1b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:14:15.137 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:15.134+0000 7f2b65f6b640 1 -- 172.21.15.92:0/2904861965 shutdown_connections 2024-09-11T00:14:15.137 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:15.134+0000 7f2b65f6b640 1 -- 172.21.15.92:0/2904861965 wait complete. 2024-09-11T00:14:15.147 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-11T00:14:15.247 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:15.245+0000 7f808e5e8640 1 -- 172.21.15.92:0/2054816995 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f80880b0d50 msgr2=0x7f80880cfda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:15.248 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:15.245+0000 7f808e5e8640 1 --2- 172.21.15.92:0/2054816995 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f80880b0d50 0x7f80880cfda0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f80880738d0 tx=0x7f807c02a560 comp rx=0 tx=0).stop 2024-09-11T00:14:15.248 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:15.245+0000 7f808e5e8640 1 -- 172.21.15.92:0/2054816995 shutdown_connections 2024-09-11T00:14:15.248 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:15.245+0000 7f808e5e8640 1 --2- 172.21.15.92:0/2054816995 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f80880b0d50 0x7f80880cfda0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:15.248 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:15.245+0000 7f808e5e8640 1 --2- 172.21.15.92:0/2054816995 >> v2:172.21.15.145:3300/0 conn(0x7f8088160530 0x7f80880cf860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:15.248 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:15.245+0000 7f808e5e8640 1 -- 172.21.15.92:0/2054816995 >> 172.21.15.92:0/2054816995 conn(0x7f80880b37c0 msgr2=0x7f80880b3bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:14:15.248 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:15.245+0000 7f808e5e8640 1 -- 172.21.15.92:0/2054816995 shutdown_connections 2024-09-11T00:14:15.248 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:15.245+0000 7f808e5e8640 1 -- 172.21.15.92:0/2054816995 wait complete. 2024-09-11T00:14:15.250 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:15.247+0000 7f808e5e8640 1 Processor -- start 2024-09-11T00:14:15.250 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:15.247+0000 7f808e5e8640 1 -- start start 2024-09-11T00:14:15.250 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:15.247+0000 7f808e5e8640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f80880b1280 0x7f80880c8380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:15.250 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:15.247+0000 7f808e5e8640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8088160530 0x7f80880c5f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:15.250 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:15.247+0000 7f808e5e8640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f80880c5ab0 0x7f808815bff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:15.250 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:15.247+0000 7f808e5e8640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f80880b05c0 con 0x7f8088160530 2024-09-11T00:14:15.250 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:15.247+0000 7f808e5e8640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f80880b34f0 con 0x7f80880b1280 2024-09-11T00:14:15.251 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:15.247+0000 7f808e5e8640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f80880b0740 con 0x7f80880c5ab0 2024-09-11T00:14:15.251 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:15.248+0000 7f80877fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8088160530 0x7f80880c5f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:15.251 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:15.248+0000 7f80877fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8088160530 0x7f80880c5f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:57750/0 (socket says 172.21.15.92:57750) 2024-09-11T00:14:15.251 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:15.248+0000 7f80877fe640 1 -- 172.21.15.92:0/482593583 learned_addr learned my addr 172.21.15.92:0/482593583 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-11T00:14:15.251 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:15.248+0000 7f8087fff640 1 --2- 172.21.15.92:0/482593583 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f80880b1280 0x7f80880c8380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:15.251 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:15.248+0000 7f808cb85640 1 --2- 172.21.15.92:0/482593583 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f80880c5ab0 0x7f808815bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:15.251 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:15.248+0000 7f80877fe640 1 -- 172.21.15.92:0/482593583 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f80880c5ab0 msgr2=0x7f808815bff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:15.251 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:15.248+0000 7f80877fe640 1 --2- 172.21.15.92:0/482593583 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f80880c5ab0 0x7f808815bff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:15.251 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:15.248+0000 7f80877fe640 1 -- 172.21.15.92:0/482593583 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f80880b1280 msgr2=0x7f80880c8380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:15.251 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:15.248+0000 7f80877fe640 1 --2- 172.21.15.92:0/482593583 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f80880b1280 0x7f80880c8380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:15.251 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:15.248+0000 7f80877fe640 1 -- 172.21.15.92:0/482593583 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80880c6900 con 0x7f8088160530 2024-09-11T00:14:15.251 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:15.248+0000 7f808cb85640 1 --2- 172.21.15.92:0/482593583 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f80880c5ab0 0x7f808815bff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:14:15.252 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:15.248+0000 7f80877fe640 1 --2- 172.21.15.92:0/482593583 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8088160530 0x7f80880c5f90 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f807c009850 tx=0x7f807c0039e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:14:15.252 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:15.248+0000 7f8084ff9640 1 -- 172.21.15.92:0/482593583 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f807c03f070 con 0x7f8088160530 2024-09-11T00:14:15.252 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:15.248+0000 7f8084ff9640 1 -- 172.21.15.92:0/482593583 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f807c004890 con 0x7f8088160530 2024-09-11T00:14:15.252 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:15.248+0000 7f808e5e8640 1 -- 172.21.15.92:0/482593583 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f80881f2ac0 con 0x7f8088160530 2024-09-11T00:14:15.252 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:15.248+0000 7f8084ff9640 1 -- 172.21.15.92:0/482593583 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f807c035030 con 0x7f8088160530 2024-09-11T00:14:15.252 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:15.248+0000 7f808e5e8640 1 -- 172.21.15.92:0/482593583 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f80881f3080 con 0x7f8088160530 2024-09-11T00:14:15.253 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:15.249+0000 7f808e5e8640 1 -- 172.21.15.92:0/482593583 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f80880b1ed0 con 0x7f8088160530 2024-09-11T00:14:15.253 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:15.250+0000 7f8084ff9640 1 -- 172.21.15.92:0/482593583 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f807c004ca0 con 0x7f8088160530 2024-09-11T00:14:15.253 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:15.250+0000 7f8084ff9640 1 --2- 172.21.15.92:0/482593583 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f8074077f70 0x7f807407a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:15.253 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:15.250+0000 7f8084ff9640 1 -- 172.21.15.92:0/482593583 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7f807c0bad00 con 0x7f8088160530 2024-09-11T00:14:15.253 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:15.251+0000 7f8087fff640 1 --2- 172.21.15.92:0/482593583 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f8074077f70 0x7f807407a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:15.253 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:15.251+0000 7f8087fff640 1 --2- 172.21.15.92:0/482593583 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f8074077f70 0x7f807407a430 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f80780058c0 tx=0x7f807800c440 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:14:15.256 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:15.254+0000 7f8084ff9640 1 -- 172.21.15.92:0/482593583 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f807c083b50 con 0x7f8088160530 2024-09-11T00:14:15.433 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:15.431+0000 7f808e5e8640 1 -- 172.21.15.92:0/482593583 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f80880b7c10 con 0x7f8088160530 2024-09-11T00:14:15.433 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:15.432+0000 7f8084ff9640 1 -- 172.21.15.92:0/482593583 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v17) ==== 84+0+65 (secure 0 0 0) 0x7f807c083450 con 0x7f8088160530 2024-09-11T00:14:15.434 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:14:15.434 INFO:teuthology.orchestra.run.smithi092.stdout:[ 2024-09-11T00:14:15.434 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-11T00:14:15.434 INFO:teuthology.orchestra.run.smithi092.stdout: "poolnum": 1, 2024-09-11T00:14:15.434 INFO:teuthology.orchestra.run.smithi092.stdout: "poolname": ".mgr" 2024-09-11T00:14:15.434 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-11T00:14:15.434 INFO:teuthology.orchestra.run.smithi092.stdout:] 2024-09-11T00:14:15.436 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:15.434+0000 7f808e5e8640 1 -- 172.21.15.92:0/482593583 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f8074077f70 msgr2=0x7f807407a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:15.436 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:15.434+0000 7f808e5e8640 1 --2- 172.21.15.92:0/482593583 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f8074077f70 0x7f807407a430 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f80780058c0 tx=0x7f807800c440 comp rx=0 tx=0).stop 2024-09-11T00:14:15.436 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:15.434+0000 7f808e5e8640 1 -- 172.21.15.92:0/482593583 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8088160530 msgr2=0x7f80880c5f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:15.436 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:15.434+0000 7f808e5e8640 1 --2- 172.21.15.92:0/482593583 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8088160530 0x7f80880c5f90 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f807c009850 tx=0x7f807c0039e0 comp rx=0 tx=0).stop 2024-09-11T00:14:15.436 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:15.434+0000 7f808e5e8640 1 -- 172.21.15.92:0/482593583 shutdown_connections 2024-09-11T00:14:15.436 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:15.434+0000 7f808e5e8640 1 --2- 172.21.15.92:0/482593583 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f8074077f70 0x7f807407a430 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:15.436 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:15.434+0000 7f808e5e8640 1 --2- 172.21.15.92:0/482593583 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f80880c5ab0 0x7f808815bff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:15.436 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:15.434+0000 7f808e5e8640 1 --2- 172.21.15.92:0/482593583 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8088160530 0x7f80880c5f90 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:15.436 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:15.434+0000 7f808e5e8640 1 --2- 172.21.15.92:0/482593583 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f80880b1280 0x7f80880c8380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:15.436 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:15.434+0000 7f808e5e8640 1 -- 172.21.15.92:0/482593583 >> 172.21.15.92:0/482593583 conn(0x7f80880b37c0 msgr2=0x7f808815ebc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:14:15.437 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:15.434+0000 7f808e5e8640 1 -- 172.21.15.92:0/482593583 shutdown_connections 2024-09-11T00:14:15.437 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:15.434+0000 7f808e5e8640 1 -- 172.21.15.92:0/482593583 wait complete. 2024-09-11T00:14:15.446 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-11T00:14:15.446 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-11T00:14:15.552 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:15.550+0000 7ff2b73a0640 1 -- 172.21.15.92:0/4285530684 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff2b0160530 msgr2=0x7ff2b00cf860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:15.552 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:15.550+0000 7ff2b73a0640 1 --2- 172.21.15.92:0/4285530684 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff2b0160530 0x7ff2b00cf860 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7ff2a0005fd0 tx=0x7ff2a002a820 comp rx=0 tx=0).stop 2024-09-11T00:14:15.552 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:15.550+0000 7ff2b73a0640 1 -- 172.21.15.92:0/4285530684 shutdown_connections 2024-09-11T00:14:15.552 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:15.550+0000 7ff2b73a0640 1 --2- 172.21.15.92:0/4285530684 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff2b0160530 0x7ff2b00cf860 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:15.552 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:15.550+0000 7ff2b73a0640 1 -- 172.21.15.92:0/4285530684 >> 172.21.15.92:0/4285530684 conn(0x7ff2b00b37c0 msgr2=0x7ff2b00b3bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:14:15.552 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:15.550+0000 7ff2b73a0640 1 -- 172.21.15.92:0/4285530684 shutdown_connections 2024-09-11T00:14:15.552 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:15.550+0000 7ff2b73a0640 1 -- 172.21.15.92:0/4285530684 wait complete. 2024-09-11T00:14:15.553 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:15.551+0000 7ff2b73a0640 1 Processor -- start 2024-09-11T00:14:15.553 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:15.551+0000 7ff2b73a0640 1 -- start start 2024-09-11T00:14:15.555 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:15.552+0000 7ff2b73a0640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff2b00b05c0 0x7ff2b01501a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:15.555 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:15.552+0000 7ff2b73a0640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff2b0160530 0x7ff2b00c55d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:15.555 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:15.552+0000 7ff2b73a0640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff2b00c8d60 0x7ff2b00b65a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:15.555 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:15.552+0000 7ff2b73a0640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7ff2b00cfda0 con 0x7ff2b00b05c0 2024-09-11T00:14:15.555 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:15.552+0000 7ff2b73a0640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7ff2b00b22b0 con 0x7ff2b0160530 2024-09-11T00:14:15.555 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:15.552+0000 7ff2b73a0640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7ff2b00cff20 con 0x7ff2b00c8d60 2024-09-11T00:14:15.555 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:15.552+0000 7ff2b513c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff2b00b05c0 0x7ff2b01501a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:15.555 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:15.552+0000 7ff2b513c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff2b00b05c0 0x7ff2b01501a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:57768/0 (socket says 172.21.15.92:57768) 2024-09-11T00:14:15.555 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:15.552+0000 7ff2b513c640 1 -- 172.21.15.92:0/2514351111 learned_addr learned my addr 172.21.15.92:0/2514351111 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-11T00:14:15.555 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:15.552+0000 7ff2b513c640 1 -- 172.21.15.92:0/2514351111 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff2b00c8d60 msgr2=0x7ff2b00b65a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:15.555 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:15.552+0000 7ff2b513c640 1 --2- 172.21.15.92:0/2514351111 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff2b00c8d60 0x7ff2b00b65a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:15.555 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:15.552+0000 7ff2b513c640 1 -- 172.21.15.92:0/2514351111 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff2b0160530 msgr2=0x7ff2b00c55d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:15.556 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:15.552+0000 7ff2b513c640 1 --2- 172.21.15.92:0/2514351111 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff2b0160530 0x7ff2b00c55d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:15.556 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:15.552+0000 7ff2b513c640 1 -- 172.21.15.92:0/2514351111 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2b00c9240 con 0x7ff2b00b05c0 2024-09-11T00:14:15.556 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:15.552+0000 7ff2b513c640 1 --2- 172.21.15.92:0/2514351111 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff2b00b05c0 0x7ff2b01501a0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7ff2a0035040 tx=0x7ff2a0032c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:14:15.556 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:15.553+0000 7ff2adffb640 1 -- 172.21.15.92:0/2514351111 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2a0037040 con 0x7ff2b00b05c0 2024-09-11T00:14:15.556 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:15.553+0000 7ff2adffb640 1 -- 172.21.15.92:0/2514351111 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff2a0042070 con 0x7ff2b00b05c0 2024-09-11T00:14:15.556 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:15.553+0000 7ff2b73a0640 1 -- 172.21.15.92:0/2514351111 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2b00c9520 con 0x7ff2b00b05c0 2024-09-11T00:14:15.556 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:15.553+0000 7ff2adffb640 1 -- 172.21.15.92:0/2514351111 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2a00042a0 con 0x7ff2b00b05c0 2024-09-11T00:14:15.556 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:15.553+0000 7ff2b73a0640 1 -- 172.21.15.92:0/2514351111 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2b00c9ae0 con 0x7ff2b00b05c0 2024-09-11T00:14:15.557 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:15.554+0000 7ff2b73a0640 1 -- 172.21.15.92:0/2514351111 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff2b00cf860 con 0x7ff2b00b05c0 2024-09-11T00:14:15.557 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:15.554+0000 7ff2adffb640 1 -- 172.21.15.92:0/2514351111 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7ff2a003a030 con 0x7ff2b00b05c0 2024-09-11T00:14:15.557 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:15.555+0000 7ff2adffb640 1 --2- 172.21.15.92:0/2514351111 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7ff29c077fa0 0x7ff29c07a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:15.557 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:15.555+0000 7ff2adffb640 1 -- 172.21.15.92:0/2514351111 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7ff2a00ba470 con 0x7ff2b00b05c0 2024-09-11T00:14:15.557 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:15.555+0000 7ff2b493b640 1 --2- 172.21.15.92:0/2514351111 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7ff29c077fa0 0x7ff29c07a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:15.557 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:15.555+0000 7ff2b493b640 1 --2- 172.21.15.92:0/2514351111 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7ff29c077fa0 0x7ff29c07a460 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7ff2b015d2d0 tx=0x7ff2a40079d0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:14:15.560 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:15.559+0000 7ff2adffb640 1 -- 172.21.15.92:0/2514351111 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7ff2a0083350 con 0x7ff2b00b05c0 2024-09-11T00:14:15.737 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:15.735+0000 7ff2b73a0640 1 -- 172.21.15.92:0/2514351111 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7ff2b00b4590 con 0x7ff2b00b05c0 2024-09-11T00:14:15.975 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T00:14:15.977 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T00:14:16.607 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:16.605+0000 7ff2adffb640 1 -- 172.21.15.92:0/2514351111 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v18) ==== 138+0+0 (secure 0 0 0) 0x7ff2a0082c50 con 0x7ff2b00b05c0 2024-09-11T00:14:16.607 INFO:teuthology.orchestra.run.smithi092.stderr:pool 'cephfs_metadata' created 2024-09-11T00:14:16.610 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:16.609+0000 7ff2b73a0640 1 -- 172.21.15.92:0/2514351111 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7ff29c077fa0 msgr2=0x7ff29c07a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:16.610 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:16.609+0000 7ff2b73a0640 1 --2- 172.21.15.92:0/2514351111 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7ff29c077fa0 0x7ff29c07a460 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7ff2b015d2d0 tx=0x7ff2a40079d0 comp rx=0 tx=0).stop 2024-09-11T00:14:16.610 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:16.609+0000 7ff2b73a0640 1 -- 172.21.15.92:0/2514351111 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff2b00b05c0 msgr2=0x7ff2b01501a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:16.610 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:16.609+0000 7ff2b73a0640 1 --2- 172.21.15.92:0/2514351111 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff2b00b05c0 0x7ff2b01501a0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7ff2a0035040 tx=0x7ff2a0032c90 comp rx=0 tx=0).stop 2024-09-11T00:14:16.610 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:16.609+0000 7ff2b73a0640 1 -- 172.21.15.92:0/2514351111 shutdown_connections 2024-09-11T00:14:16.611 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:16.609+0000 7ff2b73a0640 1 --2- 172.21.15.92:0/2514351111 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7ff29c077fa0 0x7ff29c07a460 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:16.611 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:16.609+0000 7ff2b73a0640 1 --2- 172.21.15.92:0/2514351111 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff2b00c8d60 0x7ff2b00b65a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:16.611 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:16.609+0000 7ff2b73a0640 1 --2- 172.21.15.92:0/2514351111 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff2b0160530 0x7ff2b00c55d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:16.611 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:16.609+0000 7ff2b73a0640 1 --2- 172.21.15.92:0/2514351111 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff2b00b05c0 0x7ff2b01501a0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:16.611 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:16.609+0000 7ff2b73a0640 1 -- 172.21.15.92:0/2514351111 >> 172.21.15.92:0/2514351111 conn(0x7ff2b00b37c0 msgr2=0x7ff2b00b1260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:14:16.611 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:16.610+0000 7ff2b73a0640 1 -- 172.21.15.92:0/2514351111 shutdown_connections 2024-09-11T00:14:16.611 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:16.610+0000 7ff2b73a0640 1 -- 172.21.15.92:0/2514351111 wait complete. 2024-09-11T00:14:16.626 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2024-09-11T00:14:16.736 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:16.734+0000 7fcbb50a9640 1 -- 172.21.15.92:0/883367926 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcb9c004e60 msgr2=0x7fcb9c00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:16.736 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:16.734+0000 7fcbb50a9640 1 --2- 172.21.15.92:0/883367926 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcb9c004e60 0x7fcb9c00b9c0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fcba800c640 tx=0x7fcb9c005830 comp rx=0 tx=0).stop 2024-09-11T00:14:16.736 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:16.734+0000 7fcbaf59e640 1 -- 172.21.15.92:0/883367926 reap_dead start 2024-09-11T00:14:16.736 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:16.734+0000 7fcbb50a9640 1 -- 172.21.15.92:0/883367926 shutdown_connections 2024-09-11T00:14:16.736 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:16.734+0000 7fcbb50a9640 1 -- 172.21.15.92:0/883367926 >> 172.21.15.92:0/883367926 conn(0x7fcbb0074150 msgr2=0x7fcbb0074560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:14:16.736 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:16.734+0000 7fcbb50a9640 1 -- 172.21.15.92:0/883367926 shutdown_connections 2024-09-11T00:14:16.736 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:16.734+0000 7fcbb50a9640 1 -- 172.21.15.92:0/883367926 wait complete. 2024-09-11T00:14:16.737 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:16.735+0000 7fcbb50a9640 1 Processor -- start 2024-09-11T00:14:16.737 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:16.735+0000 7fcbb50a9640 1 -- start start 2024-09-11T00:14:16.739 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:16.736+0000 7fcbb50a9640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fcb9c004e60 0x7fcbb0099840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:16.739 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:16.736+0000 7fcbb50a9640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcbb014cb50 0x7fcbb00c9600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:16.739 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:16.736+0000 7fcbb50a9640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fcbb014cfd0 0x7fcbb00c9b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:16.739 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:16.736+0000 7fcbb50a9640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fcbb00b1740 con 0x7fcbb014cb50 2024-09-11T00:14:16.739 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:16.736+0000 7fcbb50a9640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fcbb00b6230 con 0x7fcbb014cfd0 2024-09-11T00:14:16.739 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:16.736+0000 7fcbb50a9640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7fcbb00b18c0 con 0x7fcb9c004e60 2024-09-11T00:14:16.739 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:16.736+0000 7fcba7fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcbb014cb50 0x7fcbb00c9600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:16.739 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:16.736+0000 7fcba7fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcbb014cb50 0x7fcbb00c9600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:57788/0 (socket says 172.21.15.92:57788) 2024-09-11T00:14:16.740 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:16.736+0000 7fcba7fff640 1 -- 172.21.15.92:0/3776634311 learned_addr learned my addr 172.21.15.92:0/3776634311 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-11T00:14:16.740 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:16.736+0000 7fcbaed9d640 1 --2- 172.21.15.92:0/3776634311 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fcb9c004e60 0x7fcbb0099840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:16.740 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:16.736+0000 7fcbaf59e640 1 --2- 172.21.15.92:0/3776634311 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fcbb014cfd0 0x7fcbb00c9b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:16.740 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:16.736+0000 7fcba7fff640 1 -- 172.21.15.92:0/3776634311 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fcb9c004e60 msgr2=0x7fcbb0099840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:16.740 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:16.736+0000 7fcba7fff640 1 --2- 172.21.15.92:0/3776634311 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fcb9c004e60 0x7fcbb0099840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:16.740 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:16.736+0000 7fcba7fff640 1 -- 172.21.15.92:0/3776634311 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fcbb014cfd0 msgr2=0x7fcbb00c9b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:16.740 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:16.736+0000 7fcba7fff640 1 --2- 172.21.15.92:0/3776634311 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fcbb014cfd0 0x7fcbb00c9b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:16.740 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:16.736+0000 7fcba7fff640 1 -- 172.21.15.92:0/3776634311 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcbb015b980 con 0x7fcbb014cb50 2024-09-11T00:14:16.740 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:16.737+0000 7fcba7fff640 1 --2- 172.21.15.92:0/3776634311 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcbb014cb50 0x7fcbb00c9600 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fcb98003fb0 tx=0x7fcb98001630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:14:16.740 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:16.737+0000 7fcba77fe640 1 -- 172.21.15.92:0/3776634311 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb98011840 con 0x7fcbb014cb50 2024-09-11T00:14:16.740 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:16.737+0000 7fcba77fe640 1 -- 172.21.15.92:0/3776634311 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcb980119e0 con 0x7fcbb014cb50 2024-09-11T00:14:16.740 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:16.737+0000 7fcbb50a9640 1 -- 172.21.15.92:0/3776634311 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcbb015bbf0 con 0x7fcbb014cb50 2024-09-11T00:14:16.741 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:16.737+0000 7fcba77fe640 1 -- 172.21.15.92:0/3776634311 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb98011e10 con 0x7fcbb014cb50 2024-09-11T00:14:16.741 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:16.737+0000 7fcbb50a9640 1 -- 172.21.15.92:0/3776634311 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcbb015c1b0 con 0x7fcbb014cb50 2024-09-11T00:14:16.741 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:16.738+0000 7fcbb50a9640 1 -- 172.21.15.92:0/3776634311 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcbb00ca970 con 0x7fcbb014cb50 2024-09-11T00:14:16.741 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:16.738+0000 7fcba77fe640 1 -- 172.21.15.92:0/3776634311 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fcb98022060 con 0x7fcbb014cb50 2024-09-11T00:14:16.742 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:16.739+0000 7fcba77fe640 1 --2- 172.21.15.92:0/3776634311 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7fcb90077f70 0x7fcb9007a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:16.742 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:16.739+0000 7fcba77fe640 1 -- 172.21.15.92:0/3776634311 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 5227+0+0 (secure 0 0 0) 0x7fcb9809a3d0 con 0x7fcbb014cb50 2024-09-11T00:14:16.742 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:16.739+0000 7fcbaed9d640 1 --2- 172.21.15.92:0/3776634311 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7fcb90077f70 0x7fcb9007a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:16.742 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:16.740+0000 7fcbaed9d640 1 --2- 172.21.15.92:0/3776634311 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7fcb90077f70 0x7fcb9007a430 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fcba0009c50 tx=0x7fcba0005f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:14:16.745 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:16.744+0000 7fcba77fe640 1 -- 172.21.15.92:0/3776634311 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fcb98063140 con 0x7fcbb014cb50 2024-09-11T00:14:16.922 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:16.921+0000 7fcbb50a9640 1 -- 172.21.15.92:0/3776634311 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) -- 0x7fcbb00cefe0 con 0x7fcbb014cb50 2024-09-11T00:14:17.612 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:17.610+0000 7fcba77fe640 1 -- 172.21.15.92:0/3776634311 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v19) ==== 171+0+0 (secure 0 0 0) 0x7fcb98062a40 con 0x7fcbb014cb50 2024-09-11T00:14:17.612 INFO:teuthology.orchestra.run.smithi092.stderr:pool 'cephfs_data' created 2024-09-11T00:14:17.617 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:17.615+0000 7fcbb50a9640 1 -- 172.21.15.92:0/3776634311 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7fcb90077f70 msgr2=0x7fcb9007a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:17.617 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:17.615+0000 7fcbb50a9640 1 --2- 172.21.15.92:0/3776634311 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7fcb90077f70 0x7fcb9007a430 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fcba0009c50 tx=0x7fcba0005f90 comp rx=0 tx=0).stop 2024-09-11T00:14:17.617 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:17.615+0000 7fcbb50a9640 1 -- 172.21.15.92:0/3776634311 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcbb014cb50 msgr2=0x7fcbb00c9600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:17.617 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:17.615+0000 7fcbb50a9640 1 --2- 172.21.15.92:0/3776634311 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcbb014cb50 0x7fcbb00c9600 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fcb98003fb0 tx=0x7fcb98001630 comp rx=0 tx=0).stop 2024-09-11T00:14:17.617 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:17.615+0000 7fcbb50a9640 1 -- 172.21.15.92:0/3776634311 shutdown_connections 2024-09-11T00:14:17.617 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:17.615+0000 7fcbb50a9640 1 --2- 172.21.15.92:0/3776634311 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7fcb90077f70 0x7fcb9007a430 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:17.617 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:17.615+0000 7fcbb50a9640 1 --2- 172.21.15.92:0/3776634311 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fcbb014cfd0 0x7fcbb00c9b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:17.617 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:17.615+0000 7fcbb50a9640 1 --2- 172.21.15.92:0/3776634311 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcbb014cb50 0x7fcbb00c9600 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:17.617 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:17.615+0000 7fcbb50a9640 1 --2- 172.21.15.92:0/3776634311 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fcb9c004e60 0x7fcbb0099840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:17.617 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:17.615+0000 7fcbb50a9640 1 -- 172.21.15.92:0/3776634311 >> 172.21.15.92:0/3776634311 conn(0x7fcbb0074150 msgr2=0x7fcbb00cf520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:14:17.617 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:17.615+0000 7fcbb50a9640 1 -- 172.21.15.92:0/3776634311 shutdown_connections 2024-09-11T00:14:17.618 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:17.615+0000 7fcbb50a9640 1 -- 172.21.15.92:0/3776634311 wait complete. 2024-09-11T00:14:17.639 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-11T00:14:17.749 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:17.747+0000 7f0a84f3d640 1 -- 172.21.15.92:0/2813331724 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f0a80073780 msgr2=0x7f0a80073b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:17.749 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:17.747+0000 7f0a84f3d640 1 --2- 172.21.15.92:0/2813331724 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f0a80073780 0x7f0a80073b60 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f0a70005fd0 tx=0x7f0a7002aa90 comp rx=0 tx=0).stop 2024-09-11T00:14:17.749 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:17.747+0000 7f0a84f3d640 1 -- 172.21.15.92:0/2813331724 shutdown_connections 2024-09-11T00:14:17.749 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:17.747+0000 7f0a84f3d640 1 --2- 172.21.15.92:0/2813331724 >> v2:172.21.15.145:3300/0 conn(0x7f0a8006f140 0x7f0a8006f5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:17.749 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:17.747+0000 7f0a84f3d640 1 --2- 172.21.15.92:0/2813331724 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f0a80073780 0x7f0a80073b60 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:17.749 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:17.747+0000 7f0a84f3d640 1 -- 172.21.15.92:0/2813331724 >> 172.21.15.92:0/2813331724 conn(0x7f0a800b1760 msgr2=0x7f0a800b1b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:14:17.749 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:17.747+0000 7f0a84f3d640 1 -- 172.21.15.92:0/2813331724 shutdown_connections 2024-09-11T00:14:17.749 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:17.747+0000 7f0a84f3d640 1 -- 172.21.15.92:0/2813331724 wait complete. 2024-09-11T00:14:17.752 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:17.748+0000 7f0a84f3d640 1 Processor -- start 2024-09-11T00:14:17.752 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:17.748+0000 7f0a84f3d640 1 -- start start 2024-09-11T00:14:17.752 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:17.749+0000 7f0a84f3d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0a8006f140 0x7f0a801f81c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:17.753 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:17.749+0000 7f0a84f3d640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f0a80073780 0x7f0a801f5470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:17.753 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:17.749+0000 7f0a84f3d640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0a8015c470 0x7f0a8015af10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:17.753 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:17.749+0000 7f0a84f3d640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f0a8006fcb0 con 0x7f0a8006f140 2024-09-11T00:14:17.753 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:17.749+0000 7f0a84f3d640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f0a8006fb30 con 0x7f0a8015c470 2024-09-11T00:14:17.753 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:17.749+0000 7f0a84f3d640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f0a8006fe30 con 0x7f0a80073780 2024-09-11T00:14:17.753 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:17.749+0000 7f0a7e59c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0a8006f140 0x7f0a801f81c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:17.753 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:17.749+0000 7f0a7e59c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0a8006f140 0x7f0a801f81c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:57802/0 (socket says 172.21.15.92:57802) 2024-09-11T00:14:17.753 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:17.749+0000 7f0a7e59c640 1 -- 172.21.15.92:0/902906207 learned_addr learned my addr 172.21.15.92:0/902906207 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-11T00:14:17.753 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:17.749+0000 7f0a7ed9d640 1 --2- 172.21.15.92:0/902906207 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0a8015c470 0x7f0a8015af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:17.754 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:17.749+0000 7f0a7dd9b640 1 --2- 172.21.15.92:0/902906207 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f0a80073780 0x7f0a801f5470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:17.754 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:17.749+0000 7f0a7e59c640 1 -- 172.21.15.92:0/902906207 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f0a80073780 msgr2=0x7f0a801f5470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:17.754 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:17.749+0000 7f0a7e59c640 1 --2- 172.21.15.92:0/902906207 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f0a80073780 0x7f0a801f5470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:17.754 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:17.749+0000 7f0a7e59c640 1 -- 172.21.15.92:0/902906207 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0a8015c470 msgr2=0x7f0a8015af10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:17.754 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:17.749+0000 7f0a7e59c640 1 --2- 172.21.15.92:0/902906207 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0a8015c470 0x7f0a8015af10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:17.754 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:17.749+0000 7f0a7e59c640 1 -- 172.21.15.92:0/902906207 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a801f4ce0 con 0x7f0a8006f140 2024-09-11T00:14:17.754 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:17.749+0000 7f0a7ed9d640 1 --2- 172.21.15.92:0/902906207 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0a8015c470 0x7f0a8015af10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:14:17.754 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:17.749+0000 7f0a7dd9b640 1 --2- 172.21.15.92:0/902906207 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f0a80073780 0x7f0a801f5470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:14:17.754 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:17.750+0000 7f0a7e59c640 1 --2- 172.21.15.92:0/902906207 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0a8006f140 0x7f0a801f81c0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f0a70006010 tx=0x7f0a70003ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:14:17.754 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:17.750+0000 7f0a76ffd640 1 -- 172.21.15.92:0/902906207 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a70046070 con 0x7f0a8006f140 2024-09-11T00:14:17.755 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:17.750+0000 7f0a76ffd640 1 -- 172.21.15.92:0/902906207 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0a70004250 con 0x7f0a8006f140 2024-09-11T00:14:17.755 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:17.750+0000 7f0a84f3d640 1 -- 172.21.15.92:0/902906207 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0a801f89f0 con 0x7f0a8006f140 2024-09-11T00:14:17.755 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:17.750+0000 7f0a76ffd640 1 -- 172.21.15.92:0/902906207 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a70004680 con 0x7f0a8006f140 2024-09-11T00:14:17.755 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:17.750+0000 7f0a84f3d640 1 -- 172.21.15.92:0/902906207 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0a801f4f50 con 0x7f0a8006f140 2024-09-11T00:14:17.755 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:17.751+0000 7f0a84f3d640 1 -- 172.21.15.92:0/902906207 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0a8006f5f0 con 0x7f0a8006f140 2024-09-11T00:14:17.756 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:17.752+0000 7f0a76ffd640 1 -- 172.21.15.92:0/902906207 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f0a70036400 con 0x7f0a8006f140 2024-09-11T00:14:17.756 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:17.752+0000 7f0a76ffd640 1 --2- 172.21.15.92:0/902906207 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f0a60077f70 0x7f0a6007a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:17.756 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:17.752+0000 7f0a76ffd640 1 -- 172.21.15.92:0/902906207 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 5609+0+0 (secure 0 0 0) 0x7f0a700bae00 con 0x7f0a8006f140 2024-09-11T00:14:17.756 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:17.752+0000 7f0a7dd9b640 1 --2- 172.21.15.92:0/902906207 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f0a60077f70 0x7f0a6007a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:17.756 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:17.753+0000 7f0a7dd9b640 1 --2- 172.21.15.92:0/902906207 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f0a60077f70 0x7f0a6007a430 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f0a80155150 tx=0x7f0a68009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:14:17.758 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:17.756+0000 7f0a76ffd640 1 -- 172.21.15.92:0/902906207 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f0a70032030 con 0x7f0a8006f140 2024-09-11T00:14:17.972 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:17.967+0000 7f0a84f3d640 1 -- 172.21.15.92:0/902906207 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f0a8006e3e0 con 0x7f0a8006f140 2024-09-11T00:14:18.627 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:18.625+0000 7f0a76ffd640 1 -- 172.21.15.92:0/902906207 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) ==== 172+0+0 (secure 0 0 0) 0x7f0a70004820 con 0x7f0a8006f140 2024-09-11T00:14:18.629 INFO:teuthology.orchestra.run.smithi092.stderr:new fs with metadata pool 2 and data pool 3 2024-09-11T00:14:18.638 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:18.635+0000 7f0a84f3d640 1 -- 172.21.15.92:0/902906207 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f0a60077f70 msgr2=0x7f0a6007a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:18.638 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:18.635+0000 7f0a84f3d640 1 --2- 172.21.15.92:0/902906207 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f0a60077f70 0x7f0a6007a430 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f0a80155150 tx=0x7f0a68009040 comp rx=0 tx=0).stop 2024-09-11T00:14:18.638 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:18.635+0000 7f0a84f3d640 1 -- 172.21.15.92:0/902906207 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0a8006f140 msgr2=0x7f0a801f81c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:18.638 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:18.635+0000 7f0a84f3d640 1 --2- 172.21.15.92:0/902906207 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0a8006f140 0x7f0a801f81c0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f0a70006010 tx=0x7f0a70003ce0 comp rx=0 tx=0).stop 2024-09-11T00:14:18.638 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:18.636+0000 7f0a84f3d640 1 -- 172.21.15.92:0/902906207 shutdown_connections 2024-09-11T00:14:18.638 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:18.636+0000 7f0a84f3d640 1 --2- 172.21.15.92:0/902906207 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f0a60077f70 0x7f0a6007a430 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:18.638 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:18.636+0000 7f0a84f3d640 1 --2- 172.21.15.92:0/902906207 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0a8015c470 0x7f0a8015af10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:18.638 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:18.636+0000 7f0a84f3d640 1 --2- 172.21.15.92:0/902906207 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f0a80073780 0x7f0a801f5470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:18.638 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:18.636+0000 7f0a84f3d640 1 --2- 172.21.15.92:0/902906207 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0a8006f140 0x7f0a801f81c0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:18.638 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:18.636+0000 7f0a84f3d640 1 -- 172.21.15.92:0/902906207 >> 172.21.15.92:0/902906207 conn(0x7f0a800b1760 msgr2=0x7f0a800b1b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:14:18.639 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:18.637+0000 7f0a84f3d640 1 -- 172.21.15.92:0/902906207 shutdown_connections 2024-09-11T00:14:18.639 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:18.637+0000 7f0a84f3d640 1 -- 172.21.15.92:0/902906207 wait complete. 2024-09-11T00:14:18.653 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2024-09-11T00:14:18.654 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2024-09-11T00:14:18.764 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:18.762+0000 7f7c2970e640 1 -- 172.21.15.92:0/2333970597 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7c2415f350 msgr2=0x7f7c240b1150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:18.764 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:18.762+0000 7f7c2970e640 1 --2- 172.21.15.92:0/2333970597 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7c2415f350 0x7f7c240b1150 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f7c24072f00 tx=0x7f7c1402a980 comp rx=0 tx=0).stop 2024-09-11T00:14:18.764 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:18.762+0000 7f7c2970e640 1 -- 172.21.15.92:0/2333970597 shutdown_connections 2024-09-11T00:14:18.764 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:18.762+0000 7f7c2970e640 1 --2- 172.21.15.92:0/2333970597 >> v2:172.21.15.145:3300/0 conn(0x7f7c240b1da0 0x7f7c240af7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:18.764 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:18.762+0000 7f7c2970e640 1 --2- 172.21.15.92:0/2333970597 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7c2415f350 0x7f7c240b1150 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:18.764 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:18.762+0000 7f7c2970e640 1 -- 172.21.15.92:0/2333970597 >> 172.21.15.92:0/2333970597 conn(0x7f7c240d1be0 msgr2=0x7f7c240d1ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:14:18.764 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:18.762+0000 7f7c2970e640 1 -- 172.21.15.92:0/2333970597 shutdown_connections 2024-09-11T00:14:18.765 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:18.762+0000 7f7c2970e640 1 -- 172.21.15.92:0/2333970597 wait complete. 2024-09-11T00:14:18.765 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:18.763+0000 7f7c2970e640 1 Processor -- start 2024-09-11T00:14:18.765 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:18.763+0000 7f7c2970e640 1 -- start start 2024-09-11T00:14:18.767 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:18.764+0000 7f7c2970e640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7c240b1da0 0x7f7c241f26f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:18.767 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:18.764+0000 7f7c2970e640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7c240b2a10 0x7f7c240ca3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:18.767 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:18.764+0000 7f7c2970e640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7c2415f350 0x7f7c2414ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:18.768 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:18.764+0000 7f7c2970e640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f7c240b00a0 con 0x7f7c240b2a10 2024-09-11T00:14:18.768 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:18.764+0000 7f7c2970e640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f7c240aff20 con 0x7f7c240b1da0 2024-09-11T00:14:18.768 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:18.764+0000 7f7c2970e640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f7c240b0220 con 0x7f7c2415f350 2024-09-11T00:14:18.768 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:18.764+0000 7f7c227fc640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7c240b2a10 0x7f7c240ca3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:18.768 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:18.764+0000 7f7c227fc640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7c240b2a10 0x7f7c240ca3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:57808/0 (socket says 172.21.15.92:57808) 2024-09-11T00:14:18.768 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:18.764+0000 7f7c227fc640 1 -- 172.21.15.92:0/1445477881 learned_addr learned my addr 172.21.15.92:0/1445477881 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-11T00:14:18.768 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:18.764+0000 7f7c22ffd640 1 --2- 172.21.15.92:0/1445477881 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7c240b1da0 0x7f7c241f26f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:18.768 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:18.764+0000 7f7c237fe640 1 --2- 172.21.15.92:0/1445477881 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7c2415f350 0x7f7c2414ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:18.768 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:18.765+0000 7f7c227fc640 1 -- 172.21.15.92:0/1445477881 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7c2415f350 msgr2=0x7f7c2414ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:18.768 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:18.765+0000 7f7c227fc640 1 --2- 172.21.15.92:0/1445477881 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7c2415f350 0x7f7c2414ccc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:18.769 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:18.765+0000 7f7c227fc640 1 -- 172.21.15.92:0/1445477881 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7c240b1da0 msgr2=0x7f7c241f26f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:18.769 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:18.765+0000 7f7c227fc640 1 --2- 172.21.15.92:0/1445477881 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7c240b1da0 0x7f7c241f26f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:18.769 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:18.765+0000 7f7c227fc640 1 -- 172.21.15.92:0/1445477881 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c241f5ce0 con 0x7f7c240b2a10 2024-09-11T00:14:18.769 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:18.765+0000 7f7c227fc640 1 --2- 172.21.15.92:0/1445477881 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7c240b2a10 0x7f7c240ca3e0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f7c0c00c400 tx=0x7f7c0c00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:14:18.769 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:18.765+0000 7f7c1b7fe640 1 -- 172.21.15.92:0/1445477881 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c0c011790 con 0x7f7c240b2a10 2024-09-11T00:14:18.769 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:18.765+0000 7f7c1b7fe640 1 -- 172.21.15.92:0/1445477881 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7c0c017070 con 0x7f7c240b2a10 2024-09-11T00:14:18.769 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:18.765+0000 7f7c2970e640 1 -- 172.21.15.92:0/1445477881 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c241f5fc0 con 0x7f7c240b2a10 2024-09-11T00:14:18.769 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:18.765+0000 7f7c1b7fe640 1 -- 172.21.15.92:0/1445477881 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c0c011d00 con 0x7f7c240b2a10 2024-09-11T00:14:18.769 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:18.765+0000 7f7c2970e640 1 -- 172.21.15.92:0/1445477881 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c241f6580 con 0x7f7c240b2a10 2024-09-11T00:14:18.769 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:18.766+0000 7f7c2970e640 1 -- 172.21.15.92:0/1445477881 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7c240b06d0 con 0x7f7c240b2a10 2024-09-11T00:14:18.770 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:18.767+0000 7f7c1b7fe640 1 -- 172.21.15.92:0/1445477881 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f7c0c01c460 con 0x7f7c240b2a10 2024-09-11T00:14:18.770 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:18.767+0000 7f7c1b7fe640 1 --2- 172.21.15.92:0/1445477881 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f7c04077f70 0x7f7c0407a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:18.770 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:18.767+0000 7f7c1b7fe640 1 -- 172.21.15.92:0/1445477881 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f7c0c099a20 con 0x7f7c240b2a10 2024-09-11T00:14:18.770 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:18.767+0000 7f7c22ffd640 1 --2- 172.21.15.92:0/1445477881 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f7c04077f70 0x7f7c0407a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:18.771 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:18.768+0000 7f7c22ffd640 1 --2- 172.21.15.92:0/1445477881 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f7c04077f70 0x7f7c0407a430 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f7c14035000 tx=0x7f7c14004ab0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:14:18.772 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:18.771+0000 7f7c1b7fe640 1 -- 172.21.15.92:0/1445477881 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f7c0c061f60 con 0x7f7c240b2a10 2024-09-11T00:14:18.956 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:18.954+0000 7f7c2970e640 1 -- 172.21.15.92:0/1445477881 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) -- 0x7f7c24070c50 con 0x7f7c240b2a10 2024-09-11T00:14:19.622 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:19.621+0000 7f7c1b7fe640 1 -- 172.21.15.92:0/1445477881 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v21) ==== 157+0+0 (secure 0 0 0) 0x7f7c0c066990 con 0x7f7c240b2a10 2024-09-11T00:14:19.625 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:19.623+0000 7f7c2970e640 1 -- 172.21.15.92:0/1445477881 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f7c04077f70 msgr2=0x7f7c0407a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:19.625 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:19.623+0000 7f7c2970e640 1 --2- 172.21.15.92:0/1445477881 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f7c04077f70 0x7f7c0407a430 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f7c14035000 tx=0x7f7c14004ab0 comp rx=0 tx=0).stop 2024-09-11T00:14:19.626 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:19.623+0000 7f7c2970e640 1 -- 172.21.15.92:0/1445477881 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7c240b2a10 msgr2=0x7f7c240ca3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:19.626 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:19.623+0000 7f7c2970e640 1 --2- 172.21.15.92:0/1445477881 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7c240b2a10 0x7f7c240ca3e0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f7c0c00c400 tx=0x7f7c0c00c8c0 comp rx=0 tx=0).stop 2024-09-11T00:14:19.626 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:19.624+0000 7f7c2970e640 1 -- 172.21.15.92:0/1445477881 shutdown_connections 2024-09-11T00:14:19.626 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:19.624+0000 7f7c2970e640 1 --2- 172.21.15.92:0/1445477881 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f7c04077f70 0x7f7c0407a430 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:19.626 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:19.624+0000 7f7c2970e640 1 --2- 172.21.15.92:0/1445477881 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7c2415f350 0x7f7c2414ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:19.626 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:19.624+0000 7f7c2970e640 1 --2- 172.21.15.92:0/1445477881 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7c240b2a10 0x7f7c240ca3e0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:19.626 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:19.624+0000 7f7c2970e640 1 --2- 172.21.15.92:0/1445477881 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7c240b1da0 0x7f7c241f26f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:19.626 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:19.624+0000 7f7c2970e640 1 -- 172.21.15.92:0/1445477881 >> 172.21.15.92:0/1445477881 conn(0x7f7c240d1be0 msgr2=0x7f7c240d1fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:14:19.626 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:19.624+0000 7f7c2970e640 1 -- 172.21.15.92:0/1445477881 shutdown_connections 2024-09-11T00:14:19.626 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:19.624+0000 7f7c2970e640 1 -- 172.21.15.92:0/1445477881 wait complete. 2024-09-11T00:14:19.639 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2024-09-11T00:14:19.755 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:19.752+0000 7fe556d17640 1 -- 172.21.15.92:0/2586269455 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe55015bce0 msgr2=0x7fe5500cc6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:19.755 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:19.752+0000 7fe556d17640 1 --2- 172.21.15.92:0/2586269455 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe55015bce0 0x7fe5500cc6c0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fe5500b18e0 tx=0x7fe54c02a4d0 comp rx=0 tx=0).stop 2024-09-11T00:14:19.755 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:19.752+0000 7fe556d17640 1 -- 172.21.15.92:0/2586269455 shutdown_connections 2024-09-11T00:14:19.755 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:19.752+0000 7fe556d17640 1 --2- 172.21.15.92:0/2586269455 >> v2:172.21.15.145:3300/0 conn(0x7fe5500cf270 0x7fe5500b1bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:19.755 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:19.752+0000 7fe556d17640 1 --2- 172.21.15.92:0/2586269455 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe55015bce0 0x7fe5500cc6c0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:19.755 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:19.752+0000 7fe556d17640 1 -- 172.21.15.92:0/2586269455 >> 172.21.15.92:0/2586269455 conn(0x7fe5500d1bf0 msgr2=0x7fe5500d2000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:14:19.755 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:19.753+0000 7fe556d17640 1 -- 172.21.15.92:0/2586269455 shutdown_connections 2024-09-11T00:14:19.755 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:19.753+0000 7fe556d17640 1 -- 172.21.15.92:0/2586269455 wait complete. 2024-09-11T00:14:19.757 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:19.754+0000 7fe556d17640 1 Processor -- start 2024-09-11T00:14:19.757 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:19.754+0000 7fe556d17640 1 -- start start 2024-09-11T00:14:19.757 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:19.755+0000 7fe556d17640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe5500ccc00 0x7fe55015c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:19.757 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:19.755+0000 7fe556d17640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe5500cf270 0x7fe5500cb380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:19.758 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:19.755+0000 7fe556d17640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe55015bce0 0x7fe55015a540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:19.758 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:19.755+0000 7fe556d17640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fe5500b2660 con 0x7fe55015bce0 2024-09-11T00:14:19.758 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:19.755+0000 7fe556d17640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fe5500b24e0 con 0x7fe5500ccc00 2024-09-11T00:14:19.758 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:19.755+0000 7fe556d17640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7fe5500b27e0 con 0x7fe5500cf270 2024-09-11T00:14:19.758 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:19.755+0000 7fe5552b4640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe55015bce0 0x7fe55015a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:19.758 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:19.755+0000 7fe5552b4640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe55015bce0 0x7fe55015a540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:57826/0 (socket says 172.21.15.92:57826) 2024-09-11T00:14:19.758 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:19.755+0000 7fe5552b4640 1 -- 172.21.15.92:0/3305429892 learned_addr learned my addr 172.21.15.92:0/3305429892 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-11T00:14:19.758 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:19.755+0000 7fe554ab3640 1 --2- 172.21.15.92:0/3305429892 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe5500ccc00 0x7fe55015c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:19.758 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:19.755+0000 7fe547fff640 1 --2- 172.21.15.92:0/3305429892 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe5500cf270 0x7fe5500cb380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:19.758 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:19.755+0000 7fe5552b4640 1 -- 172.21.15.92:0/3305429892 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe5500cf270 msgr2=0x7fe5500cb380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:19.758 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:19.755+0000 7fe5552b4640 1 --2- 172.21.15.92:0/3305429892 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe5500cf270 0x7fe5500cb380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:19.758 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:19.755+0000 7fe5552b4640 1 -- 172.21.15.92:0/3305429892 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe5500ccc00 msgr2=0x7fe55015c2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:19.758 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:19.755+0000 7fe5552b4640 1 --2- 172.21.15.92:0/3305429892 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe5500ccc00 0x7fe55015c2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:19.759 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:19.755+0000 7fe5552b4640 1 -- 172.21.15.92:0/3305429892 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5501f8080 con 0x7fe55015bce0 2024-09-11T00:14:19.759 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:19.755+0000 7fe554ab3640 1 --2- 172.21.15.92:0/3305429892 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe5500ccc00 0x7fe55015c2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:14:19.759 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:19.755+0000 7fe5552b4640 1 --2- 172.21.15.92:0/3305429892 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe55015bce0 0x7fe55015a540 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fe54800eaa0 tx=0x7fe54800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:14:19.759 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:19.755+0000 7fe5457fa640 1 -- 172.21.15.92:0/3305429892 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe54800cdb0 con 0x7fe55015bce0 2024-09-11T00:14:19.759 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:19.755+0000 7fe5457fa640 1 -- 172.21.15.92:0/3305429892 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe548004c10 con 0x7fe55015bce0 2024-09-11T00:14:19.759 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:19.755+0000 7fe556d17640 1 -- 172.21.15.92:0/3305429892 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe5501f8360 con 0x7fe55015bce0 2024-09-11T00:14:19.759 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:19.755+0000 7fe5457fa640 1 -- 172.21.15.92:0/3305429892 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe548005020 con 0x7fe55015bce0 2024-09-11T00:14:19.759 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:19.755+0000 7fe556d17640 1 -- 172.21.15.92:0/3305429892 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5501f8920 con 0x7fe55015bce0 2024-09-11T00:14:19.760 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:19.756+0000 7fe556d17640 1 -- 172.21.15.92:0/3305429892 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe5500cafe0 con 0x7fe55015bce0 2024-09-11T00:14:19.760 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:19.757+0000 7fe5457fa640 1 -- 172.21.15.92:0/3305429892 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fe54800f040 con 0x7fe55015bce0 2024-09-11T00:14:19.760 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:19.757+0000 7fe5457fa640 1 --2- 172.21.15.92:0/3305429892 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7fe53c077f70 0x7fe53c07a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:19.760 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:19.757+0000 7fe5457fa640 1 -- 172.21.15.92:0/3305429892 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 6007+0+0 (secure 0 0 0) 0x7fe54809a480 con 0x7fe55015bce0 2024-09-11T00:14:19.760 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:19.757+0000 7fe554ab3640 1 --2- 172.21.15.92:0/3305429892 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7fe53c077f70 0x7fe53c07a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:19.760 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:19.758+0000 7fe554ab3640 1 --2- 172.21.15.92:0/3305429892 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7fe53c077f70 0x7fe53c07a430 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fe54c033000 tx=0x7fe54c004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:14:19.763 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:19.761+0000 7fe5457fa640 1 -- 172.21.15.92:0/3305429892 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fe548016030 con 0x7fe55015bce0 2024-09-11T00:14:19.940 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:19.939+0000 7fe556d17640 1 -- 172.21.15.92:0/3305429892 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7fe5500b2d00 con 0x7fe55015bce0 2024-09-11T00:14:21.639 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:21.637+0000 7fe5457fa640 1 -- 172.21.15.92:0/3305429892 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v23) ==== 228+0+0 (secure 0 0 0) 0x7fe548062ee0 con 0x7fe55015bce0 2024-09-11T00:14:21.639 INFO:teuthology.orchestra.run.smithi092.stderr:pool 'cephfs_data_ec' created 2024-09-11T00:14:21.643 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:21.641+0000 7fe556d17640 1 -- 172.21.15.92:0/3305429892 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7fe53c077f70 msgr2=0x7fe53c07a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:21.643 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:21.641+0000 7fe556d17640 1 --2- 172.21.15.92:0/3305429892 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7fe53c077f70 0x7fe53c07a430 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fe54c033000 tx=0x7fe54c004730 comp rx=0 tx=0).stop 2024-09-11T00:14:21.643 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:21.641+0000 7fe556d17640 1 -- 172.21.15.92:0/3305429892 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe55015bce0 msgr2=0x7fe55015a540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:21.643 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:21.641+0000 7fe556d17640 1 --2- 172.21.15.92:0/3305429892 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe55015bce0 0x7fe55015a540 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fe54800eaa0 tx=0x7fe54800ef60 comp rx=0 tx=0).stop 2024-09-11T00:14:21.643 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:21.641+0000 7fe556d17640 1 -- 172.21.15.92:0/3305429892 shutdown_connections 2024-09-11T00:14:21.644 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:21.641+0000 7fe556d17640 1 --2- 172.21.15.92:0/3305429892 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7fe53c077f70 0x7fe53c07a430 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:21.644 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:21.641+0000 7fe556d17640 1 --2- 172.21.15.92:0/3305429892 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe55015bce0 0x7fe55015a540 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:21.644 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:21.641+0000 7fe556d17640 1 --2- 172.21.15.92:0/3305429892 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe5500cf270 0x7fe5500cb380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:21.644 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:21.641+0000 7fe556d17640 1 --2- 172.21.15.92:0/3305429892 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe5500ccc00 0x7fe55015c2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:21.644 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:21.641+0000 7fe556d17640 1 -- 172.21.15.92:0/3305429892 >> 172.21.15.92:0/3305429892 conn(0x7fe5500d1bf0 msgr2=0x7fe5500ccfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:14:21.644 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:21.641+0000 7fe556d17640 1 -- 172.21.15.92:0/3305429892 shutdown_connections 2024-09-11T00:14:21.644 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:21.642+0000 7fe556d17640 1 -- 172.21.15.92:0/3305429892 wait complete. 2024-09-11T00:14:21.663 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2024-09-11T00:14:21.773 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:21.771+0000 7f6173271640 1 -- 172.21.15.92:0/261210702 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6154003a50 msgr2=0x7f6154003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:21.773 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:21.771+0000 7f6173271640 1 --2- 172.21.15.92:0/261210702 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6154003a50 0x7f6154003e70 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f61640016c0 tx=0x7f6154005830 comp rx=0 tx=0).stop 2024-09-11T00:14:21.773 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:21.771+0000 7f6173271640 1 -- 172.21.15.92:0/261210702 shutdown_connections 2024-09-11T00:14:21.774 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:21.771+0000 7f6173271640 1 --2- 172.21.15.92:0/261210702 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6154003a50 0x7f6154003e70 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:21.774 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:21.771+0000 7f6173271640 1 -- 172.21.15.92:0/261210702 >> 172.21.15.92:0/261210702 conn(0x7f616c0d0c00 msgr2=0x7f616c0d0fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:14:21.774 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:21.771+0000 7f6173271640 1 -- 172.21.15.92:0/261210702 shutdown_connections 2024-09-11T00:14:21.774 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:21.771+0000 7f6173271640 1 -- 172.21.15.92:0/261210702 wait complete. 2024-09-11T00:14:21.774 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:21.773+0000 7f6173271640 1 Processor -- start 2024-09-11T00:14:21.774 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:21.773+0000 7f6173271640 1 -- start start 2024-09-11T00:14:21.776 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:21.773+0000 7f6173271640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6154003a50 0x7f616c15da50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:21.776 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:21.773+0000 7f6173271640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f616c070e10 0x7f616c06f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:21.776 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:21.773+0000 7f6173271640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f616c06f930 0x7f616c06fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:21.777 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:21.773+0000 7f6173271640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f616c15efd0 con 0x7f616c070e10 2024-09-11T00:14:21.777 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:21.773+0000 7f6173271640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f616c15ee50 con 0x7f616c06f930 2024-09-11T00:14:21.777 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:21.773+0000 7f6173271640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f616c15f150 con 0x7f6154003a50 2024-09-11T00:14:21.777 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:21.774+0000 7f617080c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f616c070e10 0x7f616c06f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:21.777 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:21.774+0000 7f617080c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f616c070e10 0x7f616c06f3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:57842/0 (socket says 172.21.15.92:57842) 2024-09-11T00:14:21.777 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:21.774+0000 7f617080c640 1 -- 172.21.15.92:0/765070167 learned_addr learned my addr 172.21.15.92:0/765070167 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-11T00:14:21.777 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:21.774+0000 7f617100d640 1 --2- 172.21.15.92:0/765070167 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6154003a50 0x7f616c15da50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:21.777 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:21.774+0000 7f617180e640 1 --2- 172.21.15.92:0/765070167 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f616c06f930 0x7f616c06fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:21.777 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:21.774+0000 7f617080c640 1 -- 172.21.15.92:0/765070167 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6154003a50 msgr2=0x7f616c15da50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:21.777 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:21.774+0000 7f617080c640 1 --2- 172.21.15.92:0/765070167 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6154003a50 0x7f616c15da50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:21.777 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:21.774+0000 7f617080c640 1 -- 172.21.15.92:0/765070167 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f616c06f930 msgr2=0x7f616c06fdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:21.777 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:21.774+0000 7f617080c640 1 --2- 172.21.15.92:0/765070167 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f616c06f930 0x7f616c06fdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:21.777 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:21.774+0000 7f617080c640 1 -- 172.21.15.92:0/765070167 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f616c1578b0 con 0x7f616c070e10 2024-09-11T00:14:21.778 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:21.774+0000 7f617080c640 1 --2- 172.21.15.92:0/765070167 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f616c070e10 0x7f616c06f3f0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f61600066f0 tx=0x7f6160003a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:14:21.778 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:21.774+0000 7f6169ffb640 1 -- 172.21.15.92:0/765070167 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f616000f7e0 con 0x7f616c070e10 2024-09-11T00:14:21.778 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:21.774+0000 7f6169ffb640 1 -- 172.21.15.92:0/765070167 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6160016020 con 0x7f616c070e10 2024-09-11T00:14:21.778 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:21.774+0000 7f6173271640 1 -- 172.21.15.92:0/765070167 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f616c1e9030 con 0x7f616c070e10 2024-09-11T00:14:21.778 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:21.774+0000 7f6169ffb640 1 -- 172.21.15.92:0/765070167 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f616000fc20 con 0x7f616c070e10 2024-09-11T00:14:21.778 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:21.774+0000 7f6173271640 1 -- 172.21.15.92:0/765070167 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f616c144520 con 0x7f616c070e10 2024-09-11T00:14:21.779 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:21.775+0000 7f6173271640 1 -- 172.21.15.92:0/765070167 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f616c15e6e0 con 0x7f616c070e10 2024-09-11T00:14:21.779 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:21.776+0000 7f6169ffb640 1 -- 172.21.15.92:0/765070167 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f6160025440 con 0x7f616c070e10 2024-09-11T00:14:21.779 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:21.777+0000 7f6169ffb640 1 --2- 172.21.15.92:0/765070167 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f6158077fa0 0x7f615807a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:21.779 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:21.777+0000 7f6169ffb640 1 -- 172.21.15.92:0/765070167 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 6500+0+0 (secure 0 0 0) 0x7f616009af80 con 0x7f616c070e10 2024-09-11T00:14:21.779 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:21.777+0000 7f617100d640 1 --2- 172.21.15.92:0/765070167 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f6158077fa0 0x7f615807a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:21.780 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:21.777+0000 7f617100d640 1 --2- 172.21.15.92:0/765070167 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f6158077fa0 0x7f615807a460 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f6164032000 tx=0x7f616402c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:14:21.782 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:21.780+0000 7f6169ffb640 1 -- 172.21.15.92:0/765070167 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f616c15e6e0 con 0x7f616c070e10 2024-09-11T00:14:21.957 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:21.955+0000 7f6173271640 1 -- 172.21.15.92:0/765070167 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) -- 0x7f616c0b54f0 con 0x7f616c070e10 2024-09-11T00:14:22.645 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:22.643+0000 7f6169ffb640 1 -- 172.21.15.92:0/765070167 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 4 allow_ec_overwrites to true v24) ==== 169+0+0 (secure 0 0 0) 0x7f6160020020 con 0x7f616c070e10 2024-09-11T00:14:22.645 INFO:teuthology.orchestra.run.smithi092.stderr:set pool 4 allow_ec_overwrites to true 2024-09-11T00:14:22.648 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:22.646+0000 7f6173271640 1 -- 172.21.15.92:0/765070167 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f6158077fa0 msgr2=0x7f615807a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:22.649 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:22.646+0000 7f6173271640 1 --2- 172.21.15.92:0/765070167 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f6158077fa0 0x7f615807a460 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f6164032000 tx=0x7f616402c040 comp rx=0 tx=0).stop 2024-09-11T00:14:22.649 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:22.646+0000 7f6173271640 1 -- 172.21.15.92:0/765070167 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f616c070e10 msgr2=0x7f616c06f3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:22.649 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:22.646+0000 7f6173271640 1 --2- 172.21.15.92:0/765070167 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f616c070e10 0x7f616c06f3f0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f61600066f0 tx=0x7f6160003a80 comp rx=0 tx=0).stop 2024-09-11T00:14:22.649 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:22.646+0000 7f6173271640 1 -- 172.21.15.92:0/765070167 shutdown_connections 2024-09-11T00:14:22.649 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:22.646+0000 7f6173271640 1 --2- 172.21.15.92:0/765070167 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f6158077fa0 0x7f615807a460 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:22.649 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:22.646+0000 7f6173271640 1 --2- 172.21.15.92:0/765070167 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f616c06f930 0x7f616c06fdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:22.650 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:22.646+0000 7f6173271640 1 --2- 172.21.15.92:0/765070167 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f616c070e10 0x7f616c06f3f0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:22.650 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:22.646+0000 7f6173271640 1 --2- 172.21.15.92:0/765070167 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6154003a50 0x7f616c15da50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:22.650 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:22.646+0000 7f6173271640 1 -- 172.21.15.92:0/765070167 >> 172.21.15.92:0/765070167 conn(0x7f616c0d0c00 msgr2=0x7f616c0cf660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:14:22.650 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:22.646+0000 7f6173271640 1 -- 172.21.15.92:0/765070167 shutdown_connections 2024-09-11T00:14:22.650 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:22.646+0000 7f6173271640 1 -- 172.21.15.92:0/765070167 wait complete. 2024-09-11T00:14:22.672 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs cephfs_data_ec 2024-09-11T00:14:22.783 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:22.781+0000 7ff628408640 1 -- 172.21.15.92:0/1852443537 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff60c004d90 msgr2=0x7ff60c005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:22.783 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:22.781+0000 7ff628408640 1 --2- 172.21.15.92:0/1852443537 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff60c004d90 0x7ff60c005210 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7ff6200d1350 tx=0x7ff60c005830 comp rx=0 tx=0).stop 2024-09-11T00:14:22.783 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:22.781+0000 7ff6269a5640 1 -- 172.21.15.92:0/1852443537 reap_dead start 2024-09-11T00:14:22.783 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:22.781+0000 7ff628408640 1 -- 172.21.15.92:0/1852443537 shutdown_connections 2024-09-11T00:14:22.783 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:22.781+0000 7ff628408640 1 -- 172.21.15.92:0/1852443537 >> 172.21.15.92:0/1852443537 conn(0x7ff620074150 msgr2=0x7ff620074560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:14:22.783 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:22.781+0000 7ff628408640 1 -- 172.21.15.92:0/1852443537 shutdown_connections 2024-09-11T00:14:22.784 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:22.781+0000 7ff628408640 1 -- 172.21.15.92:0/1852443537 wait complete. 2024-09-11T00:14:22.784 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:22.783+0000 7ff628408640 1 Processor -- start 2024-09-11T00:14:22.784 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:22.783+0000 7ff628408640 1 -- start start 2024-09-11T00:14:22.786 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:22.783+0000 7ff628408640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff60c004d90 0x7ff6200c6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:22.786 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:22.783+0000 7ff628408640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff6200c9b50 0x7ff6200c9fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:22.786 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:22.783+0000 7ff628408640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff6200ae310 0x7ff6200ae790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:22.786 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:22.783+0000 7ff628408640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7ff6200b6230 con 0x7ff6200c9b50 2024-09-11T00:14:22.786 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:22.783+0000 7ff628408640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7ff6200b60b0 con 0x7ff60c004d90 2024-09-11T00:14:22.786 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:22.783+0000 7ff628408640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7ff6200b0e40 con 0x7ff6200ae310 2024-09-11T00:14:22.786 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:22.783+0000 7ff6259a3640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff6200c9b50 0x7ff6200c9fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:22.787 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:22.783+0000 7ff6259a3640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff6200c9b50 0x7ff6200c9fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:57864/0 (socket says 172.21.15.92:57864) 2024-09-11T00:14:22.787 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:22.783+0000 7ff6259a3640 1 -- 172.21.15.92:0/2243084142 learned_addr learned my addr 172.21.15.92:0/2243084142 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-11T00:14:22.787 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:22.783+0000 7ff6261a4640 1 --2- 172.21.15.92:0/2243084142 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff60c004d90 0x7ff6200c6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:22.787 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:22.784+0000 7ff6269a5640 1 --2- 172.21.15.92:0/2243084142 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff6200ae310 0x7ff6200ae790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:22.787 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:22.784+0000 7ff6259a3640 1 -- 172.21.15.92:0/2243084142 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff6200ae310 msgr2=0x7ff6200ae790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:22.787 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:22.784+0000 7ff6259a3640 1 --2- 172.21.15.92:0/2243084142 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff6200ae310 0x7ff6200ae790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:22.787 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:22.784+0000 7ff6259a3640 1 -- 172.21.15.92:0/2243084142 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff60c004d90 msgr2=0x7ff6200c6090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:22.787 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:22.784+0000 7ff6259a3640 1 --2- 172.21.15.92:0/2243084142 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff60c004d90 0x7ff6200c6090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:22.787 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:22.784+0000 7ff6259a3640 1 -- 172.21.15.92:0/2243084142 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6200ca5d0 con 0x7ff6200c9b50 2024-09-11T00:14:22.787 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:22.784+0000 7ff6259a3640 1 --2- 172.21.15.92:0/2243084142 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff6200c9b50 0x7ff6200c9fd0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7ff6100066b0 tx=0x7ff6100039c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:14:22.787 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:22.784+0000 7ff616ffd640 1 -- 172.21.15.92:0/2243084142 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff610015070 con 0x7ff6200c9b50 2024-09-11T00:14:22.787 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:22.784+0000 7ff616ffd640 1 -- 172.21.15.92:0/2243084142 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff610011900 con 0x7ff6200c9b50 2024-09-11T00:14:22.788 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:22.784+0000 7ff628408640 1 -- 172.21.15.92:0/2243084142 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff6200c7710 con 0x7ff6200c9b50 2024-09-11T00:14:22.788 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:22.784+0000 7ff616ffd640 1 -- 172.21.15.92:0/2243084142 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff610011d50 con 0x7ff6200c9b50 2024-09-11T00:14:22.788 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:22.784+0000 7ff628408640 1 -- 172.21.15.92:0/2243084142 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6200c7cd0 con 0x7ff6200c9b50 2024-09-11T00:14:22.788 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:22.785+0000 7ff628408640 1 -- 172.21.15.92:0/2243084142 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff6200d02b0 con 0x7ff6200c9b50 2024-09-11T00:14:22.788 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:22.786+0000 7ff616ffd640 1 -- 172.21.15.92:0/2243084142 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7ff61000f430 con 0x7ff6200c9b50 2024-09-11T00:14:22.789 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:22.786+0000 7ff616ffd640 1 --2- 172.21.15.92:0/2243084142 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7ff604077fa0 0x7ff60407a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:22.789 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:22.786+0000 7ff616ffd640 1 -- 172.21.15.92:0/2243084142 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6500+0+0 (secure 0 0 0) 0x7ff61009ad70 con 0x7ff6200c9b50 2024-09-11T00:14:22.789 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:22.786+0000 7ff6261a4640 1 --2- 172.21.15.92:0/2243084142 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7ff604077fa0 0x7ff60407a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:22.789 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:22.787+0000 7ff6261a4640 1 --2- 172.21.15.92:0/2243084142 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7ff604077fa0 0x7ff60407a460 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7ff61c003700 tx=0x7ff61c00b260 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:14:22.792 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:22.790+0000 7ff616ffd640 1 -- 172.21.15.92:0/2243084142 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7ff610062f10 con 0x7ff6200c9b50 2024-09-11T00:14:23.001 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:23.000+0000 7ff628408640 1 -- 172.21.15.92:0/2243084142 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) -- 0x7ff6200c6620 con 0x7ff6200c9b50 2024-09-11T00:14:23.538 INFO:tasks.ceph.mds.b.smithi145.stderr:2024-09-11T00:14:23.537+0000 7ff8fb2e3640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-11T00:14:23.653 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:23.652+0000 7ff616ffd640 1 -- 172.21.15.92:0/2243084142 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 4 to fsmap v6) ==== 137+0+0 (secure 0 0 0) 0x7ff610067940 con 0x7ff6200c9b50 2024-09-11T00:14:23.653 INFO:teuthology.orchestra.run.smithi092.stderr:added data pool 4 to fsmap 2024-09-11T00:14:23.657 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:23.655+0000 7ff628408640 1 -- 172.21.15.92:0/2243084142 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7ff604077fa0 msgr2=0x7ff60407a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:23.657 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:23.655+0000 7ff628408640 1 --2- 172.21.15.92:0/2243084142 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7ff604077fa0 0x7ff60407a460 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7ff61c003700 tx=0x7ff61c00b260 comp rx=0 tx=0).stop 2024-09-11T00:14:23.657 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:23.655+0000 7ff628408640 1 -- 172.21.15.92:0/2243084142 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff6200c9b50 msgr2=0x7ff6200c9fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:23.657 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:23.655+0000 7ff628408640 1 --2- 172.21.15.92:0/2243084142 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff6200c9b50 0x7ff6200c9fd0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7ff6100066b0 tx=0x7ff6100039c0 comp rx=0 tx=0).stop 2024-09-11T00:14:23.657 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:23.655+0000 7ff628408640 1 -- 172.21.15.92:0/2243084142 shutdown_connections 2024-09-11T00:14:23.657 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:23.655+0000 7ff628408640 1 --2- 172.21.15.92:0/2243084142 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7ff604077fa0 0x7ff60407a460 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:23.657 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:23.655+0000 7ff628408640 1 --2- 172.21.15.92:0/2243084142 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff6200ae310 0x7ff6200ae790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:23.657 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:23.655+0000 7ff628408640 1 --2- 172.21.15.92:0/2243084142 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff6200c9b50 0x7ff6200c9fd0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:23.657 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:23.655+0000 7ff628408640 1 --2- 172.21.15.92:0/2243084142 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff60c004d90 0x7ff6200c6090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:23.657 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:23.655+0000 7ff628408640 1 -- 172.21.15.92:0/2243084142 >> 172.21.15.92:0/2243084142 conn(0x7ff620074150 msgr2=0x7ff62006ffb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:14:23.657 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:23.655+0000 7ff628408640 1 -- 172.21.15.92:0/2243084142 shutdown_connections 2024-09-11T00:14:23.657 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:23.655+0000 7ff628408640 1 -- 172.21.15.92:0/2243084142 wait complete. 2024-09-11T00:14:23.669 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T00:14:23.776 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:23.774+0000 7f3e11a2b640 1 -- 172.21.15.92:0/3913044744 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3df4004d40 msgr2=0x7f3df40051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:23.776 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:23.774+0000 7f3e11a2b640 1 --2- 172.21.15.92:0/3913044744 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3df4004d40 0x7f3df40051c0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f3e0400baf0 tx=0x7f3df4005830 comp rx=0 tx=0).stop 2024-09-11T00:14:23.777 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:23.774+0000 7f3e0b7fe640 1 -- 172.21.15.92:0/3913044744 reap_dead start 2024-09-11T00:14:23.777 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:23.774+0000 7f3e11a2b640 1 -- 172.21.15.92:0/3913044744 shutdown_connections 2024-09-11T00:14:23.777 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:23.774+0000 7f3e11a2b640 1 -- 172.21.15.92:0/3913044744 >> 172.21.15.92:0/3913044744 conn(0x7f3e0c074150 msgr2=0x7f3e0c074560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:14:23.777 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:23.774+0000 7f3e11a2b640 1 -- 172.21.15.92:0/3913044744 shutdown_connections 2024-09-11T00:14:23.777 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:23.774+0000 7f3e11a2b640 1 -- 172.21.15.92:0/3913044744 wait complete. 2024-09-11T00:14:23.780 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:23.776+0000 7f3e11a2b640 1 Processor -- start 2024-09-11T00:14:23.780 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:23.776+0000 7f3e11a2b640 1 -- start start 2024-09-11T00:14:23.780 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:23.777+0000 7f3e11a2b640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3df4004d40 0x7f3e0c154d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:23.780 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:23.777+0000 7f3e11a2b640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3e0c1552d0 0x7f3e0c1f7c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:23.780 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:23.777+0000 7f3e11a2b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3e0c1f81a0 0x7f3e0c1f8620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:23.781 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:23.777+0000 7f3e11a2b640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f3e0c0b08b0 con 0x7f3e0c1f81a0 2024-09-11T00:14:23.781 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:23.777+0000 7f3e11a2b640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f3e0c0b0730 con 0x7f3df4004d40 2024-09-11T00:14:23.781 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:23.777+0000 7f3e11a2b640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f3e0c0b0a30 con 0x7f3e0c1552d0 2024-09-11T00:14:23.781 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:23.777+0000 7f3e0b7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3e0c1f81a0 0x7f3e0c1f8620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:23.781 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:23.777+0000 7f3e0b7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3e0c1f81a0 0x7f3e0c1f8620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:57878/0 (socket says 172.21.15.92:57878) 2024-09-11T00:14:23.781 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:23.777+0000 7f3e0b7fe640 1 -- 172.21.15.92:0/2763565243 learned_addr learned my addr 172.21.15.92:0/2763565243 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-11T00:14:23.781 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:23.777+0000 7f3e0affd640 1 --2- 172.21.15.92:0/2763565243 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3df4004d40 0x7f3e0c154d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:23.781 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:23.777+0000 7f3e0a7fc640 1 --2- 172.21.15.92:0/2763565243 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3e0c1552d0 0x7f3e0c1f7c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:23.781 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:23.777+0000 7f3e0b7fe640 1 -- 172.21.15.92:0/2763565243 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3e0c1552d0 msgr2=0x7f3e0c1f7c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:23.782 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:23.777+0000 7f3e0b7fe640 1 --2- 172.21.15.92:0/2763565243 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3e0c1552d0 0x7f3e0c1f7c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:23.782 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:23.777+0000 7f3e0b7fe640 1 -- 172.21.15.92:0/2763565243 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3df4004d40 msgr2=0x7f3e0c154d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:23.782 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:23.777+0000 7f3e0b7fe640 1 --2- 172.21.15.92:0/2763565243 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3df4004d40 0x7f3e0c154d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:23.782 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:23.777+0000 7f3e0b7fe640 1 -- 172.21.15.92:0/2763565243 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e0c0c7590 con 0x7f3e0c1f81a0 2024-09-11T00:14:23.782 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:23.777+0000 7f3e0a7fc640 1 --2- 172.21.15.92:0/2763565243 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3e0c1552d0 0x7f3e0c1f7c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:14:23.782 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:23.777+0000 7f3e0affd640 1 --2- 172.21.15.92:0/2763565243 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3df4004d40 0x7f3e0c154d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:14:23.782 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:23.777+0000 7f3e0b7fe640 1 --2- 172.21.15.92:0/2763565243 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3e0c1f81a0 0x7f3e0c1f8620 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f3e04034040 tx=0x7f3e04005900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:14:23.782 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:23.777+0000 7f3df3fff640 1 -- 172.21.15.92:0/2763565243 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e04032bb0 con 0x7f3e0c1f81a0 2024-09-11T00:14:23.782 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:23.777+0000 7f3df3fff640 1 -- 172.21.15.92:0/2763565243 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3e04032e40 con 0x7f3e0c1f81a0 2024-09-11T00:14:23.782 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:23.777+0000 7f3df3fff640 1 -- 172.21.15.92:0/2763565243 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e04004270 con 0x7f3e0c1f81a0 2024-09-11T00:14:23.782 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:23.777+0000 7f3e11a2b640 1 -- 172.21.15.92:0/2763565243 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e0c0c9970 con 0x7f3e0c1f81a0 2024-09-11T00:14:23.782 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:23.777+0000 7f3e11a2b640 1 -- 172.21.15.92:0/2763565243 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e0c0c9f30 con 0x7f3e0c1f81a0 2024-09-11T00:14:23.782 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:23.778+0000 7f3e11a2b640 1 -- 172.21.15.92:0/2763565243 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3e0c0b5e80 con 0x7f3e0c1f81a0 2024-09-11T00:14:23.783 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:23.779+0000 7f3df3fff640 1 -- 172.21.15.92:0/2763565243 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f3e04044030 con 0x7f3e0c1f81a0 2024-09-11T00:14:23.783 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:23.779+0000 7f3df3fff640 1 --2- 172.21.15.92:0/2763565243 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f3df8077fa0 0x7f3df807a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:23.783 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:23.779+0000 7f3df3fff640 1 -- 172.21.15.92:0/2763565243 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f3e040ba880 con 0x7f3e0c1f81a0 2024-09-11T00:14:23.783 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:23.780+0000 7f3e0affd640 1 --2- 172.21.15.92:0/2763565243 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f3df8077fa0 0x7f3df807a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:23.784 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:23.780+0000 7f3e0affd640 1 --2- 172.21.15.92:0/2763565243 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f3df8077fa0 0x7f3df807a460 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f3dfc006fd0 tx=0x7f3dfc001f10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:14:23.785 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:23.784+0000 7f3df3fff640 1 -- 172.21.15.92:0/2763565243 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f3e0c0b5e80 con 0x7f3e0c1f81a0 2024-09-11T00:14:23.992 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:23.990+0000 7f3e11a2b640 1 -- 172.21.15.92:0/2763565243 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3e0c0d02b0 con 0x7f3e0c1f81a0 2024-09-11T00:14:23.992 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:23.991+0000 7f3df3fff640 1 -- 172.21.15.92:0/2763565243 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+5225 (secure 0 0 0) 0x7f3e0404a060 con 0x7f3e0c1f81a0 2024-09-11T00:14:23.994 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:14:23.995 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":6,"btime":"2024-09-11T00:14:23:644465+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4286,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/2051794804","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":2051794804},{"type":"v1","addr":"172.21.15.92:6835","nonce":2051794804}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4295,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6835/1341143168","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6834","nonce":1341143168},{"type":"v1","addr":"172.21.15.145:6835","nonce":1341143168}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4356,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6833/3149311196","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":3149311196},{"type":"v1","addr":"172.21.15.92:6833","nonce":3149311196}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T00:14:17.969166+0000","modified":"2024-09-11T00:14:23.001417+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4374},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4374":{"gid":4374,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.145:6837/3236563974","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6836","nonce":3236563974},{"type":"v1","addr":"172.21.15.145:6837","nonce":3236563974}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":4374,"qdb_cluster":[4374]},"id":1}]} 2024-09-11T00:14:23.996 INFO:teuthology.orchestra.run.smithi092.stderr:dumped fsmap epoch 6 2024-09-11T00:14:23.996 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:23.992+0000 7f3e11a2b640 1 -- 172.21.15.92:0/2763565243 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f3df8077fa0 msgr2=0x7f3df807a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:23.996 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:23.992+0000 7f3e11a2b640 1 --2- 172.21.15.92:0/2763565243 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f3df8077fa0 0x7f3df807a460 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f3dfc006fd0 tx=0x7f3dfc001f10 comp rx=0 tx=0).stop 2024-09-11T00:14:23.996 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:23.992+0000 7f3e11a2b640 1 -- 172.21.15.92:0/2763565243 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3e0c1f81a0 msgr2=0x7f3e0c1f8620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:23.996 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:23.993+0000 7f3e11a2b640 1 --2- 172.21.15.92:0/2763565243 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3e0c1f81a0 0x7f3e0c1f8620 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f3e04034040 tx=0x7f3e04005900 comp rx=0 tx=0).stop 2024-09-11T00:14:23.996 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:23.993+0000 7f3e11a2b640 1 -- 172.21.15.92:0/2763565243 shutdown_connections 2024-09-11T00:14:23.996 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:23.993+0000 7f3e11a2b640 1 --2- 172.21.15.92:0/2763565243 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f3df8077fa0 0x7f3df807a460 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:23.996 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:23.993+0000 7f3e11a2b640 1 --2- 172.21.15.92:0/2763565243 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3e0c1f81a0 0x7f3e0c1f8620 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:23.996 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:23.993+0000 7f3e11a2b640 1 --2- 172.21.15.92:0/2763565243 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3e0c1552d0 0x7f3e0c1f7c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:23.996 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:23.993+0000 7f3e11a2b640 1 --2- 172.21.15.92:0/2763565243 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3df4004d40 0x7f3e0c154d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:23.996 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:23.993+0000 7f3e11a2b640 1 -- 172.21.15.92:0/2763565243 >> 172.21.15.92:0/2763565243 conn(0x7f3e0c074150 msgr2=0x7f3e0c0b0f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:14:23.996 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:23.993+0000 7f3e11a2b640 1 -- 172.21.15.92:0/2763565243 shutdown_connections 2024-09-11T00:14:23.996 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:23.993+0000 7f3e11a2b640 1 -- 172.21.15.92:0/2763565243 wait complete. 2024-09-11T00:14:24.005 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T00:14:24.107 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:24.104+0000 7fc8899a0640 1 -- 172.21.15.92:0/4167133215 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc8840cff50 msgr2=0x7fc8840d0330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:24.107 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:24.104+0000 7fc8899a0640 1 --2- 172.21.15.92:0/4167133215 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc8840cff50 0x7fc8840d0330 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fc87c009830 tx=0x7fc87c02a510 comp rx=0 tx=0).stop 2024-09-11T00:14:24.107 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:24.104+0000 7fc8899a0640 1 -- 172.21.15.92:0/4167133215 shutdown_connections 2024-09-11T00:14:24.107 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:24.104+0000 7fc8899a0640 1 --2- 172.21.15.92:0/4167133215 >> v2:172.21.15.145:3300/0 conn(0x7fc88415f650 0x7fc8840d0870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:24.107 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:24.104+0000 7fc8899a0640 1 --2- 172.21.15.92:0/4167133215 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc8840cff50 0x7fc8840d0330 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:24.107 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:24.104+0000 7fc8899a0640 1 -- 172.21.15.92:0/4167133215 >> 172.21.15.92:0/4167133215 conn(0x7fc8840d1d70 msgr2=0x7fc8840d2180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:14:24.107 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:24.104+0000 7fc8899a0640 1 -- 172.21.15.92:0/4167133215 shutdown_connections 2024-09-11T00:14:24.108 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:24.105+0000 7fc8899a0640 1 -- 172.21.15.92:0/4167133215 wait complete. 2024-09-11T00:14:24.110 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:24.106+0000 7fc8899a0640 1 Processor -- start 2024-09-11T00:14:24.110 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:24.106+0000 7fc8899a0640 1 -- start start 2024-09-11T00:14:24.110 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:24.106+0000 7fc8899a0640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc8840b2dc0 0x7fc88414f450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:24.110 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:24.106+0000 7fc8899a0640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc8840cff50 0x7fc8841f3120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:24.110 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:24.107+0000 7fc8899a0640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc88415f650 0x7fc88414c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:24.110 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:24.107+0000 7fc8899a0640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fc8840aedc0 con 0x7fc88415f650 2024-09-11T00:14:24.110 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:24.107+0000 7fc8899a0640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fc8840aec40 con 0x7fc8840b2dc0 2024-09-11T00:14:24.110 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:24.107+0000 7fc8899a0640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7fc8840aef40 con 0x7fc8840cff50 2024-09-11T00:14:24.111 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:24.107+0000 7fc8837fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc88415f650 0x7fc88414c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:24.111 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:24.107+0000 7fc8837fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc88415f650 0x7fc88414c8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:57888/0 (socket says 172.21.15.92:57888) 2024-09-11T00:14:24.111 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:24.107+0000 7fc8837fe640 1 -- 172.21.15.92:0/2085690155 learned_addr learned my addr 172.21.15.92:0/2085690155 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-11T00:14:24.111 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:24.107+0000 7fc882ffd640 1 --2- 172.21.15.92:0/2085690155 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc8840b2dc0 0x7fc88414f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:24.111 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:24.107+0000 7fc8827fc640 1 --2- 172.21.15.92:0/2085690155 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc8840cff50 0x7fc8841f3120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:24.111 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:24.107+0000 7fc8837fe640 1 -- 172.21.15.92:0/2085690155 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc8840cff50 msgr2=0x7fc8841f3120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:24.111 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:24.107+0000 7fc8837fe640 1 --2- 172.21.15.92:0/2085690155 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc8840cff50 0x7fc8841f3120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:24.111 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:24.107+0000 7fc8837fe640 1 -- 172.21.15.92:0/2085690155 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc8840b2dc0 msgr2=0x7fc88414f450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:24.111 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:24.107+0000 7fc8837fe640 1 --2- 172.21.15.92:0/2085690155 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc8840b2dc0 0x7fc88414f450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:24.111 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:24.107+0000 7fc8837fe640 1 -- 172.21.15.92:0/2085690155 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc88414faa0 con 0x7fc88415f650 2024-09-11T00:14:24.112 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:24.107+0000 7fc8827fc640 1 --2- 172.21.15.92:0/2085690155 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc8840cff50 0x7fc8841f3120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:14:24.112 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:24.107+0000 7fc8837fe640 1 --2- 172.21.15.92:0/2085690155 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc88415f650 0x7fc88414c8d0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fc874009fd0 tx=0x7fc87400c740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:14:24.112 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:24.107+0000 7fc87bfff640 1 -- 172.21.15.92:0/2085690155 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc874003970 con 0x7fc88415f650 2024-09-11T00:14:24.112 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:24.107+0000 7fc87bfff640 1 -- 172.21.15.92:0/2085690155 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc874003c20 con 0x7fc88415f650 2024-09-11T00:14:24.112 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:24.107+0000 7fc8899a0640 1 -- 172.21.15.92:0/2085690155 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc88414fd80 con 0x7fc88415f650 2024-09-11T00:14:24.112 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:24.107+0000 7fc87bfff640 1 -- 172.21.15.92:0/2085690155 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc874004280 con 0x7fc88415f650 2024-09-11T00:14:24.112 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:24.107+0000 7fc8899a0640 1 -- 172.21.15.92:0/2085690155 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8840b4cd0 con 0x7fc88415f650 2024-09-11T00:14:24.112 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:24.108+0000 7fc8899a0640 1 -- 172.21.15.92:0/2085690155 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc8840af4d0 con 0x7fc88415f650 2024-09-11T00:14:24.113 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:24.109+0000 7fc87bfff640 1 -- 172.21.15.92:0/2085690155 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fc87400b040 con 0x7fc88415f650 2024-09-11T00:14:24.113 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:24.110+0000 7fc87bfff640 1 --2- 172.21.15.92:0/2085690155 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7fc864077f70 0x7fc86407a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:24.113 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:24.110+0000 7fc87bfff640 1 -- 172.21.15.92:0/2085690155 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fc87409a520 con 0x7fc88415f650 2024-09-11T00:14:24.113 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:24.110+0000 7fc882ffd640 1 --2- 172.21.15.92:0/2085690155 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7fc864077f70 0x7fc86407a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:24.113 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:24.110+0000 7fc882ffd640 1 --2- 172.21.15.92:0/2085690155 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7fc864077f70 0x7fc86407a430 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fc87c034000 tx=0x7fc87c004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:14:24.115 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:24.114+0000 7fc87bfff640 1 -- 172.21.15.92:0/2085690155 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fc874062d70 con 0x7fc88415f650 2024-09-11T00:14:24.288 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:24.287+0000 7fc8899a0640 1 -- 172.21.15.92:0/2085690155 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc8840b4ea0 con 0x7fc88415f650 2024-09-11T00:14:24.290 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:24.288+0000 7fc87bfff640 1 -- 172.21.15.92:0/2085690155 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18622 (secure 0 0 0) 0x7fc874062670 con 0x7fc88415f650 2024-09-11T00:14:24.290 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:14:24.290 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":25,"fsid":"47039cb3-5d2a-46bf-9066-8055b5dfc583","created":"2024-09-11T00:13:53.889939+0000","modified":"2024-09-11T00:14:23.001261+0000","last_up_change":"2024-09-11T00:14:06.563107+0000","last_in_change":"2024-09-11T00:13:56.982537+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T00:14:06.287223+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-11T00:14:15.739528+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-11T00:14:16.925480+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-11T00:14:20.639419+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"538af0ea-96c9-4999-9ccc-bee55f80ff76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":2860560077},{"type":"v1","addr":"172.21.15.92:6801","nonce":2860560077}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":2860560077},{"type":"v1","addr":"172.21.15.92:6803","nonce":2860560077}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":2860560077},{"type":"v1","addr":"172.21.15.92:6807","nonce":2860560077}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":2860560077},{"type":"v1","addr":"172.21.15.92:6805","nonce":2860560077}]},"public_addr":"172.21.15.92:6801/2860560077","cluster_addr":"172.21.15.92:6803/2860560077","heartbeat_back_addr":"172.21.15.92:6807/2860560077","heartbeat_front_addr":"172.21.15.92:6805/2860560077","state":["exists","up"]},{"osd":1,"uuid":"f9214f2c-ffe6-4447-9a13-9549a36e0537","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":2600417443},{"type":"v1","addr":"172.21.15.92:6817","nonce":2600417443}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6818","nonce":2600417443},{"type":"v1","addr":"172.21.15.92:6819","nonce":2600417443}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6822","nonce":2600417443},{"type":"v1","addr":"172.21.15.92:6823","nonce":2600417443}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":2600417443},{"type":"v1","addr":"172.21.15.92:6821","nonce":2600417443}]},"public_addr":"172.21.15.92:6817/2600417443","cluster_addr":"172.21.15.92:6819/2600417443","heartbeat_back_addr":"172.21.15.92:6823/2600417443","heartbeat_front_addr":"172.21.15.92:6821/2600417443","state":["exists","up"]},{"osd":2,"uuid":"b44dd849-fb85-42b1-8a1a-b6681bb1f467","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":3143892898},{"type":"v1","addr":"172.21.15.92:6809","nonce":3143892898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":3143892898},{"type":"v1","addr":"172.21.15.92:6811","nonce":3143892898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":3143892898},{"type":"v1","addr":"172.21.15.92:6815","nonce":3143892898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":3143892898},{"type":"v1","addr":"172.21.15.92:6813","nonce":3143892898}]},"public_addr":"172.21.15.92:6809/3143892898","cluster_addr":"172.21.15.92:6811/3143892898","heartbeat_back_addr":"172.21.15.92:6815/3143892898","heartbeat_front_addr":"172.21.15.92:6813/3143892898","state":["exists","up"]},{"osd":3,"uuid":"05a49d87-23b9-48dd-962c-d5c2686e7a32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":3913961488},{"type":"v1","addr":"172.21.15.92:6825","nonce":3913961488}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6826","nonce":3913961488},{"type":"v1","addr":"172.21.15.92:6827","nonce":3913961488}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":3913961488},{"type":"v1","addr":"172.21.15.92:6831","nonce":3913961488}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":3913961488},{"type":"v1","addr":"172.21.15.92:6829","nonce":3913961488}]},"public_addr":"172.21.15.92:6825/3913961488","cluster_addr":"172.21.15.92:6827/3913961488","heartbeat_back_addr":"172.21.15.92:6831/3913961488","heartbeat_front_addr":"172.21.15.92:6829/3913961488","state":["exists","up"]},{"osd":4,"uuid":"cf52b087-afe0-4f43-a4e7-db2ebc158815","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6826","nonce":2206798907},{"type":"v1","addr":"172.21.15.145:6827","nonce":2206798907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6828","nonce":2206798907},{"type":"v1","addr":"172.21.15.145:6829","nonce":2206798907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6832","nonce":2206798907},{"type":"v1","addr":"172.21.15.145:6833","nonce":2206798907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6830","nonce":2206798907},{"type":"v1","addr":"172.21.15.145:6831","nonce":2206798907}]},"public_addr":"172.21.15.145:6827/2206798907","cluster_addr":"172.21.15.145:6829/2206798907","heartbeat_back_addr":"172.21.15.145:6833/2206798907","heartbeat_front_addr":"172.21.15.145:6831/2206798907","state":["exists","up"]},{"osd":5,"uuid":"0e54adcd-2d1d-49fb-bf97-3dd7e9addd30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6810","nonce":2599548493},{"type":"v1","addr":"172.21.15.145:6811","nonce":2599548493}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6812","nonce":2599548493},{"type":"v1","addr":"172.21.15.145:6813","nonce":2599548493}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6816","nonce":2599548493},{"type":"v1","addr":"172.21.15.145:6817","nonce":2599548493}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6814","nonce":2599548493},{"type":"v1","addr":"172.21.15.145:6815","nonce":2599548493}]},"public_addr":"172.21.15.145:6811/2599548493","cluster_addr":"172.21.15.145:6813/2599548493","heartbeat_back_addr":"172.21.15.145:6817/2599548493","heartbeat_front_addr":"172.21.15.145:6815/2599548493","state":["exists","up"]},{"osd":6,"uuid":"4d5ae7a8-b3df-4c7a-9124-290f239f5b57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6802","nonce":4192380792},{"type":"v1","addr":"172.21.15.145:6803","nonce":4192380792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6804","nonce":4192380792},{"type":"v1","addr":"172.21.15.145:6805","nonce":4192380792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6808","nonce":4192380792},{"type":"v1","addr":"172.21.15.145:6809","nonce":4192380792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6806","nonce":4192380792},{"type":"v1","addr":"172.21.15.145:6807","nonce":4192380792}]},"public_addr":"172.21.15.145:6803/4192380792","cluster_addr":"172.21.15.145:6805/4192380792","heartbeat_back_addr":"172.21.15.145:6809/4192380792","heartbeat_front_addr":"172.21.15.145:6807/4192380792","state":["exists","up"]},{"osd":7,"uuid":"d7e36444-6e3f-4372-81d3-88e7b4e993f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6818","nonce":3010598400},{"type":"v1","addr":"172.21.15.145:6819","nonce":3010598400}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6820","nonce":3010598400},{"type":"v1","addr":"172.21.15.145:6821","nonce":3010598400}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6824","nonce":3010598400},{"type":"v1","addr":"172.21.15.145:6825","nonce":3010598400}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6822","nonce":3010598400},{"type":"v1","addr":"172.21.15.145:6823","nonce":3010598400}]},"public_addr":"172.21.15.145:6819/3010598400","cluster_addr":"172.21.15.145:6821/3010598400","heartbeat_back_addr":"172.21.15.145:6825/3010598400","heartbeat_front_addr":"172.21.15.145:6823/3010598400","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:14:03.281892+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:14:04.039021+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:14:03.045775+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:14:03.708856+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:14:04.425520+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:14:03.839369+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:14:03.029834+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:14:03.707529+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T00:14:24.292 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:24.290+0000 7fc8899a0640 1 -- 172.21.15.92:0/2085690155 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7fc864077f70 msgr2=0x7fc86407a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:24.292 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:24.290+0000 7fc8899a0640 1 --2- 172.21.15.92:0/2085690155 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7fc864077f70 0x7fc86407a430 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fc87c034000 tx=0x7fc87c004730 comp rx=0 tx=0).stop 2024-09-11T00:14:24.292 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:24.290+0000 7fc8899a0640 1 -- 172.21.15.92:0/2085690155 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc88415f650 msgr2=0x7fc88414c8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:24.292 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:24.290+0000 7fc8899a0640 1 --2- 172.21.15.92:0/2085690155 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc88415f650 0x7fc88414c8d0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fc874009fd0 tx=0x7fc87400c740 comp rx=0 tx=0).stop 2024-09-11T00:14:24.293 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:24.290+0000 7fc8899a0640 1 -- 172.21.15.92:0/2085690155 shutdown_connections 2024-09-11T00:14:24.293 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:24.290+0000 7fc8899a0640 1 --2- 172.21.15.92:0/2085690155 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7fc864077f70 0x7fc86407a430 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:24.293 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:24.290+0000 7fc8899a0640 1 --2- 172.21.15.92:0/2085690155 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc88415f650 0x7fc88414c8d0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:24.293 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:24.290+0000 7fc8899a0640 1 --2- 172.21.15.92:0/2085690155 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc8840cff50 0x7fc8841f3120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:24.293 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:24.290+0000 7fc8899a0640 1 --2- 172.21.15.92:0/2085690155 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc8840b2dc0 0x7fc88414f450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:24.293 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:24.290+0000 7fc8899a0640 1 -- 172.21.15.92:0/2085690155 >> 172.21.15.92:0/2085690155 conn(0x7fc8840d1d70 msgr2=0x7fc8840cc810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:14:24.293 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:24.290+0000 7fc8899a0640 1 -- 172.21.15.92:0/2085690155 shutdown_connections 2024-09-11T00:14:24.293 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:24.290+0000 7fc8899a0640 1 -- 172.21.15.92:0/2085690155 wait complete. 2024-09-11T00:14:24.303 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T00:14:24.403 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:24.401+0000 7fbc16932640 1 -- 172.21.15.92:0/1334894295 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbc10144780 msgr2=0x7fbc100b3da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:24.403 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:24.401+0000 7fbc16932640 1 --2- 172.21.15.92:0/1334894295 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbc10144780 0x7fbc100b3da0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fbc00009830 tx=0x7fbc0002a480 comp rx=0 tx=0).stop 2024-09-11T00:14:24.403 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:24.401+0000 7fbc16932640 1 -- 172.21.15.92:0/1334894295 shutdown_connections 2024-09-11T00:14:24.404 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:24.401+0000 7fbc16932640 1 --2- 172.21.15.92:0/1334894295 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fbc100cf210 0x7fbc1015c550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:24.404 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:24.401+0000 7fbc16932640 1 --2- 172.21.15.92:0/1334894295 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbc10144780 0x7fbc100b3da0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:24.404 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:24.401+0000 7fbc16932640 1 -- 172.21.15.92:0/1334894295 >> 172.21.15.92:0/1334894295 conn(0x7fbc100b1760 msgr2=0x7fbc100b1b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:14:24.404 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:24.401+0000 7fbc16932640 1 -- 172.21.15.92:0/1334894295 shutdown_connections 2024-09-11T00:14:24.404 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:24.401+0000 7fbc16932640 1 -- 172.21.15.92:0/1334894295 wait complete. 2024-09-11T00:14:24.404 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:24.402+0000 7fbc16932640 1 Processor -- start 2024-09-11T00:14:24.404 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:24.403+0000 7fbc16932640 1 -- start start 2024-09-11T00:14:24.406 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:24.403+0000 7fbc16932640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fbc10072680 0x7fbc100aee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:24.406 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:24.403+0000 7fbc16932640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbc100cf210 0x7fbc100b0820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:24.406 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:24.403+0000 7fbc16932640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbc10144780 0x7fbc100b0d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:24.406 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:24.403+0000 7fbc16932640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fbc1015ca90 con 0x7fbc100cf210 2024-09-11T00:14:24.406 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:24.403+0000 7fbc16932640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fbc10072d60 con 0x7fbc10144780 2024-09-11T00:14:24.406 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:24.403+0000 7fbc16932640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7fbc1015cc10 con 0x7fbc10072680 2024-09-11T00:14:24.407 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:24.403+0000 7fbc0f7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbc100cf210 0x7fbc100b0820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:24.407 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:24.404+0000 7fbc0f7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbc100cf210 0x7fbc100b0820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:41532/0 (socket says 172.21.15.92:41532) 2024-09-11T00:14:24.407 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:24.404+0000 7fbc0f7fe640 1 -- 172.21.15.92:0/3691268385 learned_addr learned my addr 172.21.15.92:0/3691268385 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-11T00:14:24.407 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:24.404+0000 7fbc0ffff640 1 --2- 172.21.15.92:0/3691268385 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fbc10072680 0x7fbc100aee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:24.407 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:24.404+0000 7fbc14ecf640 1 --2- 172.21.15.92:0/3691268385 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbc10144780 0x7fbc100b0d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:24.407 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:24.404+0000 7fbc0f7fe640 1 -- 172.21.15.92:0/3691268385 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fbc10072680 msgr2=0x7fbc100aee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:24.407 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:24.404+0000 7fbc0f7fe640 1 --2- 172.21.15.92:0/3691268385 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fbc10072680 0x7fbc100aee60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:24.407 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:24.404+0000 7fbc0f7fe640 1 -- 172.21.15.92:0/3691268385 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbc10144780 msgr2=0x7fbc100b0d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:24.407 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:24.404+0000 7fbc0f7fe640 1 --2- 172.21.15.92:0/3691268385 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbc10144780 0x7fbc100b0d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:24.407 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:24.404+0000 7fbc0f7fe640 1 -- 172.21.15.92:0/3691268385 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc101f8c50 con 0x7fbc100cf210 2024-09-11T00:14:24.407 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:24.404+0000 7fbc0ffff640 1 --2- 172.21.15.92:0/3691268385 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fbc10072680 0x7fbc100aee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:14:24.407 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:24.404+0000 7fbc14ecf640 1 --2- 172.21.15.92:0/3691268385 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbc10144780 0x7fbc100b0d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:14:24.407 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:24.404+0000 7fbc0f7fe640 1 --2- 172.21.15.92:0/3691268385 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbc100cf210 0x7fbc100b0820 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fbc0400c500 tx=0x7fbc0400c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:14:24.408 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:24.404+0000 7fbc0cff9640 1 -- 172.21.15.92:0/3691268385 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc04011790 con 0x7fbc100cf210 2024-09-11T00:14:24.408 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:24.404+0000 7fbc0cff9640 1 -- 172.21.15.92:0/3691268385 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbc04017070 con 0x7fbc100cf210 2024-09-11T00:14:24.408 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:24.404+0000 7fbc0cff9640 1 -- 172.21.15.92:0/3691268385 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc04011ce0 con 0x7fbc100cf210 2024-09-11T00:14:24.408 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:24.404+0000 7fbc16932640 1 -- 172.21.15.92:0/3691268385 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc101f4bf0 con 0x7fbc100cf210 2024-09-11T00:14:24.408 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:24.404+0000 7fbc16932640 1 -- 172.21.15.92:0/3691268385 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc100af3a0 con 0x7fbc100cf210 2024-09-11T00:14:24.409 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:24.405+0000 7fbc16932640 1 -- 172.21.15.92:0/3691268385 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbc1015c550 con 0x7fbc100cf210 2024-09-11T00:14:24.409 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:24.406+0000 7fbc0cff9640 1 -- 172.21.15.92:0/3691268385 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fbc0401c460 con 0x7fbc100cf210 2024-09-11T00:14:24.409 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:24.406+0000 7fbc0cff9640 1 --2- 172.21.15.92:0/3691268385 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7fbbfc077f70 0x7fbbfc07a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:24.409 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:24.407+0000 7fbc0cff9640 1 -- 172.21.15.92:0/3691268385 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fbc04099d00 con 0x7fbc100cf210 2024-09-11T00:14:24.409 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:24.407+0000 7fbc0ffff640 1 --2- 172.21.15.92:0/3691268385 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7fbbfc077f70 0x7fbbfc07a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:24.409 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:24.407+0000 7fbc0ffff640 1 --2- 172.21.15.92:0/3691268385 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7fbbfc077f70 0x7fbbfc07a430 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fbc00034000 tx=0x7fbc00004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:14:24.412 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:24.411+0000 7fbc0cff9640 1 -- 172.21.15.92:0/3691268385 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fbc04062550 con 0x7fbc100cf210 2024-09-11T00:14:24.589 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:24.587+0000 7fbc16932640 1 -- 172.21.15.92:0/3691268385 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fbc10070740 con 0x7fbc100cf210 2024-09-11T00:14:24.590 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:24.588+0000 7fbc0cff9640 1 -- 172.21.15.92:0/3691268385 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18622 (secure 0 0 0) 0x7fbc04061e50 con 0x7fbc100cf210 2024-09-11T00:14:24.590 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:14:24.590 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":25,"fsid":"47039cb3-5d2a-46bf-9066-8055b5dfc583","created":"2024-09-11T00:13:53.889939+0000","modified":"2024-09-11T00:14:23.001261+0000","last_up_change":"2024-09-11T00:14:06.563107+0000","last_in_change":"2024-09-11T00:13:56.982537+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T00:14:06.287223+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-11T00:14:15.739528+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-11T00:14:16.925480+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-11T00:14:20.639419+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"538af0ea-96c9-4999-9ccc-bee55f80ff76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":2860560077},{"type":"v1","addr":"172.21.15.92:6801","nonce":2860560077}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":2860560077},{"type":"v1","addr":"172.21.15.92:6803","nonce":2860560077}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":2860560077},{"type":"v1","addr":"172.21.15.92:6807","nonce":2860560077}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":2860560077},{"type":"v1","addr":"172.21.15.92:6805","nonce":2860560077}]},"public_addr":"172.21.15.92:6801/2860560077","cluster_addr":"172.21.15.92:6803/2860560077","heartbeat_back_addr":"172.21.15.92:6807/2860560077","heartbeat_front_addr":"172.21.15.92:6805/2860560077","state":["exists","up"]},{"osd":1,"uuid":"f9214f2c-ffe6-4447-9a13-9549a36e0537","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":2600417443},{"type":"v1","addr":"172.21.15.92:6817","nonce":2600417443}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6818","nonce":2600417443},{"type":"v1","addr":"172.21.15.92:6819","nonce":2600417443}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6822","nonce":2600417443},{"type":"v1","addr":"172.21.15.92:6823","nonce":2600417443}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":2600417443},{"type":"v1","addr":"172.21.15.92:6821","nonce":2600417443}]},"public_addr":"172.21.15.92:6817/2600417443","cluster_addr":"172.21.15.92:6819/2600417443","heartbeat_back_addr":"172.21.15.92:6823/2600417443","heartbeat_front_addr":"172.21.15.92:6821/2600417443","state":["exists","up"]},{"osd":2,"uuid":"b44dd849-fb85-42b1-8a1a-b6681bb1f467","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":3143892898},{"type":"v1","addr":"172.21.15.92:6809","nonce":3143892898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":3143892898},{"type":"v1","addr":"172.21.15.92:6811","nonce":3143892898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":3143892898},{"type":"v1","addr":"172.21.15.92:6815","nonce":3143892898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":3143892898},{"type":"v1","addr":"172.21.15.92:6813","nonce":3143892898}]},"public_addr":"172.21.15.92:6809/3143892898","cluster_addr":"172.21.15.92:6811/3143892898","heartbeat_back_addr":"172.21.15.92:6815/3143892898","heartbeat_front_addr":"172.21.15.92:6813/3143892898","state":["exists","up"]},{"osd":3,"uuid":"05a49d87-23b9-48dd-962c-d5c2686e7a32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":3913961488},{"type":"v1","addr":"172.21.15.92:6825","nonce":3913961488}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6826","nonce":3913961488},{"type":"v1","addr":"172.21.15.92:6827","nonce":3913961488}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":3913961488},{"type":"v1","addr":"172.21.15.92:6831","nonce":3913961488}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":3913961488},{"type":"v1","addr":"172.21.15.92:6829","nonce":3913961488}]},"public_addr":"172.21.15.92:6825/3913961488","cluster_addr":"172.21.15.92:6827/3913961488","heartbeat_back_addr":"172.21.15.92:6831/3913961488","heartbeat_front_addr":"172.21.15.92:6829/3913961488","state":["exists","up"]},{"osd":4,"uuid":"cf52b087-afe0-4f43-a4e7-db2ebc158815","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6826","nonce":2206798907},{"type":"v1","addr":"172.21.15.145:6827","nonce":2206798907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6828","nonce":2206798907},{"type":"v1","addr":"172.21.15.145:6829","nonce":2206798907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6832","nonce":2206798907},{"type":"v1","addr":"172.21.15.145:6833","nonce":2206798907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6830","nonce":2206798907},{"type":"v1","addr":"172.21.15.145:6831","nonce":2206798907}]},"public_addr":"172.21.15.145:6827/2206798907","cluster_addr":"172.21.15.145:6829/2206798907","heartbeat_back_addr":"172.21.15.145:6833/2206798907","heartbeat_front_addr":"172.21.15.145:6831/2206798907","state":["exists","up"]},{"osd":5,"uuid":"0e54adcd-2d1d-49fb-bf97-3dd7e9addd30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6810","nonce":2599548493},{"type":"v1","addr":"172.21.15.145:6811","nonce":2599548493}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6812","nonce":2599548493},{"type":"v1","addr":"172.21.15.145:6813","nonce":2599548493}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6816","nonce":2599548493},{"type":"v1","addr":"172.21.15.145:6817","nonce":2599548493}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6814","nonce":2599548493},{"type":"v1","addr":"172.21.15.145:6815","nonce":2599548493}]},"public_addr":"172.21.15.145:6811/2599548493","cluster_addr":"172.21.15.145:6813/2599548493","heartbeat_back_addr":"172.21.15.145:6817/2599548493","heartbeat_front_addr":"172.21.15.145:6815/2599548493","state":["exists","up"]},{"osd":6,"uuid":"4d5ae7a8-b3df-4c7a-9124-290f239f5b57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6802","nonce":4192380792},{"type":"v1","addr":"172.21.15.145:6803","nonce":4192380792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6804","nonce":4192380792},{"type":"v1","addr":"172.21.15.145:6805","nonce":4192380792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6808","nonce":4192380792},{"type":"v1","addr":"172.21.15.145:6809","nonce":4192380792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6806","nonce":4192380792},{"type":"v1","addr":"172.21.15.145:6807","nonce":4192380792}]},"public_addr":"172.21.15.145:6803/4192380792","cluster_addr":"172.21.15.145:6805/4192380792","heartbeat_back_addr":"172.21.15.145:6809/4192380792","heartbeat_front_addr":"172.21.15.145:6807/4192380792","state":["exists","up"]},{"osd":7,"uuid":"d7e36444-6e3f-4372-81d3-88e7b4e993f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6818","nonce":3010598400},{"type":"v1","addr":"172.21.15.145:6819","nonce":3010598400}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6820","nonce":3010598400},{"type":"v1","addr":"172.21.15.145:6821","nonce":3010598400}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6824","nonce":3010598400},{"type":"v1","addr":"172.21.15.145:6825","nonce":3010598400}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6822","nonce":3010598400},{"type":"v1","addr":"172.21.15.145:6823","nonce":3010598400}]},"public_addr":"172.21.15.145:6819/3010598400","cluster_addr":"172.21.15.145:6821/3010598400","heartbeat_back_addr":"172.21.15.145:6825/3010598400","heartbeat_front_addr":"172.21.15.145:6823/3010598400","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:14:03.281892+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:14:04.039021+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:14:03.045775+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:14:03.708856+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:14:04.425520+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:14:03.839369+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:14:03.029834+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:14:03.707529+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T00:14:24.592 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:24.590+0000 7fbc16932640 1 -- 172.21.15.92:0/3691268385 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7fbbfc077f70 msgr2=0x7fbbfc07a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:24.592 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:24.590+0000 7fbc16932640 1 --2- 172.21.15.92:0/3691268385 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7fbbfc077f70 0x7fbbfc07a430 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fbc00034000 tx=0x7fbc00004730 comp rx=0 tx=0).stop 2024-09-11T00:14:24.592 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:24.590+0000 7fbc16932640 1 -- 172.21.15.92:0/3691268385 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbc100cf210 msgr2=0x7fbc100b0820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:24.592 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:24.590+0000 7fbc16932640 1 --2- 172.21.15.92:0/3691268385 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbc100cf210 0x7fbc100b0820 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fbc0400c500 tx=0x7fbc0400c900 comp rx=0 tx=0).stop 2024-09-11T00:14:24.592 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:24.590+0000 7fbc16932640 1 -- 172.21.15.92:0/3691268385 shutdown_connections 2024-09-11T00:14:24.593 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:24.590+0000 7fbc16932640 1 --2- 172.21.15.92:0/3691268385 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7fbbfc077f70 0x7fbbfc07a430 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:24.593 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:24.590+0000 7fbc16932640 1 --2- 172.21.15.92:0/3691268385 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbc10144780 0x7fbc100b0d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:24.593 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:24.590+0000 7fbc16932640 1 --2- 172.21.15.92:0/3691268385 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbc100cf210 0x7fbc100b0820 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:24.593 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:24.590+0000 7fbc16932640 1 --2- 172.21.15.92:0/3691268385 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fbc10072680 0x7fbc100aee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:24.593 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:24.590+0000 7fbc16932640 1 -- 172.21.15.92:0/3691268385 >> 172.21.15.92:0/3691268385 conn(0x7fbc100b1760 msgr2=0x7fbc1015b1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:14:24.593 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:24.590+0000 7fbc16932640 1 -- 172.21.15.92:0/3691268385 shutdown_connections 2024-09-11T00:14:24.593 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:24.591+0000 7fbc16932640 1 -- 172.21.15.92:0/3691268385 wait complete. 2024-09-11T00:14:24.620 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T00:14:24.722 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:24.720+0000 7f20187bb640 1 -- 172.21.15.92:0/1546365555 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1ff8004d40 msgr2=0x7f1ff80051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:24.723 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:24.720+0000 7f20187bb640 1 --2- 172.21.15.92:0/1546365555 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1ff8004d40 0x7f1ff80051c0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f2000005fd0 tx=0x7f1ff8005830 comp rx=0 tx=0).stop 2024-09-11T00:14:24.723 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:24.720+0000 7f2016d58640 1 -- 172.21.15.92:0/1546365555 reap_dead start 2024-09-11T00:14:24.723 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:24.721+0000 7f20187bb640 1 -- 172.21.15.92:0/1546365555 shutdown_connections 2024-09-11T00:14:24.723 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:24.721+0000 7f20187bb640 1 -- 172.21.15.92:0/1546365555 >> 172.21.15.92:0/1546365555 conn(0x7f20100d0c00 msgr2=0x7f20100d0fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:14:24.723 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:24.721+0000 7f20187bb640 1 -- 172.21.15.92:0/1546365555 shutdown_connections 2024-09-11T00:14:24.723 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:24.721+0000 7f20187bb640 1 -- 172.21.15.92:0/1546365555 wait complete. 2024-09-11T00:14:24.723 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:24.722+0000 7f20187bb640 1 Processor -- start 2024-09-11T00:14:24.724 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:24.722+0000 7f20187bb640 1 -- start start 2024-09-11T00:14:24.725 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:24.722+0000 7f20187bb640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1ff8004d40 0x7f201013caa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:24.725 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:24.722+0000 7f20187bb640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f201014b210 0x7f20100a9480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:24.726 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:24.722+0000 7f20187bb640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2010140590 0x7f20101f5dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:24.726 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:24.723+0000 7f20187bb640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f20100d16f0 con 0x7f2010140590 2024-09-11T00:14:24.726 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:24.723+0000 7f20187bb640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f2010145bf0 con 0x7f201014b210 2024-09-11T00:14:24.726 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:24.723+0000 7f20187bb640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f20100d1870 con 0x7f1ff8004d40 2024-09-11T00:14:24.726 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:24.723+0000 7f2016d58640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2010140590 0x7f20101f5dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:24.726 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:24.723+0000 7f2016d58640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2010140590 0x7f20101f5dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:41544/0 (socket says 172.21.15.92:41544) 2024-09-11T00:14:24.726 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:24.723+0000 7f2016d58640 1 -- 172.21.15.92:0/4092815504 learned_addr learned my addr 172.21.15.92:0/4092815504 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-11T00:14:24.726 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:24.723+0000 7f2015d56640 1 --2- 172.21.15.92:0/4092815504 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f201014b210 0x7f20100a9480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:24.726 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:24.723+0000 7f2016557640 1 --2- 172.21.15.92:0/4092815504 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1ff8004d40 0x7f201013caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:24.726 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:24.723+0000 7f2016d58640 1 -- 172.21.15.92:0/4092815504 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1ff8004d40 msgr2=0x7f201013caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:24.726 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:24.723+0000 7f2016d58640 1 --2- 172.21.15.92:0/4092815504 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1ff8004d40 0x7f201013caa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:24.726 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:24.723+0000 7f2016d58640 1 -- 172.21.15.92:0/4092815504 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f201014b210 msgr2=0x7f20100a9480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:24.726 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:24.723+0000 7f2016d58640 1 --2- 172.21.15.92:0/4092815504 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f201014b210 0x7f20100a9480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:24.726 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:24.723+0000 7f2016d58640 1 -- 172.21.15.92:0/4092815504 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f201013cfe0 con 0x7f2010140590 2024-09-11T00:14:24.727 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:24.723+0000 7f2015d56640 1 --2- 172.21.15.92:0/4092815504 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f201014b210 0x7f20100a9480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:14:24.727 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:24.723+0000 7f2016d58640 1 --2- 172.21.15.92:0/4092815504 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2010140590 0x7f20101f5dd0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f2000005fd0 tx=0x7f2000033670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:14:24.727 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:24.723+0000 7f200effd640 1 -- 172.21.15.92:0/4092815504 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2000038040 con 0x7f2010140590 2024-09-11T00:14:24.727 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:24.723+0000 7f200effd640 1 -- 172.21.15.92:0/4092815504 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f200002b670 con 0x7f2010140590 2024-09-11T00:14:24.727 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:24.723+0000 7f20187bb640 1 -- 172.21.15.92:0/4092815504 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20100a99c0 con 0x7f2010140590 2024-09-11T00:14:24.727 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:24.723+0000 7f200effd640 1 -- 172.21.15.92:0/4092815504 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2000004d40 con 0x7f2010140590 2024-09-11T00:14:24.727 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:24.723+0000 7f20187bb640 1 -- 172.21.15.92:0/4092815504 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f201014e110 con 0x7f2010140590 2024-09-11T00:14:24.728 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:24.724+0000 7f20187bb640 1 -- 172.21.15.92:0/4092815504 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f20100cf090 con 0x7f2010140590 2024-09-11T00:14:24.728 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:24.725+0000 7f200effd640 1 -- 172.21.15.92:0/4092815504 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f200003b050 con 0x7f2010140590 2024-09-11T00:14:24.728 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:24.725+0000 7f200effd640 1 --2- 172.21.15.92:0/4092815504 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f1ffc077fa0 0x7f1ffc07a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:24.728 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:24.725+0000 7f200effd640 1 -- 172.21.15.92:0/4092815504 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f20000b9ef0 con 0x7f2010140590 2024-09-11T00:14:24.728 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:24.726+0000 7f2016557640 1 --2- 172.21.15.92:0/4092815504 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f1ffc077fa0 0x7f1ffc07a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:24.728 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:24.726+0000 7f2016557640 1 --2- 172.21.15.92:0/4092815504 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f1ffc077fa0 0x7f1ffc07a460 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f2008001d50 tx=0x7f2008001ce0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:14:24.731 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:24.729+0000 7f200effd640 1 -- 172.21.15.92:0/4092815504 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f201013cfe0 con 0x7f2010140590 2024-09-11T00:14:24.939 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:24.938+0000 7f20187bb640 1 -- 172.21.15.92:0/4092815504 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f201006d360 con 0x7f2010140590 2024-09-11T00:14:24.940 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:24.938+0000 7f200effd640 1 -- 172.21.15.92:0/4092815504 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+5225 (secure 0 0 0) 0x7f2000082740 con 0x7f2010140590 2024-09-11T00:14:24.940 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:14:24.940 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":6,"btime":"2024-09-11T00:14:23:644465+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4286,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/2051794804","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":2051794804},{"type":"v1","addr":"172.21.15.92:6835","nonce":2051794804}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4295,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6835/1341143168","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6834","nonce":1341143168},{"type":"v1","addr":"172.21.15.145:6835","nonce":1341143168}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4356,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6833/3149311196","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":3149311196},{"type":"v1","addr":"172.21.15.92:6833","nonce":3149311196}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T00:14:17.969166+0000","modified":"2024-09-11T00:14:23.001417+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4374},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4374":{"gid":4374,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.145:6837/3236563974","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6836","nonce":3236563974},{"type":"v1","addr":"172.21.15.145:6837","nonce":3236563974}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":4374,"qdb_cluster":[4374]},"id":1}]} 2024-09-11T00:14:24.940 INFO:teuthology.orchestra.run.smithi092.stderr:dumped fsmap epoch 6 2024-09-11T00:14:24.942 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:24.940+0000 7f20187bb640 1 -- 172.21.15.92:0/4092815504 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f1ffc077fa0 msgr2=0x7f1ffc07a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:24.942 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:24.940+0000 7f20187bb640 1 --2- 172.21.15.92:0/4092815504 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f1ffc077fa0 0x7f1ffc07a460 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f2008001d50 tx=0x7f2008001ce0 comp rx=0 tx=0).stop 2024-09-11T00:14:24.942 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:24.940+0000 7f20187bb640 1 -- 172.21.15.92:0/4092815504 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2010140590 msgr2=0x7f20101f5dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:24.942 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:24.940+0000 7f20187bb640 1 --2- 172.21.15.92:0/4092815504 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2010140590 0x7f20101f5dd0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f2000005fd0 tx=0x7f2000033670 comp rx=0 tx=0).stop 2024-09-11T00:14:24.942 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:24.940+0000 7f20187bb640 1 -- 172.21.15.92:0/4092815504 shutdown_connections 2024-09-11T00:14:24.944 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:24.940+0000 7f20187bb640 1 --2- 172.21.15.92:0/4092815504 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f1ffc077fa0 0x7f1ffc07a460 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:24.944 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:24.940+0000 7f20187bb640 1 --2- 172.21.15.92:0/4092815504 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2010140590 0x7f20101f5dd0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:24.944 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:24.940+0000 7f20187bb640 1 --2- 172.21.15.92:0/4092815504 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f201014b210 0x7f20100a9480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:24.944 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:24.940+0000 7f20187bb640 1 --2- 172.21.15.92:0/4092815504 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1ff8004d40 0x7f201013caa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:24.944 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:24.940+0000 7f20187bb640 1 -- 172.21.15.92:0/4092815504 >> 172.21.15.92:0/4092815504 conn(0x7f20100d0c00 msgr2=0x7f201015a400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:14:24.944 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:24.940+0000 7f20187bb640 1 -- 172.21.15.92:0/4092815504 shutdown_connections 2024-09-11T00:14:24.944 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:24.940+0000 7f20187bb640 1 -- 172.21.15.92:0/4092815504 wait complete. 2024-09-11T00:14:24.952 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T00:14:25.053 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.051+0000 7f417ebc6640 1 -- 172.21.15.92:0/3863013730 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f417815e150 msgr2=0x7f417815e530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:25.053 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.051+0000 7f417ebc6640 1 --2- 172.21.15.92:0/3863013730 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f417815e150 0x7f417815e530 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f4168005fd0 tx=0x7f416802a8b0 comp rx=0 tx=0).stop 2024-09-11T00:14:25.053 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.051+0000 7f417ebc6640 1 -- 172.21.15.92:0/3863013730 shutdown_connections 2024-09-11T00:14:25.053 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.051+0000 7f417ebc6640 1 --2- 172.21.15.92:0/3863013730 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f417806e2e0 0x7f41780b47b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:25.053 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.051+0000 7f417ebc6640 1 --2- 172.21.15.92:0/3863013730 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f417815e150 0x7f417815e530 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:25.053 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.051+0000 7f417ebc6640 1 -- 172.21.15.92:0/3863013730 >> 172.21.15.92:0/3863013730 conn(0x7f41780b1760 msgr2=0x7f41780b1b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:14:25.053 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.051+0000 7f417ebc6640 1 -- 172.21.15.92:0/3863013730 shutdown_connections 2024-09-11T00:14:25.054 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.051+0000 7f417ebc6640 1 -- 172.21.15.92:0/3863013730 wait complete. 2024-09-11T00:14:25.054 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.052+0000 7f417ebc6640 1 Processor -- start 2024-09-11T00:14:25.054 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.052+0000 7f417ebc6640 1 -- start start 2024-09-11T00:14:25.056 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.053+0000 7f417ebc6640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f417806e2e0 0x7f41781f52e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:25.056 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.053+0000 7f417ebc6640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f41780725d0 0x7f4178159520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:25.056 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.053+0000 7f417ebc6640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f417815e150 0x7f417814ad80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:25.056 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.053+0000 7f417ebc6640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f41780cc570 con 0x7f417806e2e0 2024-09-11T00:14:25.056 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.053+0000 7f417ebc6640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f41780cf3e0 con 0x7f41780725d0 2024-09-11T00:14:25.056 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.053+0000 7f417ebc6640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f41780cc6f0 con 0x7f417815e150 2024-09-11T00:14:25.056 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.053+0000 7f417c962640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f417806e2e0 0x7f41781f52e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:25.056 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.053+0000 7f417c962640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f417806e2e0 0x7f41781f52e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:41558/0 (socket says 172.21.15.92:41558) 2024-09-11T00:14:25.056 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.053+0000 7f417c962640 1 -- 172.21.15.92:0/3364795843 learned_addr learned my addr 172.21.15.92:0/3364795843 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-11T00:14:25.056 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.053+0000 7f417c962640 1 -- 172.21.15.92:0/3364795843 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f417815e150 msgr2=0x7f417814ad80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:25.056 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.053+0000 7f417c962640 1 --2- 172.21.15.92:0/3364795843 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f417815e150 0x7f417814ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:25.056 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.053+0000 7f417c962640 1 -- 172.21.15.92:0/3364795843 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f41780725d0 msgr2=0x7f4178159520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:25.056 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.053+0000 7f417c962640 1 --2- 172.21.15.92:0/3364795843 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f41780725d0 0x7f4178159520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:25.057 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.053+0000 7f417c962640 1 -- 172.21.15.92:0/3364795843 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41781f4840 con 0x7f417806e2e0 2024-09-11T00:14:25.057 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.054+0000 7f417c962640 1 --2- 172.21.15.92:0/3364795843 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f417806e2e0 0x7f41781f52e0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f4168009cd0 tx=0x7f4168003a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:14:25.057 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.054+0000 7f41757fa640 1 -- 172.21.15.92:0/3364795843 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4168031b90 con 0x7f417806e2e0 2024-09-11T00:14:25.057 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.054+0000 7f41757fa640 1 -- 172.21.15.92:0/3364795843 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4168031e20 con 0x7f417806e2e0 2024-09-11T00:14:25.057 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.054+0000 7f417ebc6640 1 -- 172.21.15.92:0/3364795843 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41781f8c30 con 0x7f417806e2e0 2024-09-11T00:14:25.057 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.054+0000 7f41757fa640 1 -- 172.21.15.92:0/3364795843 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41680332d0 con 0x7f417806e2e0 2024-09-11T00:14:25.057 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.054+0000 7f417ebc6640 1 -- 172.21.15.92:0/3364795843 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41781f4ae0 con 0x7f417806e2e0 2024-09-11T00:14:25.058 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.055+0000 7f417ebc6640 1 -- 172.21.15.92:0/3364795843 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f41780ccba0 con 0x7f417806e2e0 2024-09-11T00:14:25.058 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.055+0000 7f41757fa640 1 -- 172.21.15.92:0/3364795843 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f416804b030 con 0x7f417806e2e0 2024-09-11T00:14:25.058 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.056+0000 7f41757fa640 1 --2- 172.21.15.92:0/3364795843 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f4158077f70 0x7f415807a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:25.058 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.056+0000 7f41757fa640 1 -- 172.21.15.92:0/3364795843 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f41680bb380 con 0x7f417806e2e0 2024-09-11T00:14:25.058 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.056+0000 7f4177fff640 1 --2- 172.21.15.92:0/3364795843 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f4158077f70 0x7f415807a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:25.058 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.056+0000 7f4177fff640 1 --2- 172.21.15.92:0/3364795843 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f4158077f70 0x7f415807a430 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f417814ad10 tx=0x7f4160005c70 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:14:25.061 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.060+0000 7f41757fa640 1 -- 172.21.15.92:0/3364795843 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f416803f030 con 0x7f417806e2e0 2024-09-11T00:14:25.236 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.234+0000 7f417ebc6640 1 -- 172.21.15.92:0/3364795843 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f41780cde00 con 0x7f417806e2e0 2024-09-11T00:14:25.237 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.235+0000 7f41757fa640 1 -- 172.21.15.92:0/3364795843 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18622 (secure 0 0 0) 0x7f4168083b40 con 0x7f417806e2e0 2024-09-11T00:14:25.237 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:14:25.237 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":25,"fsid":"47039cb3-5d2a-46bf-9066-8055b5dfc583","created":"2024-09-11T00:13:53.889939+0000","modified":"2024-09-11T00:14:23.001261+0000","last_up_change":"2024-09-11T00:14:06.563107+0000","last_in_change":"2024-09-11T00:13:56.982537+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T00:14:06.287223+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-11T00:14:15.739528+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-11T00:14:16.925480+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-11T00:14:20.639419+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"538af0ea-96c9-4999-9ccc-bee55f80ff76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":2860560077},{"type":"v1","addr":"172.21.15.92:6801","nonce":2860560077}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":2860560077},{"type":"v1","addr":"172.21.15.92:6803","nonce":2860560077}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":2860560077},{"type":"v1","addr":"172.21.15.92:6807","nonce":2860560077}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":2860560077},{"type":"v1","addr":"172.21.15.92:6805","nonce":2860560077}]},"public_addr":"172.21.15.92:6801/2860560077","cluster_addr":"172.21.15.92:6803/2860560077","heartbeat_back_addr":"172.21.15.92:6807/2860560077","heartbeat_front_addr":"172.21.15.92:6805/2860560077","state":["exists","up"]},{"osd":1,"uuid":"f9214f2c-ffe6-4447-9a13-9549a36e0537","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":2600417443},{"type":"v1","addr":"172.21.15.92:6817","nonce":2600417443}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6818","nonce":2600417443},{"type":"v1","addr":"172.21.15.92:6819","nonce":2600417443}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6822","nonce":2600417443},{"type":"v1","addr":"172.21.15.92:6823","nonce":2600417443}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":2600417443},{"type":"v1","addr":"172.21.15.92:6821","nonce":2600417443}]},"public_addr":"172.21.15.92:6817/2600417443","cluster_addr":"172.21.15.92:6819/2600417443","heartbeat_back_addr":"172.21.15.92:6823/2600417443","heartbeat_front_addr":"172.21.15.92:6821/2600417443","state":["exists","up"]},{"osd":2,"uuid":"b44dd849-fb85-42b1-8a1a-b6681bb1f467","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":3143892898},{"type":"v1","addr":"172.21.15.92:6809","nonce":3143892898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":3143892898},{"type":"v1","addr":"172.21.15.92:6811","nonce":3143892898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":3143892898},{"type":"v1","addr":"172.21.15.92:6815","nonce":3143892898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":3143892898},{"type":"v1","addr":"172.21.15.92:6813","nonce":3143892898}]},"public_addr":"172.21.15.92:6809/3143892898","cluster_addr":"172.21.15.92:6811/3143892898","heartbeat_back_addr":"172.21.15.92:6815/3143892898","heartbeat_front_addr":"172.21.15.92:6813/3143892898","state":["exists","up"]},{"osd":3,"uuid":"05a49d87-23b9-48dd-962c-d5c2686e7a32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":3913961488},{"type":"v1","addr":"172.21.15.92:6825","nonce":3913961488}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6826","nonce":3913961488},{"type":"v1","addr":"172.21.15.92:6827","nonce":3913961488}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":3913961488},{"type":"v1","addr":"172.21.15.92:6831","nonce":3913961488}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":3913961488},{"type":"v1","addr":"172.21.15.92:6829","nonce":3913961488}]},"public_addr":"172.21.15.92:6825/3913961488","cluster_addr":"172.21.15.92:6827/3913961488","heartbeat_back_addr":"172.21.15.92:6831/3913961488","heartbeat_front_addr":"172.21.15.92:6829/3913961488","state":["exists","up"]},{"osd":4,"uuid":"cf52b087-afe0-4f43-a4e7-db2ebc158815","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6826","nonce":2206798907},{"type":"v1","addr":"172.21.15.145:6827","nonce":2206798907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6828","nonce":2206798907},{"type":"v1","addr":"172.21.15.145:6829","nonce":2206798907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6832","nonce":2206798907},{"type":"v1","addr":"172.21.15.145:6833","nonce":2206798907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6830","nonce":2206798907},{"type":"v1","addr":"172.21.15.145:6831","nonce":2206798907}]},"public_addr":"172.21.15.145:6827/2206798907","cluster_addr":"172.21.15.145:6829/2206798907","heartbeat_back_addr":"172.21.15.145:6833/2206798907","heartbeat_front_addr":"172.21.15.145:6831/2206798907","state":["exists","up"]},{"osd":5,"uuid":"0e54adcd-2d1d-49fb-bf97-3dd7e9addd30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6810","nonce":2599548493},{"type":"v1","addr":"172.21.15.145:6811","nonce":2599548493}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6812","nonce":2599548493},{"type":"v1","addr":"172.21.15.145:6813","nonce":2599548493}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6816","nonce":2599548493},{"type":"v1","addr":"172.21.15.145:6817","nonce":2599548493}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6814","nonce":2599548493},{"type":"v1","addr":"172.21.15.145:6815","nonce":2599548493}]},"public_addr":"172.21.15.145:6811/2599548493","cluster_addr":"172.21.15.145:6813/2599548493","heartbeat_back_addr":"172.21.15.145:6817/2599548493","heartbeat_front_addr":"172.21.15.145:6815/2599548493","state":["exists","up"]},{"osd":6,"uuid":"4d5ae7a8-b3df-4c7a-9124-290f239f5b57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6802","nonce":4192380792},{"type":"v1","addr":"172.21.15.145:6803","nonce":4192380792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6804","nonce":4192380792},{"type":"v1","addr":"172.21.15.145:6805","nonce":4192380792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6808","nonce":4192380792},{"type":"v1","addr":"172.21.15.145:6809","nonce":4192380792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6806","nonce":4192380792},{"type":"v1","addr":"172.21.15.145:6807","nonce":4192380792}]},"public_addr":"172.21.15.145:6803/4192380792","cluster_addr":"172.21.15.145:6805/4192380792","heartbeat_back_addr":"172.21.15.145:6809/4192380792","heartbeat_front_addr":"172.21.15.145:6807/4192380792","state":["exists","up"]},{"osd":7,"uuid":"d7e36444-6e3f-4372-81d3-88e7b4e993f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6818","nonce":3010598400},{"type":"v1","addr":"172.21.15.145:6819","nonce":3010598400}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6820","nonce":3010598400},{"type":"v1","addr":"172.21.15.145:6821","nonce":3010598400}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6824","nonce":3010598400},{"type":"v1","addr":"172.21.15.145:6825","nonce":3010598400}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6822","nonce":3010598400},{"type":"v1","addr":"172.21.15.145:6823","nonce":3010598400}]},"public_addr":"172.21.15.145:6819/3010598400","cluster_addr":"172.21.15.145:6821/3010598400","heartbeat_back_addr":"172.21.15.145:6825/3010598400","heartbeat_front_addr":"172.21.15.145:6823/3010598400","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:14:03.281892+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:14:04.039021+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:14:03.045775+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:14:03.708856+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:14:04.425520+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:14:03.839369+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:14:03.029834+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:14:03.707529+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T00:14:25.239 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.237+0000 7f417ebc6640 1 -- 172.21.15.92:0/3364795843 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f4158077f70 msgr2=0x7f415807a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:25.239 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.237+0000 7f417ebc6640 1 --2- 172.21.15.92:0/3364795843 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f4158077f70 0x7f415807a430 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f417814ad10 tx=0x7f4160005c70 comp rx=0 tx=0).stop 2024-09-11T00:14:25.239 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.237+0000 7f417ebc6640 1 -- 172.21.15.92:0/3364795843 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f417806e2e0 msgr2=0x7f41781f52e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:25.240 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.237+0000 7f417ebc6640 1 --2- 172.21.15.92:0/3364795843 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f417806e2e0 0x7f41781f52e0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f4168009cd0 tx=0x7f4168003a10 comp rx=0 tx=0).stop 2024-09-11T00:14:25.240 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.237+0000 7f417ebc6640 1 -- 172.21.15.92:0/3364795843 shutdown_connections 2024-09-11T00:14:25.240 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.237+0000 7f417ebc6640 1 --2- 172.21.15.92:0/3364795843 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f4158077f70 0x7f415807a430 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:25.240 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.237+0000 7f417ebc6640 1 --2- 172.21.15.92:0/3364795843 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f417815e150 0x7f417814ad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:25.240 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.237+0000 7f417ebc6640 1 --2- 172.21.15.92:0/3364795843 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f41780725d0 0x7f4178159520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:25.240 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.237+0000 7f417ebc6640 1 --2- 172.21.15.92:0/3364795843 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f417806e2e0 0x7f41781f52e0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:25.240 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.237+0000 7f417ebc6640 1 -- 172.21.15.92:0/3364795843 >> 172.21.15.92:0/3364795843 conn(0x7f41780b1760 msgr2=0x7f41780ce600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:14:25.240 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.238+0000 7f417ebc6640 1 -- 172.21.15.92:0/3364795843 shutdown_connections 2024-09-11T00:14:25.240 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.238+0000 7f417ebc6640 1 -- 172.21.15.92:0/3364795843 wait complete. 2024-09-11T00:14:25.652 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 6, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-11T00:14:17.969166+0000', 'modified': '2024-09-11T00:14:23.001417+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4374}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4374': {'gid': 4374, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.145:6837/3236563974', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.145:6836', 'nonce': 3236563974}, {'type': 'v1', 'addr': '172.21.15.145:6837', 'nonce': 3236563974}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1, 'qdb_leader': 4374, 'qdb_cluster': [4374]} 2024-09-11T00:14:25.653 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-11T00:14:25.653 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-09-11T00:14:25.755 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.754+0000 7f62515da640 1 -- 172.21.15.92:0/3685726852 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f624c15e060 msgr2=0x7f624c0b6dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:25.756 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.754+0000 7f62515da640 1 --2- 172.21.15.92:0/3685726852 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f624c15e060 0x7f624c0b6dc0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f624c0d15e0 tx=0x7f623c02aa30 comp rx=0 tx=0).stop 2024-09-11T00:14:25.756 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.754+0000 7f62515da640 1 -- 172.21.15.92:0/3685726852 shutdown_connections 2024-09-11T00:14:25.756 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.754+0000 7f62515da640 1 --2- 172.21.15.92:0/3685726852 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f624c0d4af0 0x7f624c0d2a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:25.756 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.754+0000 7f62515da640 1 --2- 172.21.15.92:0/3685726852 >> v2:172.21.15.145:3300/0 conn(0x7f624c0b7300 0x7f624c0d24e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:25.756 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.754+0000 7f62515da640 1 --2- 172.21.15.92:0/3685726852 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f624c15e060 0x7f624c0b6dc0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:25.756 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.754+0000 7f62515da640 1 -- 172.21.15.92:0/3685726852 >> 172.21.15.92:0/3685726852 conn(0x7f624c0d3f70 msgr2=0x7f624c0d4350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:14:25.756 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.754+0000 7f62515da640 1 -- 172.21.15.92:0/3685726852 shutdown_connections 2024-09-11T00:14:25.756 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.754+0000 7f62515da640 1 -- 172.21.15.92:0/3685726852 wait complete. 2024-09-11T00:14:25.757 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.755+0000 7f62515da640 1 Processor -- start 2024-09-11T00:14:25.757 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.755+0000 7f62515da640 1 -- start start 2024-09-11T00:14:25.759 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.756+0000 7f62515da640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f624c0d4af0 0x7f624c1f1e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:25.759 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.756+0000 7f62515da640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f624c15e060 0x7f624c1544e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:25.759 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.756+0000 7f62515da640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f624c0c8380 0x7f624c154a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:25.759 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.756+0000 7f62515da640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f624c161e60 con 0x7f624c15e060 2024-09-11T00:14:25.759 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.756+0000 7f62515da640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f624c161ce0 con 0x7f624c0c8380 2024-09-11T00:14:25.759 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.756+0000 7f62515da640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f624c161fe0 con 0x7f624c0d4af0 2024-09-11T00:14:25.759 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.756+0000 7f624a7fc640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f624c15e060 0x7f624c1544e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:25.759 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.756+0000 7f624a7fc640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f624c15e060 0x7f624c1544e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:41566/0 (socket says 172.21.15.92:41566) 2024-09-11T00:14:25.759 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.756+0000 7f624a7fc640 1 -- 172.21.15.92:0/2136131228 learned_addr learned my addr 172.21.15.92:0/2136131228 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-11T00:14:25.759 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.756+0000 7f624affd640 1 --2- 172.21.15.92:0/2136131228 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f624c0d4af0 0x7f624c1f1e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:25.759 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.756+0000 7f624b7fe640 1 --2- 172.21.15.92:0/2136131228 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f624c0c8380 0x7f624c154a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:25.759 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.756+0000 7f624a7fc640 1 -- 172.21.15.92:0/2136131228 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f624c0d4af0 msgr2=0x7f624c1f1e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:25.760 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.756+0000 7f624a7fc640 1 --2- 172.21.15.92:0/2136131228 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f624c0d4af0 0x7f624c1f1e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:25.760 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.756+0000 7f624a7fc640 1 -- 172.21.15.92:0/2136131228 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f624c0c8380 msgr2=0x7f624c154a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:25.760 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.756+0000 7f624a7fc640 1 --2- 172.21.15.92:0/2136131228 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f624c0c8380 0x7f624c154a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:25.760 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.756+0000 7f624a7fc640 1 -- 172.21.15.92:0/2136131228 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f624c1f5600 con 0x7f624c15e060 2024-09-11T00:14:25.760 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.756+0000 7f624a7fc640 1 --2- 172.21.15.92:0/2136131228 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f624c15e060 0x7f624c1544e0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f624000c920 tx=0x7f624000cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:14:25.760 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.756+0000 7f62337fe640 1 -- 172.21.15.92:0/2136131228 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6240007c70 con 0x7f624c15e060 2024-09-11T00:14:25.760 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.756+0000 7f62337fe640 1 -- 172.21.15.92:0/2136131228 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f624000f450 con 0x7f624c15e060 2024-09-11T00:14:25.760 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.757+0000 7f62515da640 1 -- 172.21.15.92:0/2136131228 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f624c15f6c0 con 0x7f624c15e060 2024-09-11T00:14:25.760 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.757+0000 7f62337fe640 1 -- 172.21.15.92:0/2136131228 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f624000f8a0 con 0x7f624c15e060 2024-09-11T00:14:25.760 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.757+0000 7f62515da640 1 -- 172.21.15.92:0/2136131228 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f624c15fc80 con 0x7f624c15e060 2024-09-11T00:14:25.761 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.758+0000 7f62337fe640 1 -- 172.21.15.92:0/2136131228 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f6240020030 con 0x7f624c15e060 2024-09-11T00:14:25.761 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.759+0000 7f62337fe640 1 --2- 172.21.15.92:0/2136131228 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f6238077f70 0x7f623807a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:25.761 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.759+0000 7f62337fe640 1 -- 172.21.15.92:0/2136131228 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f624009a4a0 con 0x7f624c15e060 2024-09-11T00:14:25.761 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.759+0000 7f624affd640 1 --2- 172.21.15.92:0/2136131228 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f6238077f70 0x7f623807a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:25.762 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.759+0000 7f6254487740 1 Processor -- start 2024-09-11T00:14:25.762 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.759+0000 7f624affd640 1 --2- 172.21.15.92:0/2136131228 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f6238077f70 0x7f623807a430 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f623c035000 tx=0x7f623c03b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:14:25.762 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.760+0000 7f6254487740 1 -- start start 2024-09-11T00:14:25.764 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.760+0000 7f6254487740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56391eda21b0 0x56391ed79b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:25.764 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.760+0000 7f6254487740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56391edc1df0 0x56391edc21f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:25.764 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.760+0000 7f6254487740 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x56391ed775f0 0x56391ed77a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:25.764 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.760+0000 7f6254487740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x56391ecee820 con 0x56391eda21b0 2024-09-11T00:14:25.764 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.760+0000 7f6254487740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x56391ecddc50 con 0x56391edc1df0 2024-09-11T00:14:25.765 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.760+0000 7f6254487740 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x56391ece1a60 con 0x56391ed775f0 2024-09-11T00:14:25.765 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.760+0000 7f624affd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56391eda21b0 0x56391ed79b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:25.765 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.760+0000 7f624affd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56391eda21b0 0x56391ed79b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:41570/0 (socket says 172.21.15.92:41570) 2024-09-11T00:14:25.765 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.760+0000 7f624affd640 1 -- 172.21.15.92:0/2236600417 learned_addr learned my addr 172.21.15.92:0/2236600417 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-11T00:14:25.765 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.760+0000 7f624a7fc640 1 --2- 172.21.15.92:0/2236600417 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56391edc1df0 0x56391edc21f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:25.765 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.760+0000 7f624b7fe640 1 --2- 172.21.15.92:0/2236600417 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x56391ed775f0 0x56391ed77a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:25.765 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.761+0000 7f624affd640 1 -- 172.21.15.92:0/2236600417 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x56391ed775f0 msgr2=0x56391ed77a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:14:25.765 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.761+0000 7f624affd640 1 --2- 172.21.15.92:0/2236600417 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x56391ed775f0 0x56391ed77a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:25.765 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.761+0000 7f624affd640 1 -- 172.21.15.92:0/2236600417 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56391edc1df0 msgr2=0x56391edc21f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:14:25.765 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.761+0000 7f624affd640 1 --2- 172.21.15.92:0/2236600417 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56391edc1df0 0x56391edc21f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:25.765 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.761+0000 7f624affd640 1 -- 172.21.15.92:0/2236600417 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56391ea3f850 con 0x56391eda21b0 2024-09-11T00:14:25.765 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.761+0000 7f624b7fe640 1 --2- 172.21.15.92:0/2236600417 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x56391ed775f0 0x56391ed77a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:14:25.765 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.761+0000 7f624affd640 1 --2- 172.21.15.92:0/2236600417 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56391eda21b0 0x56391ed79b20 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f623c02b020 tx=0x7f623c02aa30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e38835c278fb57c server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:14:25.766 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.761+0000 7f6230ff9640 1 -- 172.21.15.92:0/2236600417 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f623c033050 con 0x56391eda21b0 2024-09-11T00:14:25.766 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.761+0000 7f6230ff9640 1 -- 172.21.15.92:0/2236600417 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f623c02fa10 con 0x56391eda21b0 2024-09-11T00:14:25.766 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.761+0000 7f6230ff9640 1 -- 172.21.15.92:0/2236600417 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f623c02fdc0 con 0x56391eda21b0 2024-09-11T00:14:25.766 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.762+0000 7f6254487740 1 -- 172.21.15.92:0/2236600417 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56391eda21b0 msgr2=0x56391ed79b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:25.766 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.762+0000 7f6254487740 1 --2- 172.21.15.92:0/2236600417 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56391eda21b0 0x56391ed79b20 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f623c02b020 tx=0x7f623c02aa30 comp rx=0 tx=0).stop 2024-09-11T00:14:25.766 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.762+0000 7f6254487740 1 -- 172.21.15.92:0/2236600417 shutdown_connections 2024-09-11T00:14:25.766 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.762+0000 7f6254487740 1 --2- 172.21.15.92:0/2236600417 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x56391ed775f0 0x56391ed77a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:25.766 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.762+0000 7f6254487740 1 --2- 172.21.15.92:0/2236600417 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56391edc1df0 0x56391edc21f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:25.766 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.762+0000 7f6254487740 1 --2- 172.21.15.92:0/2236600417 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56391eda21b0 0x56391ed79b20 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:25.766 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.762+0000 7f6254487740 1 -- 172.21.15.92:0/2236600417 >> 172.21.15.92:0/2236600417 conn(0x56391ed786a0 msgr2=0x56391ed7c0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:14:25.766 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.762+0000 7f6254487740 1 -- 172.21.15.92:0/2236600417 shutdown_connections 2024-09-11T00:14:25.766 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.762+0000 7f6254487740 1 -- 172.21.15.92:0/2236600417 wait complete. 2024-09-11T00:14:25.766 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.762+0000 7f6254487740 1 -- start start 2024-09-11T00:14:25.766 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.762+0000 7f6254487740 1 Processor -- start 2024-09-11T00:14:25.770 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.763+0000 7f6254487740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56391eda21b0 0x56391edbc930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:25.770 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.763+0000 7f6254487740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56391edc1df0 0x56391edbdd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:25.770 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.763+0000 7f6254487740 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x56391edb9fc0 0x56391ed8ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:25.770 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.763+0000 7f6254487740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x56391ea4e620 con 0x56391edc1df0 2024-09-11T00:14:25.770 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.763+0000 7f6254487740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x56391ec835f0 con 0x56391eda21b0 2024-09-11T00:14:25.770 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.763+0000 7f6254487740 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x56391ed76b30 con 0x56391edb9fc0 2024-09-11T00:14:25.770 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.763+0000 7f6254487740 10 client.0 _ll_register_callbacks cb 0x56391ec870a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:14:25.770 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.763+0000 7f624a7fc640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56391edc1df0 0x56391edbdd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:25.771 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.763+0000 7f624a7fc640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56391edc1df0 0x56391edbdd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:41574/0 (socket says 172.21.15.92:41574) 2024-09-11T00:14:25.771 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.763+0000 7f624a7fc640 1 -- 172.21.15.92:0/2523720087 learned_addr learned my addr 172.21.15.92:0/2523720087 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-11T00:14:25.771 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.763+0000 7f624affd640 1 --2- 172.21.15.92:0/2523720087 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56391eda21b0 0x56391edbc930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:25.771 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.763+0000 7f624b7fe640 1 --2- 172.21.15.92:0/2523720087 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x56391edb9fc0 0x56391ed8ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:25.771 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.763+0000 7f624a7fc640 1 -- 172.21.15.92:0/2523720087 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x56391edb9fc0 msgr2=0x56391ed8ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:14:25.771 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.763+0000 7f624a7fc640 1 --2- 172.21.15.92:0/2523720087 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x56391edb9fc0 0x56391ed8ccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:25.771 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.763+0000 7f624a7fc640 1 -- 172.21.15.92:0/2523720087 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56391eda21b0 msgr2=0x56391edbc930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:14:25.771 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.763+0000 7f624a7fc640 1 --2- 172.21.15.92:0/2523720087 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56391eda21b0 0x56391edbc930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:25.771 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.763+0000 7f624a7fc640 1 -- 172.21.15.92:0/2523720087 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56391eab66b0 con 0x56391edc1df0 2024-09-11T00:14:25.771 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.764+0000 7f624a7fc640 1 --2- 172.21.15.92:0/2523720087 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56391edc1df0 0x56391edbdd40 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f6240062310 tx=0x7f6240062bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9cf961ca7d235098 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:14:25.771 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.764+0000 7f6229ffb640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-11T00:14:25.771 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.764+0000 7f6229ffb640 1 -- 172.21.15.92:0/2523720087 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6240062120 con 0x56391edc1df0 2024-09-11T00:14:25.771 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.764+0000 7f6229ffb640 1 -- 172.21.15.92:0/2523720087 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f6240061870 con 0x56391edc1df0 2024-09-11T00:14:25.772 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.764+0000 7f6254487740 1 -- 172.21.15.92:0/2523720087 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f623c02fa10 con 0x56391edc1df0 2024-09-11T00:14:25.772 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.764+0000 7f6229ffb640 1 -- 172.21.15.92:0/2523720087 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=6) ==== 24+0+0 (secure 0 0 0) 0x7f6240062610 con 0x56391edc1df0 2024-09-11T00:14:25.772 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.764+0000 7f6254487740 10 client.4479 fetch_fsmap learned FSMap version 6 2024-09-11T00:14:25.772 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.764+0000 7f6254487740 1 -- 172.21.15.92:0/2523720087 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=6,monmap=2+}) -- 0x56391ed8d680 con 0x56391edc1df0 2024-09-11T00:14:25.772 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.764+0000 7f6229ffb640 1 -- 172.21.15.92:0/2523720087 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f623c02fa10 con 0x56391edc1df0 2024-09-11T00:14:25.772 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.764+0000 7f6229ffb640 1 -- 172.21.15.92:0/2523720087 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 6) ==== 3510+0+0 (secure 0 0 0) 0x7f6240069250 con 0x56391edc1df0 2024-09-11T00:14:25.772 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.764+0000 7f6254487740 10 client.4479 fetch_fsmap finished waiting for FSMap version 6 2024-09-11T00:14:25.772 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.764+0000 7f6254487740 10 client.4479 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-11T00:14:25.772 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.764+0000 7f6254487740 20 client.4479 populate_metadata read hostname 'smithi092' 2024-09-11T00:14:25.772 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.764+0000 7f6254487740 1 --2- 172.21.15.92:0/2523720087 >> [v2:172.21.15.145:6836/3236563974,v1:172.21.15.145:6837/3236563974] conn(0x56391eddc3b0 0x56391edde7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:25.772 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.764+0000 7f6254487740 4 client.4479 mds_command: new command op to 4374 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T00:14:25.772 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.764+0000 7f6254487740 1 -- 172.21.15.92:0/2523720087 --> [v2:172.21.15.145:6836/3236563974,v1:172.21.15.145:6837/3236563974] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56391ecf0770 con 0x56391eddc3b0 2024-09-11T00:14:25.773 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.764+0000 7f624affd640 1 --2- 172.21.15.92:0/2523720087 >> [v2:172.21.15.145:6836/3236563974,v1:172.21.15.145:6837/3236563974] conn(0x56391eddc3b0 0x56391edde7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:25.773 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.765+0000 7f6229ffb640 10 client.4479 ms_handle_connect on v2:172.21.15.145:6836/3236563974 2024-09-11T00:14:25.773 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.765+0000 7f624affd640 1 --2- 172.21.15.92:0/2523720087 >> [v2:172.21.15.145:6836/3236563974,v1:172.21.15.145:6837/3236563974] conn(0x56391eddc3b0 0x56391edde7a0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fadd833ade32f384 server_cookie=52d08d6828a6739b in_seq=0 out_seq=0 2024-09-11T00:14:25.773 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.765+0000 7f6229ffb640 1 -- 172.21.15.92:0/2523720087 <== mds.0 v2:172.21.15.145:6836/3236563974 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56391ecf0770 con 0x56391eddc3b0 2024-09-11T00:14:25.773 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.766+0000 7f6229ffb640 10 client.4479 handle_command_reply: tid=0 2024-09-11T00:14:25.773 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.766+0000 7f6254487740 1 client.4479 shutdown 2024-09-11T00:14:25.773 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.766+0000 7f6254487740 1 -- 172.21.15.92:0/2523720087 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56391edc1df0 msgr2=0x56391edbdd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:25.773 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.766+0000 7f6254487740 1 --2- 172.21.15.92:0/2523720087 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56391edc1df0 0x56391edbdd40 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f6240062310 tx=0x7f6240062bb0 comp rx=0 tx=0).stop 2024-09-11T00:14:25.773 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.766+0000 7f6254487740 1 -- 172.21.15.92:0/2523720087 shutdown_connections 2024-09-11T00:14:25.773 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.766+0000 7f6254487740 1 --2- 172.21.15.92:0/2523720087 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x56391edb9fc0 0x56391ed8ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:25.773 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.766+0000 7f6254487740 1 --2- 172.21.15.92:0/2523720087 >> [v2:172.21.15.145:6836/3236563974,v1:172.21.15.145:6837/3236563974] conn(0x56391eddc3b0 0x56391edde7a0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:25.773 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.766+0000 7f6254487740 1 --2- 172.21.15.92:0/2523720087 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56391edc1df0 0x56391edbdd40 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:25.773 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.766+0000 7f6254487740 1 --2- 172.21.15.92:0/2523720087 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56391eda21b0 0x56391edbc930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:25.773 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.766+0000 7f6254487740 1 -- 172.21.15.92:0/2523720087 >> 172.21.15.92:0/2523720087 conn(0x56391ed775f0 msgr2=0x56391ed7bee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:14:25.774 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.766+0000 7f6229ffb640 0 client.4479 ms_handle_reset on v2:172.21.15.145:6836/3236563974 2024-09-11T00:14:25.774 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.766+0000 7f6254487740 1 -- 172.21.15.92:0/2523720087 shutdown_connections 2024-09-11T00:14:25.774 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.766+0000 7f6254487740 1 -- 172.21.15.92:0/2523720087 wait complete. 2024-09-11T00:14:25.774 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.766+0000 7f6254487740 20 client.4479 trim_cache size 0 max 16384 2024-09-11T00:14:25.785 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.784+0000 7f6254487740 1 Processor -- start 2024-09-11T00:14:25.785 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.784+0000 7f6254487740 1 -- start start 2024-09-11T00:14:25.788 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.785+0000 7f6254487740 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x56391eda21b0 0x56391edbcc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:25.788 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.785+0000 7f6254487740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56391edb9fc0 0x56391ee404d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:25.788 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.785+0000 7f6254487740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56391edc1df0 0x56391edb7900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:25.788 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.785+0000 7f6254487740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f624c201280 con 0x56391edc1df0 2024-09-11T00:14:25.788 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.785+0000 7f6254487740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f624c1f8950 con 0x56391edb9fc0 2024-09-11T00:14:25.788 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.785+0000 7f6254487740 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f624c200c60 con 0x56391eda21b0 2024-09-11T00:14:25.788 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.785+0000 7f624b7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56391edc1df0 0x56391edb7900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:25.788 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.785+0000 7f624b7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56391edc1df0 0x56391edb7900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:41590/0 (socket says 172.21.15.92:41590) 2024-09-11T00:14:25.788 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.785+0000 7f624b7fe640 1 -- 172.21.15.92:0/2434457172 learned_addr learned my addr 172.21.15.92:0/2434457172 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-11T00:14:25.788 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.785+0000 7f624a7fc640 1 --2- 172.21.15.92:0/2434457172 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56391edb9fc0 0x56391ee404d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:25.788 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.785+0000 7f624affd640 1 --2- 172.21.15.92:0/2434457172 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x56391eda21b0 0x56391edbcc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:25.789 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.785+0000 7f624b7fe640 1 -- 172.21.15.92:0/2434457172 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x56391eda21b0 msgr2=0x56391edbcc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:14:25.789 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.785+0000 7f624b7fe640 1 --2- 172.21.15.92:0/2434457172 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x56391eda21b0 0x56391edbcc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:25.789 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.785+0000 7f624b7fe640 1 -- 172.21.15.92:0/2434457172 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56391edb9fc0 msgr2=0x56391ee404d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:14:25.789 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.785+0000 7f624b7fe640 1 --2- 172.21.15.92:0/2434457172 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56391edb9fc0 0x56391ee404d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:25.789 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.785+0000 7f624b7fe640 1 -- 172.21.15.92:0/2434457172 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56391ed7d120 con 0x56391edc1df0 2024-09-11T00:14:25.789 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.785+0000 7f624affd640 1 --2- 172.21.15.92:0/2434457172 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x56391eda21b0 0x56391edbcc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:14:25.789 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.785+0000 7f624b7fe640 1 --2- 172.21.15.92:0/2434457172 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56391edc1df0 0x56391edb7900 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f624400abb0 tx=0x7f6244012820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bebe2d16740e5cd9 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:14:25.789 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.785+0000 7f622bfff640 1 -- 172.21.15.92:0/2434457172 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6244005020 con 0x56391edc1df0 2024-09-11T00:14:25.789 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.785+0000 7f622bfff640 1 -- 172.21.15.92:0/2434457172 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f62440051c0 con 0x56391edc1df0 2024-09-11T00:14:25.789 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.785+0000 7f622bfff640 1 -- 172.21.15.92:0/2434457172 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62440055f0 con 0x56391edc1df0 2024-09-11T00:14:25.789 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.786+0000 7f6254487740 1 -- 172.21.15.92:0/2434457172 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56391edc1df0 msgr2=0x56391edb7900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:25.789 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.786+0000 7f6254487740 1 --2- 172.21.15.92:0/2434457172 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56391edc1df0 0x56391edb7900 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f624400abb0 tx=0x7f6244012820 comp rx=0 tx=0).stop 2024-09-11T00:14:25.789 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.786+0000 7f6254487740 1 -- 172.21.15.92:0/2434457172 shutdown_connections 2024-09-11T00:14:25.790 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.786+0000 7f6254487740 1 --2- 172.21.15.92:0/2434457172 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56391edc1df0 0x56391edb7900 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:25.790 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.786+0000 7f6254487740 1 --2- 172.21.15.92:0/2434457172 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56391edb9fc0 0x56391ee404d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:25.790 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.786+0000 7f6254487740 1 --2- 172.21.15.92:0/2434457172 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x56391eda21b0 0x56391edbcc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:25.790 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.786+0000 7f6254487740 1 -- 172.21.15.92:0/2434457172 >> 172.21.15.92:0/2434457172 conn(0x56391ed775f0 msgr2=0x56391ed71be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:14:25.790 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.786+0000 7f6254487740 1 -- 172.21.15.92:0/2434457172 shutdown_connections 2024-09-11T00:14:25.790 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.786+0000 7f6254487740 1 -- 172.21.15.92:0/2434457172 wait complete. 2024-09-11T00:14:25.790 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.786+0000 7f6254487740 1 -- start start 2024-09-11T00:14:25.790 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.786+0000 7f6254487740 1 Processor -- start 2024-09-11T00:14:25.794 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.787+0000 7f6254487740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56391eda21b0 0x56391ee3eb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:25.794 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.787+0000 7f6254487740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56391edb9fc0 0x56391ed8b900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:25.794 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.787+0000 7f6254487740 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x56391edc1df0 0x56391ee3b040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:25.794 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.787+0000 7f6254487740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x56391edba540 con 0x56391edb9fc0 2024-09-11T00:14:25.794 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.787+0000 7f6254487740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x56391ed8d2d0 con 0x56391eda21b0 2024-09-11T00:14:25.794 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.787+0000 7f6254487740 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x56391edbb980 con 0x56391edc1df0 2024-09-11T00:14:25.794 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.787+0000 7f6254487740 10 client.0 _ll_register_callbacks cb 0x7f6240061f60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:14:25.794 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.787+0000 7f624a7fc640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56391edb9fc0 0x56391ed8b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:25.794 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.787+0000 7f624a7fc640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56391edb9fc0 0x56391ed8b900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:41600/0 (socket says 172.21.15.92:41600) 2024-09-11T00:14:25.794 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.787+0000 7f624a7fc640 1 -- 172.21.15.92:0/3188990864 learned_addr learned my addr 172.21.15.92:0/3188990864 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-11T00:14:25.794 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.787+0000 7f624affd640 1 --2- 172.21.15.92:0/3188990864 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56391eda21b0 0x56391ee3eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:25.795 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.787+0000 7f624b7fe640 1 --2- 172.21.15.92:0/3188990864 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x56391edc1df0 0x56391ee3b040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:25.795 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.787+0000 7f624a7fc640 1 -- 172.21.15.92:0/3188990864 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x56391edc1df0 msgr2=0x56391ee3b040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:14:25.795 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.787+0000 7f624a7fc640 1 --2- 172.21.15.92:0/3188990864 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x56391edc1df0 0x56391ee3b040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:25.795 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.788+0000 7f624a7fc640 1 -- 172.21.15.92:0/3188990864 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56391eda21b0 msgr2=0x56391ee3eb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:14:25.795 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.788+0000 7f624a7fc640 1 --2- 172.21.15.92:0/3188990864 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56391eda21b0 0x56391ee3eb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:25.795 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.788+0000 7f624a7fc640 1 -- 172.21.15.92:0/3188990864 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56391ee3f090 con 0x56391edb9fc0 2024-09-11T00:14:25.795 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.788+0000 7f624b7fe640 1 --2- 172.21.15.92:0/3188990864 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x56391edc1df0 0x56391ee3b040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:14:25.795 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.788+0000 7f624affd640 1 --2- 172.21.15.92:0/3188990864 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56391eda21b0 0x56391ee3eb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:14:25.795 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.788+0000 7f624a7fc640 1 --2- 172.21.15.92:0/3188990864 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56391edb9fc0 0x56391ed8b900 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f624009a7c0 tx=0x7f6240061aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1fb5b88427f385fb server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:14:25.795 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.788+0000 7f6229ffb640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-11T00:14:25.795 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.788+0000 7f6229ffb640 1 -- 172.21.15.92:0/3188990864 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6240067090 con 0x56391edb9fc0 2024-09-11T00:14:25.795 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.788+0000 7f6229ffb640 1 -- 172.21.15.92:0/3188990864 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f624007c020 con 0x56391edb9fc0 2024-09-11T00:14:25.795 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.788+0000 7f6254487740 1 -- 172.21.15.92:0/3188990864 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f62440051c0 con 0x56391edb9fc0 2024-09-11T00:14:25.795 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.788+0000 7f6229ffb640 1 -- 172.21.15.92:0/3188990864 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=6) ==== 24+0+0 (secure 0 0 0) 0x7f6240062120 con 0x56391edb9fc0 2024-09-11T00:14:25.796 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.788+0000 7f6254487740 10 client.4485 fetch_fsmap learned FSMap version 6 2024-09-11T00:14:25.796 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.788+0000 7f6254487740 1 -- 172.21.15.92:0/3188990864 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=6,monmap=2+}) -- 0x56391ee3f2a0 con 0x56391edb9fc0 2024-09-11T00:14:25.796 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.788+0000 7f6229ffb640 1 -- 172.21.15.92:0/3188990864 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f62440051c0 con 0x56391edb9fc0 2024-09-11T00:14:25.796 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.788+0000 7f6229ffb640 1 -- 172.21.15.92:0/3188990864 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 6) ==== 3510+0+0 (secure 0 0 0) 0x7f6240098020 con 0x56391edb9fc0 2024-09-11T00:14:25.796 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.788+0000 7f6254487740 10 client.4485 fetch_fsmap finished waiting for FSMap version 6 2024-09-11T00:14:25.796 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.788+0000 7f6254487740 10 client.4485 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-11T00:14:25.796 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.788+0000 7f6254487740 20 client.4485 populate_metadata read hostname 'smithi092' 2024-09-11T00:14:25.796 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.788+0000 7f6254487740 1 --2- 172.21.15.92:0/3188990864 >> [v2:172.21.15.145:6836/3236563974,v1:172.21.15.145:6837/3236563974] conn(0x56391edb7c50 0x56391edb8640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:25.796 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.788+0000 7f6254487740 4 client.4485 mds_command: new command op to 4374 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-11T00:14:25.796 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.788+0000 7f6254487740 1 -- 172.21.15.92:0/3188990864 --> [v2:172.21.15.145:6836/3236563974,v1:172.21.15.145:6837/3236563974] -- command(tid 0: {"prefix": "status"}) -- 0x56391ecec220 con 0x56391edb7c50 2024-09-11T00:14:25.796 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.788+0000 7f624affd640 1 --2- 172.21.15.92:0/3188990864 >> [v2:172.21.15.145:6836/3236563974,v1:172.21.15.145:6837/3236563974] conn(0x56391edb7c50 0x56391edb8640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:25.796 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.789+0000 7f6229ffb640 10 client.4485 ms_handle_connect on v2:172.21.15.145:6836/3236563974 2024-09-11T00:14:25.796 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.789+0000 7f624affd640 1 --2- 172.21.15.92:0/3188990864 >> [v2:172.21.15.145:6836/3236563974,v1:172.21.15.145:6837/3236563974] conn(0x56391edb7c50 0x56391edb8640 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c44f6069dd4b34d9 server_cookie=672456e568fa40e2 in_seq=0 out_seq=0 2024-09-11T00:14:25.796 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.789+0000 7f6229ffb640 1 -- 172.21.15.92:0/3188990864 <== mds.0 v2:172.21.15.145:6836/3236563974 1 ==== command_reply(tid 0: 0 ) ==== 8+0+330 (crc 0 0 0) 0x56391ecec220 con 0x56391edb7c50 2024-09-11T00:14:25.797 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.789+0000 7f6229ffb640 10 client.4485 handle_command_reply: tid=0 2024-09-11T00:14:25.797 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.789+0000 7f6254487740 1 client.4485 shutdown 2024-09-11T00:14:25.797 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.789+0000 7f6254487740 1 -- 172.21.15.92:0/3188990864 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56391edb9fc0 msgr2=0x56391ed8b900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:25.797 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.789+0000 7f6254487740 1 --2- 172.21.15.92:0/3188990864 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56391edb9fc0 0x56391ed8b900 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f624009a7c0 tx=0x7f6240061aa0 comp rx=0 tx=0).stop 2024-09-11T00:14:25.797 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.789+0000 7f6254487740 1 -- 172.21.15.92:0/3188990864 shutdown_connections 2024-09-11T00:14:25.797 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.789+0000 7f6254487740 1 --2- 172.21.15.92:0/3188990864 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x56391edc1df0 0x56391ee3b040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:25.797 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.789+0000 7f6254487740 1 --2- 172.21.15.92:0/3188990864 >> [v2:172.21.15.145:6836/3236563974,v1:172.21.15.145:6837/3236563974] conn(0x56391edb7c50 0x56391edb8640 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:25.797 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.789+0000 7f6254487740 1 --2- 172.21.15.92:0/3188990864 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56391edb9fc0 0x56391ed8b900 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:25.797 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.789+0000 7f6254487740 1 --2- 172.21.15.92:0/3188990864 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56391eda21b0 0x56391ee3eb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:25.797 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.789+0000 7f6229ffb640 0 client.4485 ms_handle_reset on v2:172.21.15.145:6836/3236563974 2024-09-11T00:14:25.797 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.789+0000 7f6254487740 1 -- 172.21.15.92:0/3188990864 >> 172.21.15.92:0/3188990864 conn(0x56391ed775f0 msgr2=0x56391ed71e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:14:25.797 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.789+0000 7f6254487740 1 -- 172.21.15.92:0/3188990864 shutdown_connections 2024-09-11T00:14:25.797 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.789+0000 7f6254487740 1 -- 172.21.15.92:0/3188990864 wait complete. 2024-09-11T00:14:25.797 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.789+0000 7f6254487740 20 client.4485 trim_cache size 0 max 16384 2024-09-11T00:14:25.798 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2024-09-11T00:14:25.798 INFO:teuthology.orchestra.run.smithi092.stdout: "cluster_fsid": "47039cb3-5d2a-46bf-9066-8055b5dfc583", 2024-09-11T00:14:25.798 INFO:teuthology.orchestra.run.smithi092.stdout: "whoami": 0, 2024-09-11T00:14:25.798 INFO:teuthology.orchestra.run.smithi092.stdout: "id": 4374, 2024-09-11T00:14:25.798 INFO:teuthology.orchestra.run.smithi092.stdout: "want_state": "up:active", 2024-09-11T00:14:25.798 INFO:teuthology.orchestra.run.smithi092.stdout: "state": "up:active", 2024-09-11T00:14:25.798 INFO:teuthology.orchestra.run.smithi092.stdout: "fs_name": "cephfs", 2024-09-11T00:14:25.798 INFO:teuthology.orchestra.run.smithi092.stdout: "rank_uptime": 7.1689461110000003, 2024-09-11T00:14:25.798 INFO:teuthology.orchestra.run.smithi092.stdout: "mdsmap_epoch": 6, 2024-09-11T00:14:25.798 INFO:teuthology.orchestra.run.smithi092.stdout: "osdmap_epoch": 25, 2024-09-11T00:14:25.799 INFO:teuthology.orchestra.run.smithi092.stdout: "osdmap_epoch_barrier": 25, 2024-09-11T00:14:25.799 INFO:teuthology.orchestra.run.smithi092.stdout: "uptime": 13.246528141000001 2024-09-11T00:14:25.799 INFO:teuthology.orchestra.run.smithi092.stdout:} 2024-09-11T00:14:25.799 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.790+0000 7f62515da640 1 -- 172.21.15.92:0/2136131228 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f6238077f70 msgr2=0x7f623807a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:25.799 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.790+0000 7f62515da640 1 --2- 172.21.15.92:0/2136131228 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f6238077f70 0x7f623807a430 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f623c035000 tx=0x7f623c03b040 comp rx=0 tx=0).stop 2024-09-11T00:14:25.800 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.790+0000 7f62515da640 1 -- 172.21.15.92:0/2136131228 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f624c15e060 msgr2=0x7f624c1544e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:25.800 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.790+0000 7f62515da640 1 --2- 172.21.15.92:0/2136131228 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f624c15e060 0x7f624c1544e0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f624000c920 tx=0x7f624000cde0 comp rx=0 tx=0).stop 2024-09-11T00:14:25.800 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.790+0000 7f62515da640 1 -- 172.21.15.92:0/2136131228 shutdown_connections 2024-09-11T00:14:25.800 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.790+0000 7f62515da640 1 --2- 172.21.15.92:0/2136131228 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f6238077f70 0x7f623807a430 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:25.800 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.790+0000 7f62515da640 1 --2- 172.21.15.92:0/2136131228 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f624c0c8380 0x7f624c154a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:25.800 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.790+0000 7f62515da640 1 --2- 172.21.15.92:0/2136131228 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f624c15e060 0x7f624c1544e0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:25.800 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.790+0000 7f62515da640 1 --2- 172.21.15.92:0/2136131228 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f624c0d4af0 0x7f624c1f1e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:25.800 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.790+0000 7f62515da640 1 -- 172.21.15.92:0/2136131228 >> 172.21.15.92:0/2136131228 conn(0x7f624c0d3f70 msgr2=0x7f624c0b7be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:14:25.800 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.790+0000 7f62515da640 1 -- 172.21.15.92:0/2136131228 shutdown_connections 2024-09-11T00:14:25.800 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.790+0000 7f62515da640 1 -- 172.21.15.92:0/2136131228 wait complete. 2024-09-11T00:14:25.802 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-11T00:14:25.802 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-09-11T00:14:25.802 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-11T00:14:25.904 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.902+0000 7f5e7854b640 1 -- 172.21.15.92:0/2844708451 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5e58004d40 msgr2=0x7f5e580051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:25.905 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.902+0000 7f5e7854b640 1 --2- 172.21.15.92:0/2844708451 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5e58004d40 0x7f5e580051c0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f5e700cffa0 tx=0x7f5e58005830 comp rx=0 tx=0).stop 2024-09-11T00:14:25.905 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.902+0000 7f5e76ae8640 1 -- 172.21.15.92:0/2844708451 reap_dead start 2024-09-11T00:14:25.905 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.902+0000 7f5e7854b640 1 -- 172.21.15.92:0/2844708451 shutdown_connections 2024-09-11T00:14:25.905 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.902+0000 7f5e7854b640 1 -- 172.21.15.92:0/2844708451 >> 172.21.15.92:0/2844708451 conn(0x7f5e700d0c00 msgr2=0x7f5e700d0fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:14:25.905 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.902+0000 7f5e7854b640 1 -- 172.21.15.92:0/2844708451 shutdown_connections 2024-09-11T00:14:25.905 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.902+0000 7f5e7854b640 1 -- 172.21.15.92:0/2844708451 wait complete. 2024-09-11T00:14:25.905 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.904+0000 7f5e7854b640 1 Processor -- start 2024-09-11T00:14:25.905 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.904+0000 7f5e7854b640 1 -- start start 2024-09-11T00:14:25.907 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.904+0000 7f5e7854b640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f5e58004d40 0x7f5e7013e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:25.907 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.904+0000 7f5e7854b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5e7013e9a0 0x7f5e7014e630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:25.908 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.904+0000 7f5e7854b640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5e70149120 0x7f5e7014bb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:25.908 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.904+0000 7f5e7854b640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f5e700b3fd0 con 0x7f5e7013e9a0 2024-09-11T00:14:25.908 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.904+0000 7f5e7854b640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f5e700d0960 con 0x7f5e70149120 2024-09-11T00:14:25.908 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.904+0000 7f5e7854b640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f5e700b4150 con 0x7f5e58004d40 2024-09-11T00:14:25.908 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.904+0000 7f5e75ae6640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5e7013e9a0 0x7f5e7014e630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:25.908 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.904+0000 7f5e75ae6640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5e7013e9a0 0x7f5e7014e630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:41618/0 (socket says 172.21.15.92:41618) 2024-09-11T00:14:25.908 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.904+0000 7f5e75ae6640 1 -- 172.21.15.92:0/2866265883 learned_addr learned my addr 172.21.15.92:0/2866265883 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-11T00:14:25.908 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.905+0000 7f5e762e7640 1 --2- 172.21.15.92:0/2866265883 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f5e58004d40 0x7f5e7013e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:25.908 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.905+0000 7f5e76ae8640 1 --2- 172.21.15.92:0/2866265883 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5e70149120 0x7f5e7014bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:25.908 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.905+0000 7f5e75ae6640 1 -- 172.21.15.92:0/2866265883 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f5e58004d40 msgr2=0x7f5e7013e2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:25.908 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.905+0000 7f5e75ae6640 1 --2- 172.21.15.92:0/2866265883 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f5e58004d40 0x7f5e7013e2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:25.908 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.905+0000 7f5e75ae6640 1 -- 172.21.15.92:0/2866265883 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5e70149120 msgr2=0x7f5e7014bb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:25.908 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.905+0000 7f5e75ae6640 1 --2- 172.21.15.92:0/2866265883 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5e70149120 0x7f5e7014bb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:25.909 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.905+0000 7f5e75ae6640 1 -- 172.21.15.92:0/2866265883 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e7014eef0 con 0x7f5e7013e9a0 2024-09-11T00:14:25.909 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.905+0000 7f5e762e7640 1 --2- 172.21.15.92:0/2866265883 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f5e58004d40 0x7f5e7013e2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:14:25.909 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.905+0000 7f5e75ae6640 1 --2- 172.21.15.92:0/2866265883 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5e7013e9a0 0x7f5e7014e630 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f5e64003f90 tx=0x7f5e640016f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:14:25.909 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.905+0000 7f5e6effd640 1 -- 172.21.15.92:0/2866265883 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e64016030 con 0x7f5e7013e9a0 2024-09-11T00:14:25.909 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.905+0000 7f5e6effd640 1 -- 172.21.15.92:0/2866265883 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5e64011700 con 0x7f5e7013e9a0 2024-09-11T00:14:25.909 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.905+0000 7f5e7854b640 1 -- 172.21.15.92:0/2866265883 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e70153920 con 0x7f5e7013e9a0 2024-09-11T00:14:25.909 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.905+0000 7f5e6effd640 1 -- 172.21.15.92:0/2866265883 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e64011b30 con 0x7f5e7013e9a0 2024-09-11T00:14:25.909 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.905+0000 7f5e7854b640 1 -- 172.21.15.92:0/2866265883 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e70153ee0 con 0x7f5e7013e9a0 2024-09-11T00:14:25.909 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.906+0000 7f5e7854b640 1 -- 172.21.15.92:0/2866265883 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5e7015eb40 con 0x7f5e7013e9a0 2024-09-11T00:14:25.910 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.907+0000 7f5e6effd640 1 -- 172.21.15.92:0/2866265883 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f5e64023060 con 0x7f5e7013e9a0 2024-09-11T00:14:25.910 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.907+0000 7f5e6effd640 1 --2- 172.21.15.92:0/2866265883 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f5e5c077f70 0x7f5e5c07a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:25.910 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.907+0000 7f5e6effd640 1 -- 172.21.15.92:0/2866265883 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f5e6409a6c0 con 0x7f5e7013e9a0 2024-09-11T00:14:25.910 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.907+0000 7f5e762e7640 1 --2- 172.21.15.92:0/2866265883 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f5e5c077f70 0x7f5e5c07a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:25.910 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.908+0000 7f5e762e7640 1 --2- 172.21.15.92:0/2866265883 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f5e5c077f70 0x7f5e5c07a430 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f5e60005fd0 tx=0x7f5e60009500 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:14:25.913 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:25.911+0000 7f5e6effd640 1 -- 172.21.15.92:0/2866265883 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f5e64062f10 con 0x7f5e7013e9a0 2024-09-11T00:14:26.125 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:26.123+0000 7f5e7854b640 1 -- 172.21.15.92:0/2866265883 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f5e70151fe0 con 0x7f5e7013e9a0 2024-09-11T00:14:26.125 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:26.123+0000 7f5e6effd640 1 -- 172.21.15.92:0/2866265883 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v6) ==== 53+0+88 (secure 0 0 0) 0x7f5e64062810 con 0x7f5e7013e9a0 2024-09-11T00:14:26.125 INFO:teuthology.orchestra.run.smithi092.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-09-11T00:14:26.127 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:26.125+0000 7f5e7854b640 1 -- 172.21.15.92:0/2866265883 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f5e5c077f70 msgr2=0x7f5e5c07a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:26.127 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:26.125+0000 7f5e7854b640 1 --2- 172.21.15.92:0/2866265883 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f5e5c077f70 0x7f5e5c07a430 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f5e60005fd0 tx=0x7f5e60009500 comp rx=0 tx=0).stop 2024-09-11T00:14:26.127 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:26.125+0000 7f5e7854b640 1 -- 172.21.15.92:0/2866265883 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5e7013e9a0 msgr2=0x7f5e7014e630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:26.127 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:26.125+0000 7f5e7854b640 1 --2- 172.21.15.92:0/2866265883 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5e7013e9a0 0x7f5e7014e630 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f5e64003f90 tx=0x7f5e640016f0 comp rx=0 tx=0).stop 2024-09-11T00:14:26.127 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:26.125+0000 7f5e7854b640 1 -- 172.21.15.92:0/2866265883 shutdown_connections 2024-09-11T00:14:26.127 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:26.125+0000 7f5e7854b640 1 --2- 172.21.15.92:0/2866265883 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f5e5c077f70 0x7f5e5c07a430 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:26.127 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:26.125+0000 7f5e7854b640 1 --2- 172.21.15.92:0/2866265883 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5e70149120 0x7f5e7014bb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:26.127 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:26.125+0000 7f5e7854b640 1 --2- 172.21.15.92:0/2866265883 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5e7013e9a0 0x7f5e7014e630 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:26.127 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:26.125+0000 7f5e7854b640 1 --2- 172.21.15.92:0/2866265883 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f5e58004d40 0x7f5e7013e2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:26.128 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:26.125+0000 7f5e7854b640 1 -- 172.21.15.92:0/2866265883 >> 172.21.15.92:0/2866265883 conn(0x7f5e700d0c00 msgr2=0x7f5e700ceb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:14:26.128 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:26.125+0000 7f5e7854b640 1 -- 172.21.15.92:0/2866265883 shutdown_connections 2024-09-11T00:14:26.128 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:26.125+0000 7f5e7854b640 1 -- 172.21.15.92:0/2866265883 wait complete. 2024-09-11T00:14:26.138 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-11T00:14:26.138 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-11T00:14:26.138 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi092.front.sepia.ceph.com 2024-09-11T00:14:26.138 INFO:tasks.cephfs.mount:self.client.name = client.admin 2024-09-11T00:14:26.138 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-09-11T00:14:26.139 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-11T00:14:26.139 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-11T00:14:26.139 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-11T00:14:26.139 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2024-09-11T00:14:26.139 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T00:14:26.139 DEBUG:teuthology.orchestra.run.smithi092:> ip addr 2024-09-11T00:14:26.155 INFO:teuthology.orchestra.run.smithi092.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-11T00:14:26.155 INFO:teuthology.orchestra.run.smithi092.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-11T00:14:26.155 INFO:teuthology.orchestra.run.smithi092.stdout: inet 127.0.0.1/8 scope host lo 2024-09-11T00:14:26.155 INFO:teuthology.orchestra.run.smithi092.stdout: valid_lft forever preferred_lft forever 2024-09-11T00:14:26.155 INFO:teuthology.orchestra.run.smithi092.stdout: inet6 ::1/128 scope host 2024-09-11T00:14:26.155 INFO:teuthology.orchestra.run.smithi092.stdout: valid_lft forever preferred_lft forever 2024-09-11T00:14:26.155 INFO:teuthology.orchestra.run.smithi092.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-11T00:14:26.155 INFO:teuthology.orchestra.run.smithi092.stdout: link/ether 0c:c4:7a:d8:a1:b2 brd ff:ff:ff:ff:ff:ff 2024-09-11T00:14:26.156 INFO:teuthology.orchestra.run.smithi092.stdout: altname enp7s0f0 2024-09-11T00:14:26.156 INFO:teuthology.orchestra.run.smithi092.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-11T00:14:26.156 INFO:teuthology.orchestra.run.smithi092.stdout: link/ether 0c:c4:7a:d8:a1:b3 brd ff:ff:ff:ff:ff:ff 2024-09-11T00:14:26.156 INFO:teuthology.orchestra.run.smithi092.stdout: altname enp7s0f1 2024-09-11T00:14:26.156 INFO:teuthology.orchestra.run.smithi092.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-11T00:14:26.156 INFO:teuthology.orchestra.run.smithi092.stdout: link/ether 0c:c4:7a:8f:cd:44 brd ff:ff:ff:ff:ff:ff 2024-09-11T00:14:26.156 INFO:teuthology.orchestra.run.smithi092.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-11T00:14:26.156 INFO:teuthology.orchestra.run.smithi092.stdout: link/ether 0c:c4:7a:8f:cd:45 brd ff:ff:ff:ff:ff:ff 2024-09-11T00:14:26.156 INFO:teuthology.orchestra.run.smithi092.stdout: inet 172.21.15.92/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-11T00:14:26.156 INFO:teuthology.orchestra.run.smithi092.stdout: valid_lft 42782sec preferred_lft 42782sec 2024-09-11T00:14:26.156 INFO:teuthology.orchestra.run.smithi092.stdout: inet6 fe80::ec4:7aff:fe8f:cd45/64 scope link noprefixroute 2024-09-11T00:14:26.156 INFO:teuthology.orchestra.run.smithi092.stdout: valid_lft forever preferred_lft forever 2024-09-11T00:14:26.157 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-11T00:14:26.157 DEBUG:teuthology.orchestra.run.smithi092:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-11T00:14:26.157 DEBUG:teuthology.orchestra.run.smithi092:> set -e 2024-09-11T00:14:26.157 DEBUG:teuthology.orchestra.run.smithi092:> sudo ip link add name ceph-brx type bridge 2024-09-11T00:14:26.157 DEBUG:teuthology.orchestra.run.smithi092:> sudo ip addr flush dev ceph-brx 2024-09-11T00:14:26.157 DEBUG:teuthology.orchestra.run.smithi092:> sudo ip link set ceph-brx up 2024-09-11T00:14:26.157 DEBUG:teuthology.orchestra.run.smithi092:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-11T00:14:26.157 DEBUG:teuthology.orchestra.run.smithi092:> ') 2024-09-11T00:14:26.242 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:26 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-11T00:14:26.365 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:26 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T00:14:26.371 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T00:14:26.372 DEBUG:teuthology.orchestra.run.smithi092:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-11T00:14:26.398 INFO:teuthology.orchestra.run.smithi092.stdout:1 2024-09-11T00:14:26.400 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T00:14:26.400 DEBUG:teuthology.orchestra.run.smithi092:> route 2024-09-11T00:14:26.466 INFO:teuthology.orchestra.run.smithi092.stdout:Kernel IP routing table 2024-09-11T00:14:26.466 INFO:teuthology.orchestra.run.smithi092.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-11T00:14:26.466 INFO:teuthology.orchestra.run.smithi092.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-11T00:14:26.466 INFO:teuthology.orchestra.run.smithi092.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-11T00:14:26.466 INFO:teuthology.orchestra.run.smithi092.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-11T00:14:26.467 DEBUG:teuthology.orchestra.run.smithi092:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-11T00:14:26.467 DEBUG:teuthology.orchestra.run.smithi092:> set -e 2024-09-11T00:14:26.467 DEBUG:teuthology.orchestra.run.smithi092:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-11T00:14:26.467 DEBUG:teuthology.orchestra.run.smithi092:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-11T00:14:26.467 DEBUG:teuthology.orchestra.run.smithi092:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-11T00:14:26.467 DEBUG:teuthology.orchestra.run.smithi092:> ') 2024-09-11T00:14:26.555 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:26 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-11T00:14:26.789 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:26 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T00:14:26.795 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T00:14:26.795 DEBUG:teuthology.orchestra.run.smithi092:> ip netns list 2024-09-11T00:14:26.811 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T00:14:26.811 DEBUG:teuthology.orchestra.run.smithi092:> ip netns list-id 2024-09-11T00:14:26.868 DEBUG:teuthology.orchestra.run.smithi092:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-11T00:14:26.868 DEBUG:teuthology.orchestra.run.smithi092:> set -e 2024-09-11T00:14:26.868 DEBUG:teuthology.orchestra.run.smithi092:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-11T00:14:26.868 DEBUG:teuthology.orchestra.run.smithi092:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2024-09-11T00:14:26.868 DEBUG:teuthology.orchestra.run.smithi092:> ') 2024-09-11T00:14:26.956 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:26 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-11T00:14:26.980 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:26 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T00:14:26.989 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2024-09-11T00:14:26.989 DEBUG:teuthology.orchestra.run.smithi092:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-11T00:14:26.989 DEBUG:teuthology.orchestra.run.smithi092:> set -e 2024-09-11T00:14:26.989 DEBUG:teuthology.orchestra.run.smithi092:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2024-09-11T00:14:26.989 DEBUG:teuthology.orchestra.run.smithi092:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-11T00:14:26.989 DEBUG:teuthology.orchestra.run.smithi092:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2024-09-11T00:14:26.990 DEBUG:teuthology.orchestra.run.smithi092:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2024-09-11T00:14:26.990 DEBUG:teuthology.orchestra.run.smithi092:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2024-09-11T00:14:26.990 DEBUG:teuthology.orchestra.run.smithi092:> ') 2024-09-11T00:14:27.037 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:27 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-11T00:14:27.113 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:27 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T00:14:27.119 DEBUG:teuthology.orchestra.run.smithi092:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-11T00:14:27.119 DEBUG:teuthology.orchestra.run.smithi092:> set -e 2024-09-11T00:14:27.119 DEBUG:teuthology.orchestra.run.smithi092:> sudo ip link set brx.0 up 2024-09-11T00:14:27.119 DEBUG:teuthology.orchestra.run.smithi092:> sudo ip link set dev brx.0 master ceph-brx 2024-09-11T00:14:27.120 DEBUG:teuthology.orchestra.run.smithi092:> ') 2024-09-11T00:14:27.167 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:27 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-11T00:14:27.189 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:27 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T00:14:27.197 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2024-09-11T00:14:27.197 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-11T00:14:27.197 DEBUG:teuthology.orchestra.run.smithi092:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2024-09-11T00:14:27.212 INFO:teuthology.orchestra.run.smithi092.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2024-09-11T00:14:27.213 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-11T00:14:27.213 DEBUG:teuthology.orchestra.run.smithi092:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2024-09-11T00:14:27.267 DEBUG:teuthology.orchestra.run.smithi092:> sudo modprobe fuse 2024-09-11T00:14:27.333 DEBUG:teuthology.orchestra.run.smithi092:> cat /proc/self/mounts | awk '{print $2}' 2024-09-11T00:14:27.389 INFO:teuthology.orchestra.run.smithi092.stdout:/proc 2024-09-11T00:14:27.389 INFO:teuthology.orchestra.run.smithi092.stdout:/sys 2024-09-11T00:14:27.389 INFO:teuthology.orchestra.run.smithi092.stdout:/dev 2024-09-11T00:14:27.389 INFO:teuthology.orchestra.run.smithi092.stdout:/sys/kernel/security 2024-09-11T00:14:27.389 INFO:teuthology.orchestra.run.smithi092.stdout:/dev/shm 2024-09-11T00:14:27.389 INFO:teuthology.orchestra.run.smithi092.stdout:/dev/pts 2024-09-11T00:14:27.389 INFO:teuthology.orchestra.run.smithi092.stdout:/run 2024-09-11T00:14:27.390 INFO:teuthology.orchestra.run.smithi092.stdout:/sys/fs/cgroup 2024-09-11T00:14:27.390 INFO:teuthology.orchestra.run.smithi092.stdout:/sys/fs/pstore 2024-09-11T00:14:27.390 INFO:teuthology.orchestra.run.smithi092.stdout:/sys/fs/bpf 2024-09-11T00:14:27.390 INFO:teuthology.orchestra.run.smithi092.stdout:/ 2024-09-11T00:14:27.390 INFO:teuthology.orchestra.run.smithi092.stdout:/sys/fs/selinux 2024-09-11T00:14:27.390 INFO:teuthology.orchestra.run.smithi092.stdout:/proc/sys/fs/binfmt_misc 2024-09-11T00:14:27.390 INFO:teuthology.orchestra.run.smithi092.stdout:/dev/mqueue 2024-09-11T00:14:27.390 INFO:teuthology.orchestra.run.smithi092.stdout:/dev/hugepages 2024-09-11T00:14:27.390 INFO:teuthology.orchestra.run.smithi092.stdout:/sys/kernel/debug 2024-09-11T00:14:27.390 INFO:teuthology.orchestra.run.smithi092.stdout:/sys/kernel/tracing 2024-09-11T00:14:27.390 INFO:teuthology.orchestra.run.smithi092.stdout:/sys/fs/fuse/connections 2024-09-11T00:14:27.390 INFO:teuthology.orchestra.run.smithi092.stdout:/sys/kernel/config 2024-09-11T00:14:27.390 INFO:teuthology.orchestra.run.smithi092.stdout:/run/credentials/systemd-sysctl.service 2024-09-11T00:14:27.390 INFO:teuthology.orchestra.run.smithi092.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-11T00:14:27.391 INFO:teuthology.orchestra.run.smithi092.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-11T00:14:27.391 INFO:teuthology.orchestra.run.smithi092.stdout:/var/lib/nfs/rpc_pipefs 2024-09-11T00:14:27.391 INFO:teuthology.orchestra.run.smithi092.stdout:/run/user/1000 2024-09-11T00:14:27.391 INFO:teuthology.orchestra.run.smithi092.stdout:/var/lib/ceph 2024-09-11T00:14:27.391 INFO:teuthology.orchestra.run.smithi092.stdout:/var/lib/ceph/osd/ceph-0 2024-09-11T00:14:27.391 INFO:teuthology.orchestra.run.smithi092.stdout:/var/lib/ceph/osd/ceph-1 2024-09-11T00:14:27.391 INFO:teuthology.orchestra.run.smithi092.stdout:/var/lib/ceph/osd/ceph-2 2024-09-11T00:14:27.391 INFO:teuthology.orchestra.run.smithi092.stdout:/var/lib/ceph/osd/ceph-3 2024-09-11T00:14:27.391 INFO:teuthology.orchestra.run.smithi092.stdout:/run/netns 2024-09-11T00:14:27.391 INFO:teuthology.orchestra.run.smithi092.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-11T00:14:27.391 INFO:teuthology.orchestra.run.smithi092.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-11T00:14:27.391 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T00:14:27.392 DEBUG:teuthology.orchestra.run.smithi092:> ls /sys/fs/fuse/connections 2024-09-11T00:14:27.444 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-11T00:14:27.444 DEBUG:teuthology.orchestra.run.smithi092:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2024-09-11T00:14:27.487 DEBUG:teuthology.orchestra.run.smithi092:> sudo modprobe fuse 2024-09-11T00:14:27.511 DEBUG:teuthology.orchestra.run.smithi092:> cat /proc/self/mounts | awk '{print $2}' 2024-09-11T00:14:27.567 INFO:teuthology.orchestra.run.smithi092.stdout:/proc 2024-09-11T00:14:27.567 INFO:teuthology.orchestra.run.smithi092.stdout:/sys 2024-09-11T00:14:27.567 INFO:teuthology.orchestra.run.smithi092.stdout:/dev 2024-09-11T00:14:27.567 INFO:teuthology.orchestra.run.smithi092.stdout:/sys/kernel/security 2024-09-11T00:14:27.567 INFO:teuthology.orchestra.run.smithi092.stdout:/dev/shm 2024-09-11T00:14:27.567 INFO:teuthology.orchestra.run.smithi092.stdout:/dev/pts 2024-09-11T00:14:27.568 INFO:teuthology.orchestra.run.smithi092.stdout:/run 2024-09-11T00:14:27.568 INFO:teuthology.orchestra.run.smithi092.stdout:/sys/fs/cgroup 2024-09-11T00:14:27.568 INFO:teuthology.orchestra.run.smithi092.stdout:/sys/fs/pstore 2024-09-11T00:14:27.568 INFO:teuthology.orchestra.run.smithi092.stdout:/sys/fs/bpf 2024-09-11T00:14:27.568 INFO:teuthology.orchestra.run.smithi092.stdout:/ 2024-09-11T00:14:27.568 INFO:teuthology.orchestra.run.smithi092.stdout:/sys/fs/selinux 2024-09-11T00:14:27.568 INFO:teuthology.orchestra.run.smithi092.stdout:/proc/sys/fs/binfmt_misc 2024-09-11T00:14:27.568 INFO:teuthology.orchestra.run.smithi092.stdout:/dev/mqueue 2024-09-11T00:14:27.568 INFO:teuthology.orchestra.run.smithi092.stdout:/dev/hugepages 2024-09-11T00:14:27.568 INFO:teuthology.orchestra.run.smithi092.stdout:/sys/kernel/debug 2024-09-11T00:14:27.568 INFO:teuthology.orchestra.run.smithi092.stdout:/sys/kernel/tracing 2024-09-11T00:14:27.568 INFO:teuthology.orchestra.run.smithi092.stdout:/sys/fs/fuse/connections 2024-09-11T00:14:27.569 INFO:teuthology.orchestra.run.smithi092.stdout:/sys/kernel/config 2024-09-11T00:14:27.569 INFO:teuthology.orchestra.run.smithi092.stdout:/run/credentials/systemd-sysctl.service 2024-09-11T00:14:27.569 INFO:teuthology.orchestra.run.smithi092.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-11T00:14:27.569 INFO:teuthology.orchestra.run.smithi092.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-11T00:14:27.569 INFO:teuthology.orchestra.run.smithi092.stdout:/var/lib/nfs/rpc_pipefs 2024-09-11T00:14:27.569 INFO:teuthology.orchestra.run.smithi092.stdout:/run/user/1000 2024-09-11T00:14:27.569 INFO:teuthology.orchestra.run.smithi092.stdout:/var/lib/ceph 2024-09-11T00:14:27.569 INFO:teuthology.orchestra.run.smithi092.stdout:/var/lib/ceph/osd/ceph-0 2024-09-11T00:14:27.569 INFO:teuthology.orchestra.run.smithi092.stdout:/var/lib/ceph/osd/ceph-1 2024-09-11T00:14:27.569 INFO:teuthology.orchestra.run.smithi092.stdout:/var/lib/ceph/osd/ceph-2 2024-09-11T00:14:27.569 INFO:teuthology.orchestra.run.smithi092.stdout:/var/lib/ceph/osd/ceph-3 2024-09-11T00:14:27.569 INFO:teuthology.orchestra.run.smithi092.stdout:/run/netns 2024-09-11T00:14:27.569 INFO:teuthology.orchestra.run.smithi092.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-11T00:14:27.569 INFO:teuthology.orchestra.run.smithi092.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-11T00:14:27.570 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T00:14:27.570 DEBUG:teuthology.orchestra.run.smithi092:> ls /sys/fs/fuse/connections 2024-09-11T00:14:27.573 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi092.stderr:2024-09-11T00:14:27.571+0000 7f521687c480 -1 init, newargv = 0x564ff2ac9720 newargc=15 2024-09-11T00:14:27.573 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi092.stderr:ceph-fuse[43750]: starting ceph client 2024-09-11T00:14:27.580 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi092.stderr:ceph-fuse[43750]: starting fuse 2024-09-11T00:14:27.588 INFO:teuthology.orchestra.run.smithi092.stdout:41 2024-09-11T00:14:27.589 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [41] 2024-09-11T00:14:27.589 DEBUG:teuthology.orchestra.run.smithi092:> sudo stdin-killer -- python3 -c ' 2024-09-11T00:14:27.589 DEBUG:teuthology.orchestra.run.smithi092:> import glob 2024-09-11T00:14:27.589 DEBUG:teuthology.orchestra.run.smithi092:> import re 2024-09-11T00:14:27.589 DEBUG:teuthology.orchestra.run.smithi092:> import os 2024-09-11T00:14:27.589 DEBUG:teuthology.orchestra.run.smithi092:> import subprocess 2024-09-11T00:14:27.589 DEBUG:teuthology.orchestra.run.smithi092:> 2024-09-11T00:14:27.589 DEBUG:teuthology.orchestra.run.smithi092:> def _find_admin_socket(client_name): 2024-09-11T00:14:27.589 DEBUG:teuthology.orchestra.run.smithi092:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2024-09-11T00:14:27.589 DEBUG:teuthology.orchestra.run.smithi092:> files = glob.glob(asok_path) 2024-09-11T00:14:27.589 DEBUG:teuthology.orchestra.run.smithi092:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2024-09-11T00:14:27.589 DEBUG:teuthology.orchestra.run.smithi092:> 2024-09-11T00:14:27.589 DEBUG:teuthology.orchestra.run.smithi092:> # Given a non-glob path, it better be there 2024-09-11T00:14:27.590 DEBUG:teuthology.orchestra.run.smithi092:> if "*" not in asok_path: 2024-09-11T00:14:27.590 DEBUG:teuthology.orchestra.run.smithi092:> assert(len(files) == 1) 2024-09-11T00:14:27.590 DEBUG:teuthology.orchestra.run.smithi092:> return files[0] 2024-09-11T00:14:27.590 DEBUG:teuthology.orchestra.run.smithi092:> 2024-09-11T00:14:27.590 DEBUG:teuthology.orchestra.run.smithi092:> for f in files: 2024-09-11T00:14:27.590 DEBUG:teuthology.orchestra.run.smithi092:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-11T00:14:27.590 DEBUG:teuthology.orchestra.run.smithi092:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-11T00:14:27.590 DEBUG:teuthology.orchestra.run.smithi092:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-11T00:14:27.590 DEBUG:teuthology.orchestra.run.smithi092:> contents = proc_f.read() 2024-09-11T00:14:27.590 DEBUG:teuthology.orchestra.run.smithi092:> if mountpoint in contents: 2024-09-11T00:14:27.590 DEBUG:teuthology.orchestra.run.smithi092:> return f 2024-09-11T00:14:27.590 DEBUG:teuthology.orchestra.run.smithi092:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-11T00:14:27.590 DEBUG:teuthology.orchestra.run.smithi092:> 2024-09-11T00:14:27.590 DEBUG:teuthology.orchestra.run.smithi092:> print(_find_admin_socket("client.admin")) 2024-09-11T00:14:27.590 DEBUG:teuthology.orchestra.run.smithi092:> ' 2024-09-11T00:14:27.707 INFO:teuthology.orchestra.run.smithi092.stdout:/var/run/ceph/ceph-client.admin.43750.asok 2024-09-11T00:14:27.710 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:27 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T00:14:27.718 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.43750.asok 2024-09-11T00:14:27.718 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T00:14:27.718 DEBUG:teuthology.orchestra.run.smithi092:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.43750.asok status 2024-09-11T00:14:27.849 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2024-09-11T00:14:27.850 INFO:teuthology.orchestra.run.smithi092.stdout: "metadata": { 2024-09-11T00:14:27.850 INFO:teuthology.orchestra.run.smithi092.stdout: "ceph_sha1": "8f219c476cb4f26fc5719c661c0323719a45cb30", 2024-09-11T00:14:27.850 INFO:teuthology.orchestra.run.smithi092.stdout: "ceph_version": "ceph version 19.3.0-4854-g8f219c47 (8f219c476cb4f26fc5719c661c0323719a45cb30) squid (dev)", 2024-09-11T00:14:27.850 INFO:teuthology.orchestra.run.smithi092.stdout: "entity_id": "admin", 2024-09-11T00:14:27.851 INFO:teuthology.orchestra.run.smithi092.stdout: "hostname": "smithi092", 2024-09-11T00:14:27.851 INFO:teuthology.orchestra.run.smithi092.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2024-09-11T00:14:27.851 INFO:teuthology.orchestra.run.smithi092.stdout: "pid": "43750", 2024-09-11T00:14:27.851 INFO:teuthology.orchestra.run.smithi092.stdout: "root": "/" 2024-09-11T00:14:27.851 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-11T00:14:27.851 INFO:teuthology.orchestra.run.smithi092.stdout: "dentry_count": 0, 2024-09-11T00:14:27.852 INFO:teuthology.orchestra.run.smithi092.stdout: "dentry_pinned_count": 0, 2024-09-11T00:14:27.852 INFO:teuthology.orchestra.run.smithi092.stdout: "id": 4497, 2024-09-11T00:14:27.852 INFO:teuthology.orchestra.run.smithi092.stdout: "inst": { 2024-09-11T00:14:27.852 INFO:teuthology.orchestra.run.smithi092.stdout: "name": { 2024-09-11T00:14:27.852 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "client", 2024-09-11T00:14:27.852 INFO:teuthology.orchestra.run.smithi092.stdout: "num": 4497 2024-09-11T00:14:27.853 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-11T00:14:27.853 INFO:teuthology.orchestra.run.smithi092.stdout: "addr": { 2024-09-11T00:14:27.853 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "v1", 2024-09-11T00:14:27.853 INFO:teuthology.orchestra.run.smithi092.stdout: "addr": "192.168.0.1:0", 2024-09-11T00:14:27.853 INFO:teuthology.orchestra.run.smithi092.stdout: "nonce": 1807413673 2024-09-11T00:14:27.853 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-11T00:14:27.853 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-11T00:14:27.853 INFO:teuthology.orchestra.run.smithi092.stdout: "addr": { 2024-09-11T00:14:27.854 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "v1", 2024-09-11T00:14:27.854 INFO:teuthology.orchestra.run.smithi092.stdout: "addr": "192.168.0.1:0", 2024-09-11T00:14:27.854 INFO:teuthology.orchestra.run.smithi092.stdout: "nonce": 1807413673 2024-09-11T00:14:27.854 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-11T00:14:27.854 INFO:teuthology.orchestra.run.smithi092.stdout: "inst_str": "client.4497 192.168.0.1:0/1807413673", 2024-09-11T00:14:27.854 INFO:teuthology.orchestra.run.smithi092.stdout: "addr_str": "192.168.0.1:0/1807413673", 2024-09-11T00:14:27.854 INFO:teuthology.orchestra.run.smithi092.stdout: "inode_count": 1, 2024-09-11T00:14:27.854 INFO:teuthology.orchestra.run.smithi092.stdout: "mds_epoch": 6, 2024-09-11T00:14:27.854 INFO:teuthology.orchestra.run.smithi092.stdout: "osd_epoch": 25, 2024-09-11T00:14:27.855 INFO:teuthology.orchestra.run.smithi092.stdout: "osd_epoch_barrier": 0, 2024-09-11T00:14:27.855 INFO:teuthology.orchestra.run.smithi092.stdout: "blocklisted": false, 2024-09-11T00:14:27.855 INFO:teuthology.orchestra.run.smithi092.stdout: "fs_name": "cephfs" 2024-09-11T00:14:27.855 INFO:teuthology.orchestra.run.smithi092.stdout:} 2024-09-11T00:14:27.858 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T00:14:27.858 DEBUG:teuthology.orchestra.run.smithi092:> stat --file-system '--printf=%T 2024-09-11T00:14:27.858 DEBUG:teuthology.orchestra.run.smithi092:> ' -- /home/ubuntu/cephtest/mnt.admin 2024-09-11T00:14:27.874 INFO:teuthology.orchestra.run.smithi092.stdout:fuseblk 2024-09-11T00:14:27.874 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2024-09-11T00:14:27.874 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T00:14:27.875 DEBUG:teuthology.orchestra.run.smithi092:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2024-09-11T00:14:27.940 DEBUG:teuthology.orchestra.run.smithi092:> (cd /home/ubuntu/cephtest/mnt.admin && exec stdin-killer --timeout=900 -- bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2024-09-11T00:14:28.031 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:28 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-11T00:14:28.053 INFO:teuthology.orchestra.run.smithi092.stdout:# file: . 2024-09-11T00:14:28.053 INFO:teuthology.orchestra.run.smithi092.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2024-09-11T00:14:28.053 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:14:28.053 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:28 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T00:14:28.058 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2024-09-11T00:14:28.059 DEBUG:teuthology.orchestra.run.smithi092:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T00:14:28.075 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-11T00:14:28.215 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:28.214+0000 7fbd64a8c640 1 -- 172.21.15.92:0/4154295681 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbd4c004800 msgr2=0x7fbd4c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:28.216 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:28.214+0000 7fbd64a8c640 1 --2- 172.21.15.92:0/4154295681 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbd4c004800 0x7fbd4c004c80 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fbd48009b50 tx=0x7fbd4c005830 comp rx=0 tx=0).stop 2024-09-11T00:14:28.216 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:28.214+0000 7fbd64a8c640 1 -- 172.21.15.92:0/4154295681 shutdown_connections 2024-09-11T00:14:28.216 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:28.214+0000 7fbd64a8c640 1 --2- 172.21.15.92:0/4154295681 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbd4c004800 0x7fbd4c004c80 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:28.216 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:28.214+0000 7fbd64a8c640 1 -- 172.21.15.92:0/4154295681 >> 172.21.15.92:0/4154295681 conn(0x7fbd600b1760 msgr2=0x7fbd600b1b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:14:28.216 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:28.214+0000 7fbd64a8c640 1 -- 172.21.15.92:0/4154295681 shutdown_connections 2024-09-11T00:14:28.216 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:28.214+0000 7fbd64a8c640 1 -- 172.21.15.92:0/4154295681 wait complete. 2024-09-11T00:14:28.216 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:28.215+0000 7fbd64a8c640 1 Processor -- start 2024-09-11T00:14:28.217 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:28.215+0000 7fbd64a8c640 1 -- start start 2024-09-11T00:14:28.218 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:28.216+0000 7fbd64a8c640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fbd4c004800 0x7fbd601391f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:28.218 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:28.216+0000 7fbd64a8c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbd60139960 0x7fbd601f5fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:28.218 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:28.216+0000 7fbd64a8c640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbd601f64f0 0x7fbd601f6970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:28.218 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:28.216+0000 7fbd64a8c640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fbd60073ef0 con 0x7fbd60139960 2024-09-11T00:14:28.219 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:28.216+0000 7fbd64a8c640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fbd60073d70 con 0x7fbd601f64f0 2024-09-11T00:14:28.219 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:28.216+0000 7fbd64a8c640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7fbd60074070 con 0x7fbd4c004800 2024-09-11T00:14:28.219 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:28.216+0000 7fbd5dd9b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbd60139960 0x7fbd601f5fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:28.219 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:28.216+0000 7fbd5dd9b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbd60139960 0x7fbd601f5fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:41636/0 (socket says 172.21.15.92:41636) 2024-09-11T00:14:28.219 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:28.216+0000 7fbd5dd9b640 1 -- 172.21.15.92:0/432417614 learned_addr learned my addr 172.21.15.92:0/432417614 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-11T00:14:28.219 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:28.216+0000 7fbd5e59c640 1 --2- 172.21.15.92:0/432417614 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fbd4c004800 0x7fbd601391f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:28.219 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:28.216+0000 7fbd5ed9d640 1 --2- 172.21.15.92:0/432417614 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbd601f64f0 0x7fbd601f6970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:28.219 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:28.216+0000 7fbd5dd9b640 1 -- 172.21.15.92:0/432417614 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fbd4c004800 msgr2=0x7fbd601391f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:28.219 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:28.216+0000 7fbd5dd9b640 1 --2- 172.21.15.92:0/432417614 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fbd4c004800 0x7fbd601391f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:28.219 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:28.216+0000 7fbd5dd9b640 1 -- 172.21.15.92:0/432417614 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbd601f64f0 msgr2=0x7fbd601f6970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:28.219 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:28.216+0000 7fbd5dd9b640 1 --2- 172.21.15.92:0/432417614 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbd601f64f0 0x7fbd601f6970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:28.219 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:28.216+0000 7fbd5dd9b640 1 -- 172.21.15.92:0/432417614 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd6013d1d0 con 0x7fbd60139960 2024-09-11T00:14:28.219 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:28.216+0000 7fbd5ed9d640 1 --2- 172.21.15.92:0/432417614 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbd601f64f0 0x7fbd601f6970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:14:28.219 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:28.216+0000 7fbd5dd9b640 1 --2- 172.21.15.92:0/432417614 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbd60139960 0x7fbd601f5fb0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fbd48036040 tx=0x7fbd480336f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:14:28.220 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:28.216+0000 7fbd56ffd640 1 -- 172.21.15.92:0/432417614 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd48038040 con 0x7fbd60139960 2024-09-11T00:14:28.220 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:28.216+0000 7fbd56ffd640 1 -- 172.21.15.92:0/432417614 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbd48004230 con 0x7fbd60139960 2024-09-11T00:14:28.220 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:28.217+0000 7fbd64a8c640 1 -- 172.21.15.92:0/432417614 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd600ab780 con 0x7fbd60139960 2024-09-11T00:14:28.220 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:28.217+0000 7fbd56ffd640 1 -- 172.21.15.92:0/432417614 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd480338e0 con 0x7fbd60139960 2024-09-11T00:14:28.220 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:28.217+0000 7fbd64a8c640 1 -- 172.21.15.92:0/432417614 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd6013cdf0 con 0x7fbd60139960 2024-09-11T00:14:28.221 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:28.217+0000 7fbd64a8c640 1 -- 172.21.15.92:0/432417614 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbd6015caa0 con 0x7fbd60139960 2024-09-11T00:14:28.221 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:28.218+0000 7fbd56ffd640 1 -- 172.21.15.92:0/432417614 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fbd4803b070 con 0x7fbd60139960 2024-09-11T00:14:28.222 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:28.218+0000 7fbd56ffd640 1 --2- 172.21.15.92:0/432417614 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7fbd40077fa0 0x7fbd4007a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:28.222 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:28.219+0000 7fbd56ffd640 1 -- 172.21.15.92:0/432417614 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fbd480ba2b0 con 0x7fbd60139960 2024-09-11T00:14:28.222 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:28.219+0000 7fbd5e59c640 1 --2- 172.21.15.92:0/432417614 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7fbd40077fa0 0x7fbd4007a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:28.222 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:28.219+0000 7fbd5e59c640 1 --2- 172.21.15.92:0/432417614 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7fbd40077fa0 0x7fbd4007a460 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fbd50004fd0 tx=0x7fbd50004ad0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:14:28.224 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:28.223+0000 7fbd56ffd640 1 -- 172.21.15.92:0/432417614 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fbd48082420 con 0x7fbd60139960 2024-09-11T00:14:28.407 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:28.406+0000 7fbd64a8c640 1 -- 172.21.15.92:0/432417614 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fbd600731f0 con 0x7fbd60139960 2024-09-11T00:14:28.408 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:28.406+0000 7fbd56ffd640 1 -- 172.21.15.92:0/432417614 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v25) ==== 80+0+0 (secure 0 0 0) 0x7fbd4808b190 con 0x7fbd60139960 2024-09-11T00:14:28.408 INFO:teuthology.orchestra.run.smithi092.stderr:listed 0 entries 2024-09-11T00:14:28.410 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:28.408+0000 7fbd64a8c640 1 -- 172.21.15.92:0/432417614 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7fbd40077fa0 msgr2=0x7fbd4007a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:28.410 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:28.408+0000 7fbd64a8c640 1 --2- 172.21.15.92:0/432417614 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7fbd40077fa0 0x7fbd4007a460 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fbd50004fd0 tx=0x7fbd50004ad0 comp rx=0 tx=0).stop 2024-09-11T00:14:28.410 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:28.408+0000 7fbd64a8c640 1 -- 172.21.15.92:0/432417614 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbd60139960 msgr2=0x7fbd601f5fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:28.410 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:28.408+0000 7fbd64a8c640 1 --2- 172.21.15.92:0/432417614 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbd60139960 0x7fbd601f5fb0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fbd48036040 tx=0x7fbd480336f0 comp rx=0 tx=0).stop 2024-09-11T00:14:28.410 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:28.408+0000 7fbd64a8c640 1 -- 172.21.15.92:0/432417614 shutdown_connections 2024-09-11T00:14:28.410 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:28.408+0000 7fbd64a8c640 1 --2- 172.21.15.92:0/432417614 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7fbd40077fa0 0x7fbd4007a460 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:28.410 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:28.408+0000 7fbd64a8c640 1 --2- 172.21.15.92:0/432417614 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbd601f64f0 0x7fbd601f6970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:28.410 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:28.408+0000 7fbd64a8c640 1 --2- 172.21.15.92:0/432417614 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbd60139960 0x7fbd601f5fb0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:28.410 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:28.408+0000 7fbd64a8c640 1 --2- 172.21.15.92:0/432417614 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fbd4c004800 0x7fbd601391f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:28.411 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:28.408+0000 7fbd64a8c640 1 -- 172.21.15.92:0/432417614 >> 172.21.15.92:0/432417614 conn(0x7fbd600b1760 msgr2=0x7fbd6006f570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:14:28.411 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:28.408+0000 7fbd64a8c640 1 -- 172.21.15.92:0/432417614 shutdown_connections 2024-09-11T00:14:28.411 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:28.408+0000 7fbd64a8c640 1 -- 172.21.15.92:0/432417614 wait complete. 2024-09-11T00:14:28.421 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2024-09-11T00:14:28.421 DEBUG:teuthology.orchestra.run.smithi092:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T00:14:28.437 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-11T00:14:28.581 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:28.579+0000 7f3cb3f9b640 1 -- 172.21.15.92:0/3167392327 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3cac0694d0 msgr2=0x7f3cac0b5e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:28.581 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:28.579+0000 7f3cb3f9b640 1 --2- 172.21.15.92:0/3167392327 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3cac0694d0 0x7f3cac0b5e90 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f3ca0005fd0 tx=0x7f3ca002aa90 comp rx=0 tx=0).stop 2024-09-11T00:14:28.581 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:28.579+0000 7f3cb3f9b640 1 -- 172.21.15.92:0/3167392327 shutdown_connections 2024-09-11T00:14:28.581 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:28.579+0000 7f3cb3f9b640 1 --2- 172.21.15.92:0/3167392327 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3cac0694d0 0x7f3cac0b5e90 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:28.581 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:28.579+0000 7f3cb3f9b640 1 --2- 172.21.15.92:0/3167392327 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3cac15f230 0x7f3cac0b5950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:28.581 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:28.579+0000 7f3cb3f9b640 1 -- 172.21.15.92:0/3167392327 >> 172.21.15.92:0/3167392327 conn(0x7f3cac074150 msgr2=0x7f3cac074560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:14:28.581 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:28.579+0000 7f3cb3f9b640 1 -- 172.21.15.92:0/3167392327 shutdown_connections 2024-09-11T00:14:28.582 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:28.579+0000 7f3cb3f9b640 1 -- 172.21.15.92:0/3167392327 wait complete. 2024-09-11T00:14:28.582 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:28.580+0000 7f3cb3f9b640 1 Processor -- start 2024-09-11T00:14:28.582 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:28.580+0000 7f3cb3f9b640 1 -- start start 2024-09-11T00:14:28.584 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:28.581+0000 7f3cb3f9b640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3cac0694d0 0x7f3cac1e85b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:28.584 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:28.581+0000 7f3cb3f9b640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3cac0d02b0 0x7f3cac154dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:28.584 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:28.581+0000 7f3cb3f9b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3cac15f230 0x7f3cac15de00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:28.584 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:28.581+0000 7f3cb3f9b640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f3cac0d0af0 con 0x7f3cac15f230 2024-09-11T00:14:28.584 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:28.581+0000 7f3cb3f9b640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f3cac0d0970 con 0x7f3cac0694d0 2024-09-11T00:14:28.584 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:28.581+0000 7f3cb3f9b640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f3cac0cd440 con 0x7f3cac0d02b0 2024-09-11T00:14:28.584 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:28.581+0000 7f3cb2538640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3cac15f230 0x7f3cac15de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:28.584 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:28.581+0000 7f3cb2538640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3cac15f230 0x7f3cac15de00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:41650/0 (socket says 172.21.15.92:41650) 2024-09-11T00:14:28.584 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:28.581+0000 7f3cb2538640 1 -- 172.21.15.92:0/1489595974 learned_addr learned my addr 172.21.15.92:0/1489595974 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-11T00:14:28.584 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:28.581+0000 7f3cb1536640 1 --2- 172.21.15.92:0/1489595974 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3cac0d02b0 0x7f3cac154dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:28.584 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:28.581+0000 7f3cb1d37640 1 --2- 172.21.15.92:0/1489595974 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3cac0694d0 0x7f3cac1e85b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:28.585 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:28.581+0000 7f3cb2538640 1 -- 172.21.15.92:0/1489595974 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3cac0d02b0 msgr2=0x7f3cac154dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:28.585 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:28.581+0000 7f3cb2538640 1 --2- 172.21.15.92:0/1489595974 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3cac0d02b0 0x7f3cac154dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:28.585 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:28.582+0000 7f3cb2538640 1 -- 172.21.15.92:0/1489595974 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3cac0694d0 msgr2=0x7f3cac1e85b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:28.585 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:28.582+0000 7f3cb2538640 1 --2- 172.21.15.92:0/1489595974 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3cac0694d0 0x7f3cac1e85b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:28.585 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:28.582+0000 7f3cb2538640 1 -- 172.21.15.92:0/1489595974 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3cac155310 con 0x7f3cac15f230 2024-09-11T00:14:28.585 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:28.582+0000 7f3cb2538640 1 --2- 172.21.15.92:0/1489595974 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3cac15f230 0x7f3cac15de00 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f3ca400c400 tx=0x7f3ca400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:14:28.585 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:28.582+0000 7f3caa7fc640 1 -- 172.21.15.92:0/1489595974 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ca4017070 con 0x7f3cac15f230 2024-09-11T00:14:28.586 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:28.582+0000 7f3caa7fc640 1 -- 172.21.15.92:0/1489595974 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3ca40053c0 con 0x7f3cac15f230 2024-09-11T00:14:28.586 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:28.582+0000 7f3caa7fc640 1 -- 172.21.15.92:0/1489595974 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ca4003850 con 0x7f3cac15f230 2024-09-11T00:14:28.586 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:28.582+0000 7f3cb3f9b640 1 -- 172.21.15.92:0/1489595974 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3cac1e5bc0 con 0x7f3cac15f230 2024-09-11T00:14:28.586 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:28.582+0000 7f3cb3f9b640 1 -- 172.21.15.92:0/1489595974 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3cac1e6180 con 0x7f3cac15f230 2024-09-11T00:14:28.587 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:28.583+0000 7f3cb3f9b640 1 -- 172.21.15.92:0/1489595974 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3cac0cd8a0 con 0x7f3cac15f230 2024-09-11T00:14:28.587 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:28.583+0000 7f3caa7fc640 1 -- 172.21.15.92:0/1489595974 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f3ca40039f0 con 0x7f3cac15f230 2024-09-11T00:14:28.587 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:28.584+0000 7f3caa7fc640 1 --2- 172.21.15.92:0/1489595974 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f3c98077fa0 0x7f3c9807a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:28.587 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:28.584+0000 7f3caa7fc640 1 -- 172.21.15.92:0/1489595974 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f3ca4099700 con 0x7f3cac15f230 2024-09-11T00:14:28.587 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:28.584+0000 7f3cb1d37640 1 --2- 172.21.15.92:0/1489595974 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f3c98077fa0 0x7f3c9807a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:28.587 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:28.585+0000 7f3cb1d37640 1 --2- 172.21.15.92:0/1489595974 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f3c98077fa0 0x7f3c9807a460 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f3c9c004630 tx=0x7f3c9c00b2e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:14:28.589 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:28.588+0000 7f3caa7fc640 1 -- 172.21.15.92:0/1489595974 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f3ca40617f0 con 0x7f3cac15f230 2024-09-11T00:14:28.776 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:28.774+0000 7f3cb3f9b640 1 -- 172.21.15.92:0/1489595974 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f3cac1e4ee0 con 0x7f3cac15f230 2024-09-11T00:14:28.776 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:28.774+0000 7f3caa7fc640 1 -- 172.21.15.92:0/1489595974 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v25) ==== 80+0+0 (secure 0 0 0) 0x7f3ca4066220 con 0x7f3cac15f230 2024-09-11T00:14:28.776 INFO:teuthology.orchestra.run.smithi092.stderr:listed 0 entries 2024-09-11T00:14:28.778 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:28.776+0000 7f3cb3f9b640 1 -- 172.21.15.92:0/1489595974 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f3c98077fa0 msgr2=0x7f3c9807a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:28.778 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:28.776+0000 7f3cb3f9b640 1 --2- 172.21.15.92:0/1489595974 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f3c98077fa0 0x7f3c9807a460 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f3c9c004630 tx=0x7f3c9c00b2e0 comp rx=0 tx=0).stop 2024-09-11T00:14:28.778 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:28.776+0000 7f3cb3f9b640 1 -- 172.21.15.92:0/1489595974 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3cac15f230 msgr2=0x7f3cac15de00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:28.778 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:28.776+0000 7f3cb3f9b640 1 --2- 172.21.15.92:0/1489595974 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3cac15f230 0x7f3cac15de00 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f3ca400c400 tx=0x7f3ca400c8c0 comp rx=0 tx=0).stop 2024-09-11T00:14:28.778 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:28.776+0000 7f3cb3f9b640 1 -- 172.21.15.92:0/1489595974 shutdown_connections 2024-09-11T00:14:28.778 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:28.776+0000 7f3cb3f9b640 1 --2- 172.21.15.92:0/1489595974 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f3c98077fa0 0x7f3c9807a460 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:28.778 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:28.776+0000 7f3cb3f9b640 1 --2- 172.21.15.92:0/1489595974 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3cac15f230 0x7f3cac15de00 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:28.779 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:28.776+0000 7f3cb3f9b640 1 --2- 172.21.15.92:0/1489595974 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3cac0d02b0 0x7f3cac154dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:28.779 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:28.776+0000 7f3cb3f9b640 1 --2- 172.21.15.92:0/1489595974 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3cac0694d0 0x7f3cac1e85b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:28.779 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:28.776+0000 7f3cb3f9b640 1 -- 172.21.15.92:0/1489595974 >> 172.21.15.92:0/1489595974 conn(0x7f3cac074150 msgr2=0x7f3cac0688e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:14:28.779 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:28.776+0000 7f3cb3f9b640 1 -- 172.21.15.92:0/1489595974 shutdown_connections 2024-09-11T00:14:28.779 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:28.776+0000 7f3cb3f9b640 1 -- 172.21.15.92:0/1489595974 wait complete. 2024-09-11T00:14:28.788 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi092.front.sepia.ceph.com... 2024-09-11T00:14:28.789 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T00:14:28.789 DEBUG:teuthology.orchestra.run.smithi092:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2024-09-11T00:14:28.812 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi092.stderr:ceph-fuse[43750]: fuse finished with error 0 and tester_r 0 2024-09-11T00:14:28.813 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T00:14:34.914 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi092.front.sepia.ceph.com 2024-09-11T00:14:34.915 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T00:14:34.915 DEBUG:teuthology.orchestra.run.smithi092:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2024-09-11T00:14:34.945 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T00:14:35.102 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:35.100+0000 7f606beed640 1 -- 172.21.15.92:0/483924859 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f606415a920 msgr2=0x7f6064072f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:35.102 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:35.100+0000 7f606beed640 1 --2- 172.21.15.92:0/483924859 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f606415a920 0x7f6064072f00 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f6054005fd0 tx=0x7f605402a820 comp rx=0 tx=0).stop 2024-09-11T00:14:35.102 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:35.100+0000 7f606beed640 1 -- 172.21.15.92:0/483924859 shutdown_connections 2024-09-11T00:14:35.103 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:35.100+0000 7f606beed640 1 --2- 172.21.15.92:0/483924859 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6064073cf0 0x7f606415b110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:35.103 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:35.100+0000 7f606beed640 1 --2- 172.21.15.92:0/483924859 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f606415a920 0x7f6064072f00 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:35.103 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:35.100+0000 7f606beed640 1 -- 172.21.15.92:0/483924859 >> 172.21.15.92:0/483924859 conn(0x7f60640b1c80 msgr2=0x7f60640b2060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:14:35.103 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:35.100+0000 7f606beed640 1 -- 172.21.15.92:0/483924859 shutdown_connections 2024-09-11T00:14:35.103 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:35.100+0000 7f606beed640 1 -- 172.21.15.92:0/483924859 wait complete. 2024-09-11T00:14:35.105 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:35.101+0000 7f606beed640 1 Processor -- start 2024-09-11T00:14:35.105 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:35.101+0000 7f606beed640 1 -- start start 2024-09-11T00:14:35.105 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:35.102+0000 7f606beed640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6064073cf0 0x7f60640d0330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:35.105 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:35.102+0000 7f606beed640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f60640b4a60 0x7f6064143950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:35.105 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:35.102+0000 7f606beed640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f606415a920 0x7f6064151710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:35.105 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:35.102+0000 7f606beed640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f606415b9e0 con 0x7f6064073cf0 2024-09-11T00:14:35.106 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:35.102+0000 7f606beed640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f606415b860 con 0x7f60640b4a60 2024-09-11T00:14:35.106 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:35.102+0000 7f606beed640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f606415bb60 con 0x7f606415a920 2024-09-11T00:14:35.106 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:35.102+0000 7f6069c89640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6064073cf0 0x7f60640d0330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:35.106 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:35.102+0000 7f6069c89640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6064073cf0 0x7f60640d0330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:50104/0 (socket says 172.21.15.92:50104) 2024-09-11T00:14:35.106 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:35.102+0000 7f6069c89640 1 -- 172.21.15.92:0/1007704761 learned_addr learned my addr 172.21.15.92:0/1007704761 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-11T00:14:35.106 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:35.102+0000 7f6069488640 1 --2- 172.21.15.92:0/1007704761 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f60640b4a60 0x7f6064143950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:35.106 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:35.102+0000 7f606a48a640 1 --2- 172.21.15.92:0/1007704761 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f606415a920 0x7f6064151710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:35.106 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:35.102+0000 7f6069c89640 1 -- 172.21.15.92:0/1007704761 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f606415a920 msgr2=0x7f6064151710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:35.106 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:35.102+0000 7f6069c89640 1 --2- 172.21.15.92:0/1007704761 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f606415a920 0x7f6064151710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:35.106 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:35.102+0000 7f6069c89640 1 -- 172.21.15.92:0/1007704761 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f60640b4a60 msgr2=0x7f6064143950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:35.106 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:35.102+0000 7f6069c89640 1 --2- 172.21.15.92:0/1007704761 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f60640b4a60 0x7f6064143950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:35.106 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:35.103+0000 7f6069c89640 1 -- 172.21.15.92:0/1007704761 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60641f6b90 con 0x7f6064073cf0 2024-09-11T00:14:35.106 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:35.103+0000 7f606a48a640 1 --2- 172.21.15.92:0/1007704761 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f606415a920 0x7f6064151710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:14:35.106 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:35.103+0000 7f6069c89640 1 --2- 172.21.15.92:0/1007704761 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6064073cf0 0x7f60640d0330 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f6054009cd0 tx=0x7f6054032d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:14:35.107 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:35.103+0000 7f60627fc640 1 -- 172.21.15.92:0/1007704761 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6054037040 con 0x7f6064073cf0 2024-09-11T00:14:35.107 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:35.103+0000 7f60627fc640 1 -- 172.21.15.92:0/1007704761 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6054042070 con 0x7f6064073cf0 2024-09-11T00:14:35.107 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:35.103+0000 7f606beed640 1 -- 172.21.15.92:0/1007704761 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f60640cf440 con 0x7f6064073cf0 2024-09-11T00:14:35.107 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:35.103+0000 7f60627fc640 1 -- 172.21.15.92:0/1007704761 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6054004280 con 0x7f6064073cf0 2024-09-11T00:14:35.107 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:35.103+0000 7f606beed640 1 -- 172.21.15.92:0/1007704761 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60641f68b0 con 0x7f6064073cf0 2024-09-11T00:14:35.108 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:35.104+0000 7f606beed640 1 -- 172.21.15.92:0/1007704761 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f60641f66c0 con 0x7f6064073cf0 2024-09-11T00:14:35.108 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:35.105+0000 7f60627fc640 1 -- 172.21.15.92:0/1007704761 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f605403a030 con 0x7f6064073cf0 2024-09-11T00:14:35.108 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:35.105+0000 7f60627fc640 1 --2- 172.21.15.92:0/1007704761 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f6050077f70 0x7f605007a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:35.108 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:35.105+0000 7f60627fc640 1 -- 172.21.15.92:0/1007704761 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f60540bab30 con 0x7f6064073cf0 2024-09-11T00:14:35.108 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:35.106+0000 7f6069488640 1 --2- 172.21.15.92:0/1007704761 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f6050077f70 0x7f605007a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:35.108 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:35.106+0000 7f6069488640 1 --2- 172.21.15.92:0/1007704761 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f6050077f70 0x7f605007a430 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f60640706e0 tx=0x7f6058009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:14:35.111 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:35.110+0000 7f60627fc640 1 -- 172.21.15.92:0/1007704761 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f60540832f0 con 0x7f6064073cf0 2024-09-11T00:14:35.287 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:35.285+0000 7f606beed640 1 -- 172.21.15.92:0/1007704761 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f606415b110 con 0x7f6064073cf0 2024-09-11T00:14:35.288 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:35.286+0000 7f60627fc640 1 -- 172.21.15.92:0/1007704761 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18622 (secure 0 0 0) 0x7f6054082bf0 con 0x7f6064073cf0 2024-09-11T00:14:35.288 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:14:35.288 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":25,"fsid":"47039cb3-5d2a-46bf-9066-8055b5dfc583","created":"2024-09-11T00:13:53.889939+0000","modified":"2024-09-11T00:14:23.001261+0000","last_up_change":"2024-09-11T00:14:06.563107+0000","last_in_change":"2024-09-11T00:13:56.982537+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T00:14:06.287223+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-11T00:14:15.739528+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-11T00:14:16.925480+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-11T00:14:20.639419+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"538af0ea-96c9-4999-9ccc-bee55f80ff76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":2860560077},{"type":"v1","addr":"172.21.15.92:6801","nonce":2860560077}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":2860560077},{"type":"v1","addr":"172.21.15.92:6803","nonce":2860560077}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":2860560077},{"type":"v1","addr":"172.21.15.92:6807","nonce":2860560077}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":2860560077},{"type":"v1","addr":"172.21.15.92:6805","nonce":2860560077}]},"public_addr":"172.21.15.92:6801/2860560077","cluster_addr":"172.21.15.92:6803/2860560077","heartbeat_back_addr":"172.21.15.92:6807/2860560077","heartbeat_front_addr":"172.21.15.92:6805/2860560077","state":["exists","up"]},{"osd":1,"uuid":"f9214f2c-ffe6-4447-9a13-9549a36e0537","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":2600417443},{"type":"v1","addr":"172.21.15.92:6817","nonce":2600417443}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6818","nonce":2600417443},{"type":"v1","addr":"172.21.15.92:6819","nonce":2600417443}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6822","nonce":2600417443},{"type":"v1","addr":"172.21.15.92:6823","nonce":2600417443}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":2600417443},{"type":"v1","addr":"172.21.15.92:6821","nonce":2600417443}]},"public_addr":"172.21.15.92:6817/2600417443","cluster_addr":"172.21.15.92:6819/2600417443","heartbeat_back_addr":"172.21.15.92:6823/2600417443","heartbeat_front_addr":"172.21.15.92:6821/2600417443","state":["exists","up"]},{"osd":2,"uuid":"b44dd849-fb85-42b1-8a1a-b6681bb1f467","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":3143892898},{"type":"v1","addr":"172.21.15.92:6809","nonce":3143892898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":3143892898},{"type":"v1","addr":"172.21.15.92:6811","nonce":3143892898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":3143892898},{"type":"v1","addr":"172.21.15.92:6815","nonce":3143892898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":3143892898},{"type":"v1","addr":"172.21.15.92:6813","nonce":3143892898}]},"public_addr":"172.21.15.92:6809/3143892898","cluster_addr":"172.21.15.92:6811/3143892898","heartbeat_back_addr":"172.21.15.92:6815/3143892898","heartbeat_front_addr":"172.21.15.92:6813/3143892898","state":["exists","up"]},{"osd":3,"uuid":"05a49d87-23b9-48dd-962c-d5c2686e7a32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":3913961488},{"type":"v1","addr":"172.21.15.92:6825","nonce":3913961488}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6826","nonce":3913961488},{"type":"v1","addr":"172.21.15.92:6827","nonce":3913961488}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":3913961488},{"type":"v1","addr":"172.21.15.92:6831","nonce":3913961488}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":3913961488},{"type":"v1","addr":"172.21.15.92:6829","nonce":3913961488}]},"public_addr":"172.21.15.92:6825/3913961488","cluster_addr":"172.21.15.92:6827/3913961488","heartbeat_back_addr":"172.21.15.92:6831/3913961488","heartbeat_front_addr":"172.21.15.92:6829/3913961488","state":["exists","up"]},{"osd":4,"uuid":"cf52b087-afe0-4f43-a4e7-db2ebc158815","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6826","nonce":2206798907},{"type":"v1","addr":"172.21.15.145:6827","nonce":2206798907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6828","nonce":2206798907},{"type":"v1","addr":"172.21.15.145:6829","nonce":2206798907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6832","nonce":2206798907},{"type":"v1","addr":"172.21.15.145:6833","nonce":2206798907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6830","nonce":2206798907},{"type":"v1","addr":"172.21.15.145:6831","nonce":2206798907}]},"public_addr":"172.21.15.145:6827/2206798907","cluster_addr":"172.21.15.145:6829/2206798907","heartbeat_back_addr":"172.21.15.145:6833/2206798907","heartbeat_front_addr":"172.21.15.145:6831/2206798907","state":["exists","up"]},{"osd":5,"uuid":"0e54adcd-2d1d-49fb-bf97-3dd7e9addd30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6810","nonce":2599548493},{"type":"v1","addr":"172.21.15.145:6811","nonce":2599548493}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6812","nonce":2599548493},{"type":"v1","addr":"172.21.15.145:6813","nonce":2599548493}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6816","nonce":2599548493},{"type":"v1","addr":"172.21.15.145:6817","nonce":2599548493}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6814","nonce":2599548493},{"type":"v1","addr":"172.21.15.145:6815","nonce":2599548493}]},"public_addr":"172.21.15.145:6811/2599548493","cluster_addr":"172.21.15.145:6813/2599548493","heartbeat_back_addr":"172.21.15.145:6817/2599548493","heartbeat_front_addr":"172.21.15.145:6815/2599548493","state":["exists","up"]},{"osd":6,"uuid":"4d5ae7a8-b3df-4c7a-9124-290f239f5b57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6802","nonce":4192380792},{"type":"v1","addr":"172.21.15.145:6803","nonce":4192380792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6804","nonce":4192380792},{"type":"v1","addr":"172.21.15.145:6805","nonce":4192380792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6808","nonce":4192380792},{"type":"v1","addr":"172.21.15.145:6809","nonce":4192380792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6806","nonce":4192380792},{"type":"v1","addr":"172.21.15.145:6807","nonce":4192380792}]},"public_addr":"172.21.15.145:6803/4192380792","cluster_addr":"172.21.15.145:6805/4192380792","heartbeat_back_addr":"172.21.15.145:6809/4192380792","heartbeat_front_addr":"172.21.15.145:6807/4192380792","state":["exists","up"]},{"osd":7,"uuid":"d7e36444-6e3f-4372-81d3-88e7b4e993f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6818","nonce":3010598400},{"type":"v1","addr":"172.21.15.145:6819","nonce":3010598400}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6820","nonce":3010598400},{"type":"v1","addr":"172.21.15.145:6821","nonce":3010598400}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6824","nonce":3010598400},{"type":"v1","addr":"172.21.15.145:6825","nonce":3010598400}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6822","nonce":3010598400},{"type":"v1","addr":"172.21.15.145:6823","nonce":3010598400}]},"public_addr":"172.21.15.145:6819/3010598400","cluster_addr":"172.21.15.145:6821/3010598400","heartbeat_back_addr":"172.21.15.145:6825/3010598400","heartbeat_front_addr":"172.21.15.145:6823/3010598400","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:14:03.281892+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:14:04.039021+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:14:03.045775+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:14:03.708856+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:14:04.425520+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:14:03.839369+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:14:03.029834+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:14:03.707529+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T00:14:35.290 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:35.288+0000 7f606beed640 1 -- 172.21.15.92:0/1007704761 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f6050077f70 msgr2=0x7f605007a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:35.290 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:35.288+0000 7f606beed640 1 --2- 172.21.15.92:0/1007704761 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f6050077f70 0x7f605007a430 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f60640706e0 tx=0x7f6058009040 comp rx=0 tx=0).stop 2024-09-11T00:14:35.290 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:35.288+0000 7f606beed640 1 -- 172.21.15.92:0/1007704761 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6064073cf0 msgr2=0x7f60640d0330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:35.290 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:35.288+0000 7f606beed640 1 --2- 172.21.15.92:0/1007704761 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6064073cf0 0x7f60640d0330 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f6054009cd0 tx=0x7f6054032d10 comp rx=0 tx=0).stop 2024-09-11T00:14:35.291 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:35.288+0000 7f606beed640 1 -- 172.21.15.92:0/1007704761 shutdown_connections 2024-09-11T00:14:35.291 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:35.288+0000 7f606beed640 1 --2- 172.21.15.92:0/1007704761 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f6050077f70 0x7f605007a430 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:35.291 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:35.288+0000 7f606beed640 1 --2- 172.21.15.92:0/1007704761 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f606415a920 0x7f6064151710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:35.291 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:35.288+0000 7f606beed640 1 --2- 172.21.15.92:0/1007704761 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f60640b4a60 0x7f6064143950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:35.291 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:35.288+0000 7f606beed640 1 --2- 172.21.15.92:0/1007704761 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6064073cf0 0x7f60640d0330 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:35.291 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:35.288+0000 7f606beed640 1 -- 172.21.15.92:0/1007704761 >> 172.21.15.92:0/1007704761 conn(0x7f60640b1c80 msgr2=0x7f60640b2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:14:35.291 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:35.288+0000 7f606beed640 1 -- 172.21.15.92:0/1007704761 shutdown_connections 2024-09-11T00:14:35.291 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:35.288+0000 7f606beed640 1 -- 172.21.15.92:0/1007704761 wait complete. 2024-09-11T00:14:35.301 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T00:14:35.402 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:35.400+0000 7feeb7b75640 1 -- 172.21.15.92:0/319342419 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7feeb013cf80 msgr2=0x7feeb006f750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:35.402 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:35.400+0000 7feeb7b75640 1 --2- 172.21.15.92:0/319342419 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7feeb013cf80 0x7feeb006f750 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7feeb0151500 tx=0x7feeac02b130 comp rx=0 tx=0).stop 2024-09-11T00:14:35.402 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:35.400+0000 7feeb7b75640 1 -- 172.21.15.92:0/319342419 shutdown_connections 2024-09-11T00:14:35.402 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:35.400+0000 7feeb7b75640 1 --2- 172.21.15.92:0/319342419 >> v2:172.21.15.145:3300/0 conn(0x7feeb015e140 0x7feeb006fc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:35.402 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:35.400+0000 7feeb7b75640 1 --2- 172.21.15.92:0/319342419 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7feeb013cf80 0x7feeb006f750 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:35.402 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:35.400+0000 7feeb7b75640 1 -- 172.21.15.92:0/319342419 >> 172.21.15.92:0/319342419 conn(0x7feeb00b1760 msgr2=0x7feeb00b1b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:14:35.402 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:35.400+0000 7feeb7b75640 1 -- 172.21.15.92:0/319342419 shutdown_connections 2024-09-11T00:14:35.403 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:35.400+0000 7feeb7b75640 1 -- 172.21.15.92:0/319342419 wait complete. 2024-09-11T00:14:35.405 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:35.401+0000 7feeb7b75640 1 Processor -- start 2024-09-11T00:14:35.405 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:35.401+0000 7feeb7b75640 1 -- start start 2024-09-11T00:14:35.405 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:35.402+0000 7feeb7b75640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7feeb013cf80 0x7feeb00aeba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:35.405 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:35.402+0000 7feeb7b75640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7feeb015b1e0 0x7feeb01f5740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:35.405 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:35.402+0000 7feeb7b75640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7feeb015e140 0x7feeb0156a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:35.405 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:35.402+0000 7feeb7b75640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7feeb00b3e90 con 0x7feeb015b1e0 2024-09-11T00:14:35.405 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:35.402+0000 7feeb7b75640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7feeb00b3d10 con 0x7feeb015e140 2024-09-11T00:14:35.405 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:35.402+0000 7feeb7b75640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7feeb00b4010 con 0x7feeb013cf80 2024-09-11T00:14:35.406 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:35.402+0000 7feeb5110640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7feeb015b1e0 0x7feeb01f5740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:35.406 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:35.402+0000 7feeb5110640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7feeb015b1e0 0x7feeb01f5740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:50134/0 (socket says 172.21.15.92:50134) 2024-09-11T00:14:35.406 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:35.402+0000 7feeb5110640 1 -- 172.21.15.92:0/1211705374 learned_addr learned my addr 172.21.15.92:0/1211705374 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-11T00:14:35.406 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:35.402+0000 7feeb6112640 1 --2- 172.21.15.92:0/1211705374 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7feeb015e140 0x7feeb0156a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:35.406 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:35.402+0000 7feeb5110640 1 -- 172.21.15.92:0/1211705374 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7feeb013cf80 msgr2=0x7feeb00aeba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:35.406 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:35.402+0000 7feeb5911640 1 --2- 172.21.15.92:0/1211705374 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7feeb013cf80 0x7feeb00aeba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:35.406 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:35.402+0000 7feeb5110640 1 --2- 172.21.15.92:0/1211705374 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7feeb013cf80 0x7feeb00aeba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:35.406 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:35.402+0000 7feeb5110640 1 -- 172.21.15.92:0/1211705374 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7feeb015e140 msgr2=0x7feeb0156a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:35.406 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:35.402+0000 7feeb5110640 1 --2- 172.21.15.92:0/1211705374 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7feeb015e140 0x7feeb0156a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:35.406 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:35.402+0000 7feeb5110640 1 -- 172.21.15.92:0/1211705374 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feeb00af240 con 0x7feeb015b1e0 2024-09-11T00:14:35.406 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:35.402+0000 7feeb6112640 1 --2- 172.21.15.92:0/1211705374 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7feeb015e140 0x7feeb0156a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:14:35.406 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:35.402+0000 7feeb5110640 1 --2- 172.21.15.92:0/1211705374 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7feeb015b1e0 0x7feeb01f5740 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7feea000c500 tx=0x7feea000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:14:35.406 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:35.402+0000 7feea67fc640 1 -- 172.21.15.92:0/1211705374 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feea0017070 con 0x7feeb015b1e0 2024-09-11T00:14:35.406 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:35.402+0000 7feea67fc640 1 -- 172.21.15.92:0/1211705374 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7feea00035f0 con 0x7feeb015b1e0 2024-09-11T00:14:35.407 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:35.402+0000 7feeb7b75640 1 -- 172.21.15.92:0/1211705374 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feeb0155f20 con 0x7feeb015b1e0 2024-09-11T00:14:35.407 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:35.402+0000 7feea67fc640 1 -- 172.21.15.92:0/1211705374 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feea0003a40 con 0x7feeb015b1e0 2024-09-11T00:14:35.407 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:35.403+0000 7feeb7b75640 1 -- 172.21.15.92:0/1211705374 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feeb0156f40 con 0x7feeb015b1e0 2024-09-11T00:14:35.407 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:35.404+0000 7feeb7b75640 1 -- 172.21.15.92:0/1211705374 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feeb015da30 con 0x7feeb015b1e0 2024-09-11T00:14:35.407 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:35.404+0000 7feea67fc640 1 -- 172.21.15.92:0/1211705374 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7feea0003be0 con 0x7feeb015b1e0 2024-09-11T00:14:35.408 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:35.405+0000 7feea67fc640 1 --2- 172.21.15.92:0/1211705374 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7fee94077f70 0x7fee9407a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:35.408 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:35.405+0000 7feea67fc640 1 -- 172.21.15.92:0/1211705374 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7feea0099800 con 0x7feeb015b1e0 2024-09-11T00:14:35.408 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:35.405+0000 7feeb5911640 1 --2- 172.21.15.92:0/1211705374 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7fee94077f70 0x7fee9407a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:35.408 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:35.405+0000 7feeb5911640 1 --2- 172.21.15.92:0/1211705374 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7fee94077f70 0x7fee9407a430 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7feeac034000 tx=0x7feeac004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:14:35.410 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:35.409+0000 7feea67fc640 1 -- 172.21.15.92:0/1211705374 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7feea0062050 con 0x7feeb015b1e0 2024-09-11T00:14:35.584 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:35.582+0000 7feeb7b75640 1 -- 172.21.15.92:0/1211705374 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7feeb00ccfa0 con 0x7feeb015b1e0 2024-09-11T00:14:35.585 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:35.583+0000 7feea67fc640 1 -- 172.21.15.92:0/1211705374 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18622 (secure 0 0 0) 0x7feea0061950 con 0x7feeb015b1e0 2024-09-11T00:14:35.585 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:14:35.585 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":25,"fsid":"47039cb3-5d2a-46bf-9066-8055b5dfc583","created":"2024-09-11T00:13:53.889939+0000","modified":"2024-09-11T00:14:23.001261+0000","last_up_change":"2024-09-11T00:14:06.563107+0000","last_in_change":"2024-09-11T00:13:56.982537+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T00:14:06.287223+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-11T00:14:15.739528+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-11T00:14:16.925480+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-11T00:14:20.639419+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"538af0ea-96c9-4999-9ccc-bee55f80ff76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":2860560077},{"type":"v1","addr":"172.21.15.92:6801","nonce":2860560077}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":2860560077},{"type":"v1","addr":"172.21.15.92:6803","nonce":2860560077}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":2860560077},{"type":"v1","addr":"172.21.15.92:6807","nonce":2860560077}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":2860560077},{"type":"v1","addr":"172.21.15.92:6805","nonce":2860560077}]},"public_addr":"172.21.15.92:6801/2860560077","cluster_addr":"172.21.15.92:6803/2860560077","heartbeat_back_addr":"172.21.15.92:6807/2860560077","heartbeat_front_addr":"172.21.15.92:6805/2860560077","state":["exists","up"]},{"osd":1,"uuid":"f9214f2c-ffe6-4447-9a13-9549a36e0537","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":2600417443},{"type":"v1","addr":"172.21.15.92:6817","nonce":2600417443}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6818","nonce":2600417443},{"type":"v1","addr":"172.21.15.92:6819","nonce":2600417443}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6822","nonce":2600417443},{"type":"v1","addr":"172.21.15.92:6823","nonce":2600417443}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":2600417443},{"type":"v1","addr":"172.21.15.92:6821","nonce":2600417443}]},"public_addr":"172.21.15.92:6817/2600417443","cluster_addr":"172.21.15.92:6819/2600417443","heartbeat_back_addr":"172.21.15.92:6823/2600417443","heartbeat_front_addr":"172.21.15.92:6821/2600417443","state":["exists","up"]},{"osd":2,"uuid":"b44dd849-fb85-42b1-8a1a-b6681bb1f467","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":3143892898},{"type":"v1","addr":"172.21.15.92:6809","nonce":3143892898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":3143892898},{"type":"v1","addr":"172.21.15.92:6811","nonce":3143892898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":3143892898},{"type":"v1","addr":"172.21.15.92:6815","nonce":3143892898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":3143892898},{"type":"v1","addr":"172.21.15.92:6813","nonce":3143892898}]},"public_addr":"172.21.15.92:6809/3143892898","cluster_addr":"172.21.15.92:6811/3143892898","heartbeat_back_addr":"172.21.15.92:6815/3143892898","heartbeat_front_addr":"172.21.15.92:6813/3143892898","state":["exists","up"]},{"osd":3,"uuid":"05a49d87-23b9-48dd-962c-d5c2686e7a32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":3913961488},{"type":"v1","addr":"172.21.15.92:6825","nonce":3913961488}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6826","nonce":3913961488},{"type":"v1","addr":"172.21.15.92:6827","nonce":3913961488}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":3913961488},{"type":"v1","addr":"172.21.15.92:6831","nonce":3913961488}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":3913961488},{"type":"v1","addr":"172.21.15.92:6829","nonce":3913961488}]},"public_addr":"172.21.15.92:6825/3913961488","cluster_addr":"172.21.15.92:6827/3913961488","heartbeat_back_addr":"172.21.15.92:6831/3913961488","heartbeat_front_addr":"172.21.15.92:6829/3913961488","state":["exists","up"]},{"osd":4,"uuid":"cf52b087-afe0-4f43-a4e7-db2ebc158815","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6826","nonce":2206798907},{"type":"v1","addr":"172.21.15.145:6827","nonce":2206798907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6828","nonce":2206798907},{"type":"v1","addr":"172.21.15.145:6829","nonce":2206798907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6832","nonce":2206798907},{"type":"v1","addr":"172.21.15.145:6833","nonce":2206798907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6830","nonce":2206798907},{"type":"v1","addr":"172.21.15.145:6831","nonce":2206798907}]},"public_addr":"172.21.15.145:6827/2206798907","cluster_addr":"172.21.15.145:6829/2206798907","heartbeat_back_addr":"172.21.15.145:6833/2206798907","heartbeat_front_addr":"172.21.15.145:6831/2206798907","state":["exists","up"]},{"osd":5,"uuid":"0e54adcd-2d1d-49fb-bf97-3dd7e9addd30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6810","nonce":2599548493},{"type":"v1","addr":"172.21.15.145:6811","nonce":2599548493}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6812","nonce":2599548493},{"type":"v1","addr":"172.21.15.145:6813","nonce":2599548493}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6816","nonce":2599548493},{"type":"v1","addr":"172.21.15.145:6817","nonce":2599548493}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6814","nonce":2599548493},{"type":"v1","addr":"172.21.15.145:6815","nonce":2599548493}]},"public_addr":"172.21.15.145:6811/2599548493","cluster_addr":"172.21.15.145:6813/2599548493","heartbeat_back_addr":"172.21.15.145:6817/2599548493","heartbeat_front_addr":"172.21.15.145:6815/2599548493","state":["exists","up"]},{"osd":6,"uuid":"4d5ae7a8-b3df-4c7a-9124-290f239f5b57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6802","nonce":4192380792},{"type":"v1","addr":"172.21.15.145:6803","nonce":4192380792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6804","nonce":4192380792},{"type":"v1","addr":"172.21.15.145:6805","nonce":4192380792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6808","nonce":4192380792},{"type":"v1","addr":"172.21.15.145:6809","nonce":4192380792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6806","nonce":4192380792},{"type":"v1","addr":"172.21.15.145:6807","nonce":4192380792}]},"public_addr":"172.21.15.145:6803/4192380792","cluster_addr":"172.21.15.145:6805/4192380792","heartbeat_back_addr":"172.21.15.145:6809/4192380792","heartbeat_front_addr":"172.21.15.145:6807/4192380792","state":["exists","up"]},{"osd":7,"uuid":"d7e36444-6e3f-4372-81d3-88e7b4e993f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6818","nonce":3010598400},{"type":"v1","addr":"172.21.15.145:6819","nonce":3010598400}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6820","nonce":3010598400},{"type":"v1","addr":"172.21.15.145:6821","nonce":3010598400}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6824","nonce":3010598400},{"type":"v1","addr":"172.21.15.145:6825","nonce":3010598400}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6822","nonce":3010598400},{"type":"v1","addr":"172.21.15.145:6823","nonce":3010598400}]},"public_addr":"172.21.15.145:6819/3010598400","cluster_addr":"172.21.15.145:6821/3010598400","heartbeat_back_addr":"172.21.15.145:6825/3010598400","heartbeat_front_addr":"172.21.15.145:6823/3010598400","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:14:03.281892+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:14:04.039021+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:14:03.045775+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:14:03.708856+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:14:04.425520+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:14:03.839369+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:14:03.029834+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:14:03.707529+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T00:14:35.587 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:35.585+0000 7feeb7b75640 1 -- 172.21.15.92:0/1211705374 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7fee94077f70 msgr2=0x7fee9407a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:35.587 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:35.585+0000 7feeb7b75640 1 --2- 172.21.15.92:0/1211705374 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7fee94077f70 0x7fee9407a430 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7feeac034000 tx=0x7feeac004730 comp rx=0 tx=0).stop 2024-09-11T00:14:35.587 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:35.585+0000 7feeb7b75640 1 -- 172.21.15.92:0/1211705374 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7feeb015b1e0 msgr2=0x7feeb01f5740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:35.587 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:35.585+0000 7feeb7b75640 1 --2- 172.21.15.92:0/1211705374 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7feeb015b1e0 0x7feeb01f5740 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7feea000c500 tx=0x7feea000c9c0 comp rx=0 tx=0).stop 2024-09-11T00:14:35.587 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:35.585+0000 7feeb7b75640 1 -- 172.21.15.92:0/1211705374 shutdown_connections 2024-09-11T00:14:35.588 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:35.585+0000 7feeb7b75640 1 --2- 172.21.15.92:0/1211705374 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7fee94077f70 0x7fee9407a430 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:35.588 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:35.585+0000 7feeb7b75640 1 --2- 172.21.15.92:0/1211705374 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7feeb015e140 0x7feeb0156a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:35.588 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:35.585+0000 7feeb7b75640 1 --2- 172.21.15.92:0/1211705374 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7feeb015b1e0 0x7feeb01f5740 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:35.588 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:35.585+0000 7feeb7b75640 1 --2- 172.21.15.92:0/1211705374 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7feeb013cf80 0x7feeb00aeba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:35.588 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:35.585+0000 7feeb7b75640 1 -- 172.21.15.92:0/1211705374 >> 172.21.15.92:0/1211705374 conn(0x7feeb00b1760 msgr2=0x7feeb013bb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:14:35.588 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:35.585+0000 7feeb7b75640 1 -- 172.21.15.92:0/1211705374 shutdown_connections 2024-09-11T00:14:35.588 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:35.585+0000 7feeb7b75640 1 -- 172.21.15.92:0/1211705374 wait complete. 2024-09-11T00:14:35.598 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-11T00:14:35.703 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:35.701+0000 7ffa0ee57640 1 -- 172.21.15.92:0/1732779326 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ffa08160530 msgr2=0x7ffa080cf860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:35.703 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:35.701+0000 7ffa0ee57640 1 --2- 172.21.15.92:0/1732779326 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ffa08160530 0x7ffa080cf860 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7ffa08073c80 tx=0x7ff9f802a4d0 comp rx=0 tx=0).stop 2024-09-11T00:14:35.703 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:35.701+0000 7ffa0ee57640 1 -- 172.21.15.92:0/1732779326 shutdown_connections 2024-09-11T00:14:35.703 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:35.701+0000 7ffa0ee57640 1 --2- 172.21.15.92:0/1732779326 >> v2:172.21.15.145:3300/0 conn(0x7ffa080b1280 0x7ffa080b16f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:35.703 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:35.701+0000 7ffa0ee57640 1 --2- 172.21.15.92:0/1732779326 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ffa080b0d50 0x7ffa080cfda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:35.703 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:35.701+0000 7ffa0ee57640 1 --2- 172.21.15.92:0/1732779326 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ffa08160530 0x7ffa080cf860 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:35.703 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:35.701+0000 7ffa0ee57640 1 -- 172.21.15.92:0/1732779326 >> 172.21.15.92:0/1732779326 conn(0x7ffa080b37c0 msgr2=0x7ffa080b3bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:14:35.703 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:35.701+0000 7ffa0ee57640 1 -- 172.21.15.92:0/1732779326 shutdown_connections 2024-09-11T00:14:35.704 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:35.701+0000 7ffa0ee57640 1 -- 172.21.15.92:0/1732779326 wait complete. 2024-09-11T00:14:35.704 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:35.702+0000 7ffa0ee57640 1 Processor -- start 2024-09-11T00:14:35.704 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:35.702+0000 7ffa0ee57640 1 -- start start 2024-09-11T00:14:35.706 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:35.703+0000 7ffa0ee57640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ffa080b1280 0x7ffa080c8390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:35.706 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:35.703+0000 7ffa0ee57640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ffa08160530 0x7ffa081f2900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:35.706 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:35.703+0000 7ffa0ee57640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ffa0815e420 0x7ffa080c9520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:35.706 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:35.703+0000 7ffa0ee57640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7ffa080b1c30 con 0x7ffa0815e420 2024-09-11T00:14:35.706 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:35.703+0000 7ffa0ee57640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7ffa080b34f0 con 0x7ffa08160530 2024-09-11T00:14:35.706 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:35.703+0000 7ffa0ee57640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7ffa080b1db0 con 0x7ffa080b1280 2024-09-11T00:14:35.706 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:35.703+0000 7ffa0d3f4640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ffa0815e420 0x7ffa080c9520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:35.706 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:35.703+0000 7ffa0d3f4640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ffa0815e420 0x7ffa080c9520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:50160/0 (socket says 172.21.15.92:50160) 2024-09-11T00:14:35.706 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:35.703+0000 7ffa0d3f4640 1 -- 172.21.15.92:0/3443412664 learned_addr learned my addr 172.21.15.92:0/3443412664 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-11T00:14:35.706 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:35.703+0000 7ffa07fff640 1 --2- 172.21.15.92:0/3443412664 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ffa08160530 0x7ffa081f2900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:35.707 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:35.703+0000 7ffa0cbf3640 1 --2- 172.21.15.92:0/3443412664 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ffa080b1280 0x7ffa080c8390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:35.707 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:35.704+0000 7ffa0d3f4640 1 -- 172.21.15.92:0/3443412664 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ffa080b1280 msgr2=0x7ffa080c8390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:35.707 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:35.704+0000 7ffa0d3f4640 1 --2- 172.21.15.92:0/3443412664 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ffa080b1280 0x7ffa080c8390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:35.707 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:35.704+0000 7ffa0d3f4640 1 -- 172.21.15.92:0/3443412664 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ffa08160530 msgr2=0x7ffa081f2900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:35.707 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:35.704+0000 7ffa0d3f4640 1 --2- 172.21.15.92:0/3443412664 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ffa08160530 0x7ffa081f2900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:35.707 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:35.704+0000 7ffa0d3f4640 1 -- 172.21.15.92:0/3443412664 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa080c8d60 con 0x7ffa0815e420 2024-09-11T00:14:35.707 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:35.704+0000 7ffa07fff640 1 --2- 172.21.15.92:0/3443412664 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ffa08160530 0x7ffa081f2900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:14:35.707 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:35.704+0000 7ffa0d3f4640 1 --2- 172.21.15.92:0/3443412664 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ffa0815e420 0x7ffa080c9520 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7ffa0000d740 tx=0x7ffa0000dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:14:35.707 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:35.704+0000 7ffa057fa640 1 -- 172.21.15.92:0/3443412664 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa00017070 con 0x7ffa0815e420 2024-09-11T00:14:35.707 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:35.704+0000 7ffa057fa640 1 -- 172.21.15.92:0/3443412664 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ffa00009d20 con 0x7ffa0815e420 2024-09-11T00:14:35.707 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:35.704+0000 7ffa0ee57640 1 -- 172.21.15.92:0/3443412664 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa081f3220 con 0x7ffa0815e420 2024-09-11T00:14:35.707 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:35.704+0000 7ffa057fa640 1 -- 172.21.15.92:0/3443412664 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa00004280 con 0x7ffa0815e420 2024-09-11T00:14:35.707 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:35.704+0000 7ffa0ee57640 1 -- 172.21.15.92:0/3443412664 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa080c9000 con 0x7ffa0815e420 2024-09-11T00:14:35.708 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:35.705+0000 7ffa0ee57640 1 -- 172.21.15.92:0/3443412664 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffa080b16f0 con 0x7ffa0815e420 2024-09-11T00:14:35.708 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:35.705+0000 7ffa057fa640 1 -- 172.21.15.92:0/3443412664 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7ffa000035f0 con 0x7ffa0815e420 2024-09-11T00:14:35.708 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:35.706+0000 7ffa057fa640 1 --2- 172.21.15.92:0/3443412664 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7ff9e8077f70 0x7ff9e807a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:35.708 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:35.706+0000 7ffa057fa640 1 -- 172.21.15.92:0/3443412664 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7ffa0009a270 con 0x7ffa0815e420 2024-09-11T00:14:35.709 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:35.706+0000 7ffa0cbf3640 1 --2- 172.21.15.92:0/3443412664 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7ff9e8077f70 0x7ff9e807a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:35.709 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:35.707+0000 7ffa0cbf3640 1 --2- 172.21.15.92:0/3443412664 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7ff9e8077f70 0x7ff9e807a430 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7ff9f8033000 tx=0x7ff9f8004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:14:35.712 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:35.710+0000 7ffa057fa640 1 -- 172.21.15.92:0/3443412664 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7ffa081f3220 con 0x7ffa0815e420 2024-09-11T00:14:35.923 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:35.921+0000 7ffa0ee57640 1 -- 172.21.15.92:0/3443412664 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7ffa080c91d0 con 0x7ffa0815e420 2024-09-11T00:14:36.676 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:36.674+0000 7ffa057fa640 1 -- 172.21.15.92:0/3443412664 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v7) ==== 118+0+0 (secure 0 0 0) 0x7ffa00062a30 con 0x7ffa0815e420 2024-09-11T00:14:36.679 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:36.677+0000 7ffa0ee57640 1 -- 172.21.15.92:0/3443412664 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7ff9e8077f70 msgr2=0x7ff9e807a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:36.679 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:36.677+0000 7ffa0ee57640 1 --2- 172.21.15.92:0/3443412664 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7ff9e8077f70 0x7ff9e807a430 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7ff9f8033000 tx=0x7ff9f8004730 comp rx=0 tx=0).stop 2024-09-11T00:14:36.679 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:36.677+0000 7ffa0ee57640 1 -- 172.21.15.92:0/3443412664 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ffa0815e420 msgr2=0x7ffa080c9520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:36.679 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:36.677+0000 7ffa0ee57640 1 --2- 172.21.15.92:0/3443412664 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ffa0815e420 0x7ffa080c9520 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7ffa0000d740 tx=0x7ffa0000dc00 comp rx=0 tx=0).stop 2024-09-11T00:14:36.679 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:36.677+0000 7ffa0ee57640 1 -- 172.21.15.92:0/3443412664 shutdown_connections 2024-09-11T00:14:36.679 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:36.677+0000 7ffa0ee57640 1 --2- 172.21.15.92:0/3443412664 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7ff9e8077f70 0x7ff9e807a430 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:36.679 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:36.677+0000 7ffa0ee57640 1 --2- 172.21.15.92:0/3443412664 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ffa0815e420 0x7ffa080c9520 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:36.679 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:36.677+0000 7ffa0ee57640 1 --2- 172.21.15.92:0/3443412664 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ffa08160530 0x7ffa081f2900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:36.679 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:36.677+0000 7ffa0ee57640 1 --2- 172.21.15.92:0/3443412664 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ffa080b1280 0x7ffa080c8390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:36.680 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:36.677+0000 7ffa0ee57640 1 -- 172.21.15.92:0/3443412664 >> 172.21.15.92:0/3443412664 conn(0x7ffa080b37c0 msgr2=0x7ffa080cf690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:14:36.680 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:36.677+0000 7ffa0ee57640 1 -- 172.21.15.92:0/3443412664 shutdown_connections 2024-09-11T00:14:36.680 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:36.677+0000 7ffa0ee57640 1 -- 172.21.15.92:0/3443412664 wait complete. 2024-09-11T00:14:36.692 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']} 2024-09-11T00:14:36.692 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-11T00:14:36.800 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:36.798+0000 7fd77ef17640 1 -- 172.21.15.92:0/2677278740 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd7780d2830 msgr2=0x7fd7780cf8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:36.800 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:36.798+0000 7fd77ef17640 1 --2- 172.21.15.92:0/2677278740 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd7780d2830 0x7fd7780cf8e0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fd778075550 tx=0x7fd77002a560 comp rx=0 tx=0).stop 2024-09-11T00:14:36.801 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:36.798+0000 7fd77ef17640 1 -- 172.21.15.92:0/2677278740 shutdown_connections 2024-09-11T00:14:36.801 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:36.798+0000 7fd77ef17640 1 --2- 172.21.15.92:0/2677278740 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd7780d2830 0x7fd7780cf8e0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:36.801 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:36.798+0000 7fd77ef17640 1 --2- 172.21.15.92:0/2677278740 >> v2:172.21.15.145:3300/0 conn(0x7fd7780d0a00 0x7fd778070760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:36.801 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:36.798+0000 7fd77ef17640 1 -- 172.21.15.92:0/2677278740 >> 172.21.15.92:0/2677278740 conn(0x7fd7780d1d10 msgr2=0x7fd7780d2120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:14:36.801 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:36.798+0000 7fd77ef17640 1 -- 172.21.15.92:0/2677278740 shutdown_connections 2024-09-11T00:14:36.801 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:36.798+0000 7fd77ef17640 1 -- 172.21.15.92:0/2677278740 wait complete. 2024-09-11T00:14:36.803 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:36.799+0000 7fd77ef17640 1 Processor -- start 2024-09-11T00:14:36.803 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:36.800+0000 7fd77ef17640 1 -- start start 2024-09-11T00:14:36.803 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:36.800+0000 7fd77ef17640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd7780d0a00 0x7fd7781f8100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:36.803 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:36.800+0000 7fd77ef17640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd7780d2830 0x7fd7780c4910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:36.803 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:36.800+0000 7fd77ef17640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd77815be00 0x7fd7780c6e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:36.803 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:36.800+0000 7fd77ef17640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fd7780cd1d0 con 0x7fd7780d2830 2024-09-11T00:14:36.803 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:36.800+0000 7fd77ef17640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fd7780cd050 con 0x7fd77815be00 2024-09-11T00:14:36.804 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:36.800+0000 7fd77ef17640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7fd7780cd350 con 0x7fd7780d0a00 2024-09-11T00:14:36.804 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:36.801+0000 7fd777fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd7780d2830 0x7fd7780c4910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:36.804 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:36.801+0000 7fd777fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd7780d2830 0x7fd7780c4910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:50184/0 (socket says 172.21.15.92:50184) 2024-09-11T00:14:36.804 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:36.801+0000 7fd777fff640 1 -- 172.21.15.92:0/3981278871 learned_addr learned my addr 172.21.15.92:0/3981278871 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-11T00:14:36.804 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:36.801+0000 7fd77d4b4640 1 --2- 172.21.15.92:0/3981278871 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd77815be00 0x7fd7780c6e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:36.804 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:36.801+0000 7fd77ccb3640 1 --2- 172.21.15.92:0/3981278871 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd7780d0a00 0x7fd7781f8100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:36.804 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:36.801+0000 7fd777fff640 1 -- 172.21.15.92:0/3981278871 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd7780d0a00 msgr2=0x7fd7781f8100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:36.804 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:36.801+0000 7fd777fff640 1 --2- 172.21.15.92:0/3981278871 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd7780d0a00 0x7fd7781f8100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:36.804 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:36.801+0000 7fd777fff640 1 -- 172.21.15.92:0/3981278871 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd77815be00 msgr2=0x7fd7780c6e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:36.804 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:36.801+0000 7fd777fff640 1 --2- 172.21.15.92:0/3981278871 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd77815be00 0x7fd7780c6e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:36.804 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:36.801+0000 7fd777fff640 1 -- 172.21.15.92:0/3981278871 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7780c7e40 con 0x7fd7780d2830 2024-09-11T00:14:36.804 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:36.801+0000 7fd77ccb3640 1 --2- 172.21.15.92:0/3981278871 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd7780d0a00 0x7fd7781f8100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:14:36.805 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:36.801+0000 7fd777fff640 1 --2- 172.21.15.92:0/3981278871 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd7780d2830 0x7fd7780c4910 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fd76000c970 tx=0x7fd76000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:14:36.805 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:36.801+0000 7fd7757fa640 1 -- 172.21.15.92:0/3981278871 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd760007bb0 con 0x7fd7780d2830 2024-09-11T00:14:36.805 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:36.801+0000 7fd7757fa640 1 -- 172.21.15.92:0/3981278871 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd760005020 con 0x7fd7780d2830 2024-09-11T00:14:36.805 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:36.801+0000 7fd77ef17640 1 -- 172.21.15.92:0/3981278871 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7780c8120 con 0x7fd7780d2830 2024-09-11T00:14:36.805 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:36.801+0000 7fd7757fa640 1 -- 172.21.15.92:0/3981278871 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd760007e60 con 0x7fd7780d2830 2024-09-11T00:14:36.805 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:36.801+0000 7fd77ef17640 1 -- 172.21.15.92:0/3981278871 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd77815cda0 con 0x7fd7780d2830 2024-09-11T00:14:36.806 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:36.802+0000 7fd77ef17640 1 -- 172.21.15.92:0/3981278871 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd778070760 con 0x7fd7780d2830 2024-09-11T00:14:36.806 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:36.803+0000 7fd7757fa640 1 -- 172.21.15.92:0/3981278871 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fd760005470 con 0x7fd7780d2830 2024-09-11T00:14:36.806 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:36.803+0000 7fd7757fa640 1 --2- 172.21.15.92:0/3981278871 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7fd758077f70 0x7fd75807a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:36.806 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:36.803+0000 7fd7757fa640 1 -- 172.21.15.92:0/3981278871 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fd76009a4f0 con 0x7fd7780d2830 2024-09-11T00:14:36.806 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:36.804+0000 7fd77ccb3640 1 --2- 172.21.15.92:0/3981278871 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7fd758077f70 0x7fd75807a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:36.806 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:36.804+0000 7fd77ccb3640 1 --2- 172.21.15.92:0/3981278871 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7fd758077f70 0x7fd75807a430 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fd768007eb0 tx=0x7fd7680073c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:14:36.809 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:36.808+0000 7fd7757fa640 1 -- 172.21.15.92:0/3981278871 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fd760014030 con 0x7fd7780d2830 2024-09-11T00:14:37.020 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:37.018+0000 7fd77ef17640 1 -- 172.21.15.92:0/3981278871 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7fd7780b7c90 con 0x7fd7780d2830 2024-09-11T00:14:37.684 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:37.683+0000 7fd7757fa640 1 -- 172.21.15.92:0/3981278871 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v8) ==== 122+0+0 (secure 0 0 0) 0x7fd760062d40 con 0x7fd7780d2830 2024-09-11T00:14:37.687 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:37.685+0000 7fd77ef17640 1 -- 172.21.15.92:0/3981278871 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7fd758077f70 msgr2=0x7fd75807a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:37.687 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:37.685+0000 7fd77ef17640 1 --2- 172.21.15.92:0/3981278871 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7fd758077f70 0x7fd75807a430 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fd768007eb0 tx=0x7fd7680073c0 comp rx=0 tx=0).stop 2024-09-11T00:14:37.687 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:37.685+0000 7fd77ef17640 1 -- 172.21.15.92:0/3981278871 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd7780d2830 msgr2=0x7fd7780c4910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:37.687 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:37.685+0000 7fd77ef17640 1 --2- 172.21.15.92:0/3981278871 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd7780d2830 0x7fd7780c4910 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fd76000c970 tx=0x7fd76000ce30 comp rx=0 tx=0).stop 2024-09-11T00:14:37.687 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:37.685+0000 7fd77ef17640 1 -- 172.21.15.92:0/3981278871 shutdown_connections 2024-09-11T00:14:37.688 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:37.685+0000 7fd77ef17640 1 --2- 172.21.15.92:0/3981278871 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7fd758077f70 0x7fd75807a430 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:37.688 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:37.685+0000 7fd77ef17640 1 --2- 172.21.15.92:0/3981278871 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd77815be00 0x7fd7780c6e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:37.688 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:37.685+0000 7fd77ef17640 1 --2- 172.21.15.92:0/3981278871 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd7780d2830 0x7fd7780c4910 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:37.688 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:37.685+0000 7fd77ef17640 1 --2- 172.21.15.92:0/3981278871 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd7780d0a00 0x7fd7781f8100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:37.688 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:37.685+0000 7fd77ef17640 1 -- 172.21.15.92:0/3981278871 >> 172.21.15.92:0/3981278871 conn(0x7fd7780d1d10 msgr2=0x7fd7780b3eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:14:37.688 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:37.685+0000 7fd77ef17640 1 -- 172.21.15.92:0/3981278871 shutdown_connections 2024-09-11T00:14:37.688 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:37.686+0000 7fd77ef17640 1 -- 172.21.15.92:0/3981278871 wait complete. 2024-09-11T00:14:37.699 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-11T00:14:37.699 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T00:14:37.801 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:37.799+0000 7f36c77ec640 1 -- 172.21.15.92:0/2033882965 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f36c0072680 msgr2=0x7f36c00ceb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:37.801 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:37.799+0000 7f36c77ec640 1 --2- 172.21.15.92:0/2033882965 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f36c0072680 0x7f36c00ceb00 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f36c006de10 tx=0x7f36b402a4d0 comp rx=0 tx=0).stop 2024-09-11T00:14:37.801 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:37.799+0000 7f36c77ec640 1 -- 172.21.15.92:0/2033882965 shutdown_connections 2024-09-11T00:14:37.802 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:37.799+0000 7f36c77ec640 1 --2- 172.21.15.92:0/2033882965 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f36c0072ad0 0x7f36c00cf040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:37.802 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:37.799+0000 7f36c77ec640 1 --2- 172.21.15.92:0/2033882965 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f36c0072680 0x7f36c00ceb00 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:37.802 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:37.799+0000 7f36c77ec640 1 --2- 172.21.15.92:0/2033882965 >> v2:172.21.15.145:3300/0 conn(0x7f36c0144780 0x7f36c00b3da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:37.802 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:37.799+0000 7f36c77ec640 1 -- 172.21.15.92:0/2033882965 >> 172.21.15.92:0/2033882965 conn(0x7f36c00b1760 msgr2=0x7f36c00b1b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:14:37.802 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:37.799+0000 7f36c77ec640 1 -- 172.21.15.92:0/2033882965 shutdown_connections 2024-09-11T00:14:37.802 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:37.799+0000 7f36c77ec640 1 -- 172.21.15.92:0/2033882965 wait complete. 2024-09-11T00:14:37.804 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:37.801+0000 7f36c77ec640 1 Processor -- start 2024-09-11T00:14:37.804 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:37.801+0000 7f36c77ec640 1 -- start start 2024-09-11T00:14:37.804 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:37.801+0000 7f36c77ec640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f36c0072680 0x7f36c013ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:37.804 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:37.801+0000 7f36c77ec640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f36c0072ad0 0x7f36c015a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:37.804 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:37.801+0000 7f36c77ec640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f36c0144780 0x7f36c0140330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:37.804 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:37.801+0000 7f36c77ec640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f36c015c6d0 con 0x7f36c0072ad0 2024-09-11T00:14:37.804 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:37.801+0000 7f36c77ec640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f36c015c550 con 0x7f36c0144780 2024-09-11T00:14:37.805 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:37.801+0000 7f36c77ec640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f36c015c850 con 0x7f36c0072680 2024-09-11T00:14:37.805 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:37.801+0000 7f36c4d87640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f36c0072ad0 0x7f36c015a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:37.805 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:37.801+0000 7f36c4d87640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f36c0072ad0 0x7f36c015a5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:50208/0 (socket says 172.21.15.92:50208) 2024-09-11T00:14:37.805 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:37.801+0000 7f36c4d87640 1 -- 172.21.15.92:0/3560998766 learned_addr learned my addr 172.21.15.92:0/3560998766 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-11T00:14:37.805 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:37.801+0000 7f36c5588640 1 --2- 172.21.15.92:0/3560998766 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f36c0072680 0x7f36c013ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:37.805 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:37.802+0000 7f36c5d89640 1 --2- 172.21.15.92:0/3560998766 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f36c0144780 0x7f36c0140330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:37.805 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:37.802+0000 7f36c4d87640 1 -- 172.21.15.92:0/3560998766 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f36c0072680 msgr2=0x7f36c013ed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:37.805 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:37.802+0000 7f36c4d87640 1 --2- 172.21.15.92:0/3560998766 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f36c0072680 0x7f36c013ed10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:37.805 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:37.802+0000 7f36c4d87640 1 -- 172.21.15.92:0/3560998766 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f36c0144780 msgr2=0x7f36c0140330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:37.805 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:37.802+0000 7f36c4d87640 1 --2- 172.21.15.92:0/3560998766 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f36c0144780 0x7f36c0140330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:37.805 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:37.802+0000 7f36c4d87640 1 -- 172.21.15.92:0/3560998766 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36c015ab00 con 0x7f36c0072ad0 2024-09-11T00:14:37.805 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:37.802+0000 7f36c4d87640 1 --2- 172.21.15.92:0/3560998766 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f36c0072ad0 0x7f36c015a5c0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f36b4009850 tx=0x7f36b4003910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:14:37.805 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:37.802+0000 7f36bdffb640 1 -- 172.21.15.92:0/3560998766 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36b403f070 con 0x7f36c0072ad0 2024-09-11T00:14:37.806 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:37.802+0000 7f36bdffb640 1 -- 172.21.15.92:0/3560998766 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f36b40047a0 con 0x7f36c0072ad0 2024-09-11T00:14:37.806 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:37.802+0000 7f36c77ec640 1 -- 172.21.15.92:0/3560998766 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f36c00cb500 con 0x7f36c0072ad0 2024-09-11T00:14:37.806 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:37.802+0000 7f36bdffb640 1 -- 172.21.15.92:0/3560998766 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36b4035030 con 0x7f36c0072ad0 2024-09-11T00:14:37.806 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:37.802+0000 7f36c77ec640 1 -- 172.21.15.92:0/3560998766 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36c00cbac0 con 0x7f36c0072ad0 2024-09-11T00:14:37.807 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:37.803+0000 7f36c77ec640 1 -- 172.21.15.92:0/3560998766 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f36c00b4560 con 0x7f36c0072ad0 2024-09-11T00:14:37.807 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:37.804+0000 7f36bdffb640 1 -- 172.21.15.92:0/3560998766 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f36b4004bb0 con 0x7f36c0072ad0 2024-09-11T00:14:37.807 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:37.804+0000 7f36bdffb640 1 --2- 172.21.15.92:0/3560998766 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f36ac077f70 0x7f36ac07a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:37.807 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:37.804+0000 7f36bdffb640 1 -- 172.21.15.92:0/3560998766 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f36b40bb0a0 con 0x7f36c0072ad0 2024-09-11T00:14:37.807 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:37.805+0000 7f36c5588640 1 --2- 172.21.15.92:0/3560998766 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f36ac077f70 0x7f36ac07a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:37.807 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:37.805+0000 7f36c5588640 1 --2- 172.21.15.92:0/3560998766 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f36ac077f70 0x7f36ac07a430 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f36b8005fd0 tx=0x7f36b80095e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:14:37.810 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:37.808+0000 7f36bdffb640 1 -- 172.21.15.92:0/3560998766 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f36c00b4560 con 0x7f36c0072ad0 2024-09-11T00:14:38.018 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:38.017+0000 7f36c77ec640 1 -- 172.21.15.92:0/3560998766 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f36c00b4d40 con 0x7f36c0072ad0 2024-09-11T00:14:38.019 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:38.017+0000 7f36bdffb640 1 -- 172.21.15.92:0/3560998766 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5225 (secure 0 0 0) 0x7f36b40832a0 con 0x7f36c0072ad0 2024-09-11T00:14:38.019 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:14:38.019 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":8,"btime":"2024-09-11T00:14:37:675941+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4286,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/2051794804","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":2051794804},{"type":"v1","addr":"172.21.15.92:6835","nonce":2051794804}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4295,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6835/1341143168","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6834","nonce":1341143168},{"type":"v1","addr":"172.21.15.145:6835","nonce":1341143168}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4356,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6833/3149311196","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":3149311196},{"type":"v1","addr":"172.21.15.92:6833","nonce":3149311196}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T00:14:17.969166+0000","modified":"2024-09-11T00:14:37.019981+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4374},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4374":{"gid":4374,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.145:6837/3236563974","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6836","nonce":3236563974},{"type":"v1","addr":"172.21.15.145:6837","nonce":3236563974}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4374,"qdb_cluster":[4374]},"id":1}]} 2024-09-11T00:14:38.019 INFO:teuthology.orchestra.run.smithi092.stderr:dumped fsmap epoch 8 2024-09-11T00:14:38.021 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:38.019+0000 7f36c77ec640 1 -- 172.21.15.92:0/3560998766 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f36ac077f70 msgr2=0x7f36ac07a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:38.021 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:38.019+0000 7f36c77ec640 1 --2- 172.21.15.92:0/3560998766 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f36ac077f70 0x7f36ac07a430 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f36b8005fd0 tx=0x7f36b80095e0 comp rx=0 tx=0).stop 2024-09-11T00:14:38.021 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:38.019+0000 7f36c77ec640 1 -- 172.21.15.92:0/3560998766 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f36c0072ad0 msgr2=0x7f36c015a5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:38.021 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:38.019+0000 7f36c77ec640 1 --2- 172.21.15.92:0/3560998766 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f36c0072ad0 0x7f36c015a5c0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f36b4009850 tx=0x7f36b4003910 comp rx=0 tx=0).stop 2024-09-11T00:14:38.021 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:38.019+0000 7f36c77ec640 1 -- 172.21.15.92:0/3560998766 shutdown_connections 2024-09-11T00:14:38.021 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:38.019+0000 7f36c77ec640 1 --2- 172.21.15.92:0/3560998766 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f36ac077f70 0x7f36ac07a430 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:38.021 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:38.019+0000 7f36c77ec640 1 --2- 172.21.15.92:0/3560998766 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f36c0144780 0x7f36c0140330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:38.021 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:38.019+0000 7f36c77ec640 1 --2- 172.21.15.92:0/3560998766 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f36c0072ad0 0x7f36c015a5c0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:38.022 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:38.019+0000 7f36c77ec640 1 --2- 172.21.15.92:0/3560998766 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f36c0072680 0x7f36c013ed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:38.022 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:38.019+0000 7f36c77ec640 1 -- 172.21.15.92:0/3560998766 >> 172.21.15.92:0/3560998766 conn(0x7f36c00b1760 msgr2=0x7f36c015ccb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:14:38.022 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:38.019+0000 7f36c77ec640 1 -- 172.21.15.92:0/3560998766 shutdown_connections 2024-09-11T00:14:38.022 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:38.019+0000 7f36c77ec640 1 -- 172.21.15.92:0/3560998766 wait complete. 2024-09-11T00:14:38.032 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T00:14:38.134 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:38.132+0000 7f42deff3640 1 -- 172.21.15.92:0/3818409695 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f42d80cff50 msgr2=0x7f42d80d0330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:38.134 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:38.132+0000 7f42deff3640 1 --2- 172.21.15.92:0/3818409695 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f42d80cff50 0x7f42d80d0330 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f42c8005fd0 tx=0x7f42c802aa90 comp rx=0 tx=0).stop 2024-09-11T00:14:38.134 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:38.132+0000 7f42deff3640 1 -- 172.21.15.92:0/3818409695 shutdown_connections 2024-09-11T00:14:38.134 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:38.132+0000 7f42deff3640 1 --2- 172.21.15.92:0/3818409695 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f42d80b2dc0 0x7f42d80d0870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:38.134 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:38.132+0000 7f42deff3640 1 --2- 172.21.15.92:0/3818409695 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f42d80cff50 0x7f42d80d0330 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:38.135 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:38.132+0000 7f42deff3640 1 -- 172.21.15.92:0/3818409695 >> 172.21.15.92:0/3818409695 conn(0x7f42d80d1d70 msgr2=0x7f42d80d2180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:14:38.135 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:38.132+0000 7f42deff3640 1 -- 172.21.15.92:0/3818409695 shutdown_connections 2024-09-11T00:14:38.135 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:38.132+0000 7f42deff3640 1 -- 172.21.15.92:0/3818409695 wait complete. 2024-09-11T00:14:38.137 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:38.133+0000 7f42deff3640 1 Processor -- start 2024-09-11T00:14:38.137 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:38.133+0000 7f42deff3640 1 -- start start 2024-09-11T00:14:38.137 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:38.134+0000 7f42deff3640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f42d80b2dc0 0x7f42d81f51a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:38.137 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:38.134+0000 7f42deff3640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f42d80cff50 0x7f42d80c7c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:38.137 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:38.134+0000 7f42deff3640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f42d815ef40 0x7f42d806db60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:38.137 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:38.134+0000 7f42deff3640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f42d80aedc0 con 0x7f42d815ef40 2024-09-11T00:14:38.137 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:38.134+0000 7f42deff3640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f42d80aec40 con 0x7f42d80b2dc0 2024-09-11T00:14:38.137 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:38.134+0000 7f42deff3640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f42d80aef40 con 0x7f42d80cff50 2024-09-11T00:14:38.137 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:38.134+0000 7f42dd590640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f42d815ef40 0x7f42d806db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:38.138 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:38.134+0000 7f42dd590640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f42d815ef40 0x7f42d806db60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:50226/0 (socket says 172.21.15.92:50226) 2024-09-11T00:14:38.138 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:38.134+0000 7f42dd590640 1 -- 172.21.15.92:0/3856557847 learned_addr learned my addr 172.21.15.92:0/3856557847 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-11T00:14:38.138 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:38.134+0000 7f42dcd8f640 1 --2- 172.21.15.92:0/3856557847 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f42d80b2dc0 0x7f42d81f51a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:38.138 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:38.134+0000 7f42d7fff640 1 --2- 172.21.15.92:0/3856557847 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f42d80cff50 0x7f42d80c7c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:38.138 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:38.134+0000 7f42dd590640 1 -- 172.21.15.92:0/3856557847 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f42d80cff50 msgr2=0x7f42d80c7c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:38.138 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:38.134+0000 7f42dd590640 1 --2- 172.21.15.92:0/3856557847 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f42d80cff50 0x7f42d80c7c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:38.138 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:38.134+0000 7f42dd590640 1 -- 172.21.15.92:0/3856557847 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f42d80b2dc0 msgr2=0x7f42d81f51a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:38.138 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:38.134+0000 7f42dd590640 1 --2- 172.21.15.92:0/3856557847 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f42d80b2dc0 0x7f42d81f51a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:38.138 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:38.134+0000 7f42dd590640 1 -- 172.21.15.92:0/3856557847 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42d81f56e0 con 0x7f42d815ef40 2024-09-11T00:14:38.138 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:38.135+0000 7f42dd590640 1 --2- 172.21.15.92:0/3856557847 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f42d815ef40 0x7f42d806db60 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f42d000c3c0 tx=0x7f42d000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:14:38.138 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:38.135+0000 7f42d57fa640 1 -- 172.21.15.92:0/3856557847 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42d0017070 con 0x7f42d815ef40 2024-09-11T00:14:38.138 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:38.135+0000 7f42d57fa640 1 -- 172.21.15.92:0/3856557847 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f42d00053c0 con 0x7f42d815ef40 2024-09-11T00:14:38.138 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:38.135+0000 7f42deff3640 1 -- 172.21.15.92:0/3856557847 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42d80c81c0 con 0x7f42d815ef40 2024-09-11T00:14:38.139 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:38.135+0000 7f42d57fa640 1 -- 172.21.15.92:0/3856557847 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42d0003850 con 0x7f42d815ef40 2024-09-11T00:14:38.139 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:38.135+0000 7f42deff3640 1 -- 172.21.15.92:0/3856557847 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42d81f5960 con 0x7f42d815ef40 2024-09-11T00:14:38.139 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:38.136+0000 7f42deff3640 1 -- 172.21.15.92:0/3856557847 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f42d80af4d0 con 0x7f42d815ef40 2024-09-11T00:14:38.139 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:38.136+0000 7f42d57fa640 1 -- 172.21.15.92:0/3856557847 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f42d00039f0 con 0x7f42d815ef40 2024-09-11T00:14:38.140 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:38.137+0000 7f42d57fa640 1 --2- 172.21.15.92:0/3856557847 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f42c4077fa0 0x7f42c407a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:38.140 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:38.137+0000 7f42d57fa640 1 -- 172.21.15.92:0/3856557847 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f42d0099660 con 0x7f42d815ef40 2024-09-11T00:14:38.140 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:38.137+0000 7f42dcd8f640 1 --2- 172.21.15.92:0/3856557847 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f42c4077fa0 0x7f42c407a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:38.140 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:38.138+0000 7f42dcd8f640 1 --2- 172.21.15.92:0/3856557847 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f42c4077fa0 0x7f42c407a460 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f42c8035000 tx=0x7f42c8039040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:14:38.142 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:38.141+0000 7f42d57fa640 1 -- 172.21.15.92:0/3856557847 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f42d80c81c0 con 0x7f42d815ef40 2024-09-11T00:14:38.318 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:38.316+0000 7f42deff3640 1 -- 172.21.15.92:0/3856557847 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f42d8072fd0 con 0x7f42d815ef40 2024-09-11T00:14:38.319 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:38.317+0000 7f42d57fa640 1 -- 172.21.15.92:0/3856557847 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18622 (secure 0 0 0) 0x7f42d81f56e0 con 0x7f42d815ef40 2024-09-11T00:14:38.319 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:14:38.320 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":25,"fsid":"47039cb3-5d2a-46bf-9066-8055b5dfc583","created":"2024-09-11T00:13:53.889939+0000","modified":"2024-09-11T00:14:23.001261+0000","last_up_change":"2024-09-11T00:14:06.563107+0000","last_in_change":"2024-09-11T00:13:56.982537+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T00:14:06.287223+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-11T00:14:15.739528+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-11T00:14:16.925480+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-11T00:14:20.639419+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"538af0ea-96c9-4999-9ccc-bee55f80ff76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":2860560077},{"type":"v1","addr":"172.21.15.92:6801","nonce":2860560077}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":2860560077},{"type":"v1","addr":"172.21.15.92:6803","nonce":2860560077}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":2860560077},{"type":"v1","addr":"172.21.15.92:6807","nonce":2860560077}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":2860560077},{"type":"v1","addr":"172.21.15.92:6805","nonce":2860560077}]},"public_addr":"172.21.15.92:6801/2860560077","cluster_addr":"172.21.15.92:6803/2860560077","heartbeat_back_addr":"172.21.15.92:6807/2860560077","heartbeat_front_addr":"172.21.15.92:6805/2860560077","state":["exists","up"]},{"osd":1,"uuid":"f9214f2c-ffe6-4447-9a13-9549a36e0537","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":2600417443},{"type":"v1","addr":"172.21.15.92:6817","nonce":2600417443}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6818","nonce":2600417443},{"type":"v1","addr":"172.21.15.92:6819","nonce":2600417443}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6822","nonce":2600417443},{"type":"v1","addr":"172.21.15.92:6823","nonce":2600417443}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":2600417443},{"type":"v1","addr":"172.21.15.92:6821","nonce":2600417443}]},"public_addr":"172.21.15.92:6817/2600417443","cluster_addr":"172.21.15.92:6819/2600417443","heartbeat_back_addr":"172.21.15.92:6823/2600417443","heartbeat_front_addr":"172.21.15.92:6821/2600417443","state":["exists","up"]},{"osd":2,"uuid":"b44dd849-fb85-42b1-8a1a-b6681bb1f467","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":3143892898},{"type":"v1","addr":"172.21.15.92:6809","nonce":3143892898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":3143892898},{"type":"v1","addr":"172.21.15.92:6811","nonce":3143892898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":3143892898},{"type":"v1","addr":"172.21.15.92:6815","nonce":3143892898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":3143892898},{"type":"v1","addr":"172.21.15.92:6813","nonce":3143892898}]},"public_addr":"172.21.15.92:6809/3143892898","cluster_addr":"172.21.15.92:6811/3143892898","heartbeat_back_addr":"172.21.15.92:6815/3143892898","heartbeat_front_addr":"172.21.15.92:6813/3143892898","state":["exists","up"]},{"osd":3,"uuid":"05a49d87-23b9-48dd-962c-d5c2686e7a32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":3913961488},{"type":"v1","addr":"172.21.15.92:6825","nonce":3913961488}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6826","nonce":3913961488},{"type":"v1","addr":"172.21.15.92:6827","nonce":3913961488}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":3913961488},{"type":"v1","addr":"172.21.15.92:6831","nonce":3913961488}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":3913961488},{"type":"v1","addr":"172.21.15.92:6829","nonce":3913961488}]},"public_addr":"172.21.15.92:6825/3913961488","cluster_addr":"172.21.15.92:6827/3913961488","heartbeat_back_addr":"172.21.15.92:6831/3913961488","heartbeat_front_addr":"172.21.15.92:6829/3913961488","state":["exists","up"]},{"osd":4,"uuid":"cf52b087-afe0-4f43-a4e7-db2ebc158815","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6826","nonce":2206798907},{"type":"v1","addr":"172.21.15.145:6827","nonce":2206798907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6828","nonce":2206798907},{"type":"v1","addr":"172.21.15.145:6829","nonce":2206798907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6832","nonce":2206798907},{"type":"v1","addr":"172.21.15.145:6833","nonce":2206798907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6830","nonce":2206798907},{"type":"v1","addr":"172.21.15.145:6831","nonce":2206798907}]},"public_addr":"172.21.15.145:6827/2206798907","cluster_addr":"172.21.15.145:6829/2206798907","heartbeat_back_addr":"172.21.15.145:6833/2206798907","heartbeat_front_addr":"172.21.15.145:6831/2206798907","state":["exists","up"]},{"osd":5,"uuid":"0e54adcd-2d1d-49fb-bf97-3dd7e9addd30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6810","nonce":2599548493},{"type":"v1","addr":"172.21.15.145:6811","nonce":2599548493}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6812","nonce":2599548493},{"type":"v1","addr":"172.21.15.145:6813","nonce":2599548493}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6816","nonce":2599548493},{"type":"v1","addr":"172.21.15.145:6817","nonce":2599548493}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6814","nonce":2599548493},{"type":"v1","addr":"172.21.15.145:6815","nonce":2599548493}]},"public_addr":"172.21.15.145:6811/2599548493","cluster_addr":"172.21.15.145:6813/2599548493","heartbeat_back_addr":"172.21.15.145:6817/2599548493","heartbeat_front_addr":"172.21.15.145:6815/2599548493","state":["exists","up"]},{"osd":6,"uuid":"4d5ae7a8-b3df-4c7a-9124-290f239f5b57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6802","nonce":4192380792},{"type":"v1","addr":"172.21.15.145:6803","nonce":4192380792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6804","nonce":4192380792},{"type":"v1","addr":"172.21.15.145:6805","nonce":4192380792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6808","nonce":4192380792},{"type":"v1","addr":"172.21.15.145:6809","nonce":4192380792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6806","nonce":4192380792},{"type":"v1","addr":"172.21.15.145:6807","nonce":4192380792}]},"public_addr":"172.21.15.145:6803/4192380792","cluster_addr":"172.21.15.145:6805/4192380792","heartbeat_back_addr":"172.21.15.145:6809/4192380792","heartbeat_front_addr":"172.21.15.145:6807/4192380792","state":["exists","up"]},{"osd":7,"uuid":"d7e36444-6e3f-4372-81d3-88e7b4e993f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6818","nonce":3010598400},{"type":"v1","addr":"172.21.15.145:6819","nonce":3010598400}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6820","nonce":3010598400},{"type":"v1","addr":"172.21.15.145:6821","nonce":3010598400}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6824","nonce":3010598400},{"type":"v1","addr":"172.21.15.145:6825","nonce":3010598400}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6822","nonce":3010598400},{"type":"v1","addr":"172.21.15.145:6823","nonce":3010598400}]},"public_addr":"172.21.15.145:6819/3010598400","cluster_addr":"172.21.15.145:6821/3010598400","heartbeat_back_addr":"172.21.15.145:6825/3010598400","heartbeat_front_addr":"172.21.15.145:6823/3010598400","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:14:03.281892+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:14:04.039021+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:14:03.045775+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:14:03.708856+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:14:04.425520+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:14:03.839369+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:14:03.029834+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:14:03.707529+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T00:14:38.322 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:38.320+0000 7f42deff3640 1 -- 172.21.15.92:0/3856557847 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f42c4077fa0 msgr2=0x7f42c407a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:38.322 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:38.320+0000 7f42deff3640 1 --2- 172.21.15.92:0/3856557847 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f42c4077fa0 0x7f42c407a460 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f42c8035000 tx=0x7f42c8039040 comp rx=0 tx=0).stop 2024-09-11T00:14:38.322 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:38.320+0000 7f42deff3640 1 -- 172.21.15.92:0/3856557847 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f42d815ef40 msgr2=0x7f42d806db60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:38.322 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:38.320+0000 7f42deff3640 1 --2- 172.21.15.92:0/3856557847 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f42d815ef40 0x7f42d806db60 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f42d000c3c0 tx=0x7f42d000c880 comp rx=0 tx=0).stop 2024-09-11T00:14:38.322 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:38.320+0000 7f42deff3640 1 -- 172.21.15.92:0/3856557847 shutdown_connections 2024-09-11T00:14:38.322 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:38.320+0000 7f42deff3640 1 --2- 172.21.15.92:0/3856557847 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f42c4077fa0 0x7f42c407a460 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:38.322 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:38.320+0000 7f42deff3640 1 --2- 172.21.15.92:0/3856557847 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f42d815ef40 0x7f42d806db60 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:38.322 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:38.320+0000 7f42deff3640 1 --2- 172.21.15.92:0/3856557847 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f42d80cff50 0x7f42d80c7c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:38.322 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:38.320+0000 7f42deff3640 1 --2- 172.21.15.92:0/3856557847 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f42d80b2dc0 0x7f42d81f51a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:38.322 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:38.320+0000 7f42deff3640 1 -- 172.21.15.92:0/3856557847 >> 172.21.15.92:0/3856557847 conn(0x7f42d80d1d70 msgr2=0x7f42d80716e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:14:38.323 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:38.320+0000 7f42deff3640 1 -- 172.21.15.92:0/3856557847 shutdown_connections 2024-09-11T00:14:38.323 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:38.320+0000 7f42deff3640 1 -- 172.21.15.92:0/3856557847 wait complete. 2024-09-11T00:14:38.332 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-11T00:14:38.333 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T00:14:38.433 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:38.431+0000 7feba78ed640 1 -- 172.21.15.92:0/3349957561 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7feba006fe40 msgr2=0x7feba00702a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:38.433 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:38.431+0000 7feba78ed640 1 --2- 172.21.15.92:0/3349957561 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7feba006fe40 0x7feba00702a0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7feba0071550 tx=0x7feb9802a4d0 comp rx=0 tx=0).stop 2024-09-11T00:14:38.433 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:38.431+0000 7feba78ed640 1 -- 172.21.15.92:0/3349957561 shutdown_connections 2024-09-11T00:14:38.433 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:38.431+0000 7feba78ed640 1 --2- 172.21.15.92:0/3349957561 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7feba006fe40 0x7feba00702a0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:38.433 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:38.431+0000 7feba78ed640 1 --2- 172.21.15.92:0/3349957561 >> v2:172.21.15.145:3300/0 conn(0x7feba00cfef0 0x7feba00d0380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:38.434 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:38.431+0000 7feba78ed640 1 -- 172.21.15.92:0/3349957561 >> 172.21.15.92:0/3349957561 conn(0x7feba00b1c80 msgr2=0x7feba00b2060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:14:38.434 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:38.431+0000 7feba78ed640 1 -- 172.21.15.92:0/3349957561 shutdown_connections 2024-09-11T00:14:38.434 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:38.431+0000 7feba78ed640 1 -- 172.21.15.92:0/3349957561 wait complete. 2024-09-11T00:14:38.436 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:38.432+0000 7feba78ed640 1 Processor -- start 2024-09-11T00:14:38.436 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:38.432+0000 7feba78ed640 1 -- start start 2024-09-11T00:14:38.436 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:38.433+0000 7feba78ed640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7feba006fe40 0x7feba00ce7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:38.436 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:38.433+0000 7feba78ed640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7feba00b2f80 0x7feba015f610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:38.436 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:38.433+0000 7feba78ed640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7feba00cfef0 0x7feba01f7d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:38.436 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:38.433+0000 7feba78ed640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7feba01414d0 con 0x7feba00cfef0 2024-09-11T00:14:38.436 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:38.433+0000 7feba78ed640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7feba0141350 con 0x7feba006fe40 2024-09-11T00:14:38.436 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:38.433+0000 7feba78ed640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7feba00707e0 con 0x7feba00b2f80 2024-09-11T00:14:38.437 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:38.433+0000 7feba5e8a640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7feba00cfef0 0x7feba01f7d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:38.437 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:38.433+0000 7feba5e8a640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7feba00cfef0 0x7feba01f7d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:50242/0 (socket says 172.21.15.92:50242) 2024-09-11T00:14:38.437 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:38.433+0000 7feba5e8a640 1 -- 172.21.15.92:0/3667648748 learned_addr learned my addr 172.21.15.92:0/3667648748 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-11T00:14:38.437 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:38.433+0000 7feba5689640 1 --2- 172.21.15.92:0/3667648748 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7feba006fe40 0x7feba00ce7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:38.437 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:38.433+0000 7feba4e88640 1 --2- 172.21.15.92:0/3667648748 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7feba00b2f80 0x7feba015f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:38.437 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:38.433+0000 7feba5e8a640 1 -- 172.21.15.92:0/3667648748 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7feba00b2f80 msgr2=0x7feba015f610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:38.437 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:38.433+0000 7feba5e8a640 1 --2- 172.21.15.92:0/3667648748 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7feba00b2f80 0x7feba015f610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:38.437 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:38.433+0000 7feba5e8a640 1 -- 172.21.15.92:0/3667648748 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7feba006fe40 msgr2=0x7feba00ce7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:38.437 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:38.433+0000 7feba5e8a640 1 --2- 172.21.15.92:0/3667648748 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7feba006fe40 0x7feba00ce7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:38.437 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:38.433+0000 7feba5e8a640 1 -- 172.21.15.92:0/3667648748 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feba015fff0 con 0x7feba00cfef0 2024-09-11T00:14:38.437 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:38.434+0000 7feba5e8a640 1 --2- 172.21.15.92:0/3667648748 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7feba00cfef0 0x7feba01f7d40 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7feb980099c0 tx=0x7feb98003960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:14:38.438 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:38.434+0000 7feb9dffb640 1 -- 172.21.15.92:0/3667648748 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb9803f070 con 0x7feba00cfef0 2024-09-11T00:14:38.438 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:38.434+0000 7feb9dffb640 1 -- 172.21.15.92:0/3667648748 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7feb980047a0 con 0x7feba00cfef0 2024-09-11T00:14:38.438 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:38.434+0000 7feba78ed640 1 -- 172.21.15.92:0/3667648748 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feba01602d0 con 0x7feba00cfef0 2024-09-11T00:14:38.438 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:38.434+0000 7feb9dffb640 1 -- 172.21.15.92:0/3667648748 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb98035030 con 0x7feba00cfef0 2024-09-11T00:14:38.438 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:38.434+0000 7feba78ed640 1 -- 172.21.15.92:0/3667648748 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feba0160890 con 0x7feba00cfef0 2024-09-11T00:14:38.439 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:38.435+0000 7feba78ed640 1 -- 172.21.15.92:0/3667648748 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feba01315b0 con 0x7feba00cfef0 2024-09-11T00:14:38.439 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:38.436+0000 7feb9dffb640 1 -- 172.21.15.92:0/3667648748 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7feb98004bf0 con 0x7feba00cfef0 2024-09-11T00:14:38.439 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:38.436+0000 7feb9dffb640 1 --2- 172.21.15.92:0/3667648748 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7feb8c077f70 0x7feb8c07a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:38.439 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:38.436+0000 7feb9dffb640 1 -- 172.21.15.92:0/3667648748 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7feb980bb100 con 0x7feba00cfef0 2024-09-11T00:14:38.439 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:38.436+0000 7feba5689640 1 --2- 172.21.15.92:0/3667648748 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7feb8c077f70 0x7feb8c07a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:38.439 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:38.437+0000 7feba5689640 1 --2- 172.21.15.92:0/3667648748 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7feb8c077f70 0x7feb8c07a430 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7feba0133580 tx=0x7feb90003d90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:14:38.441 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:38.440+0000 7feb9dffb640 1 -- 172.21.15.92:0/3667648748 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7feb98083270 con 0x7feba00cfef0 2024-09-11T00:14:38.612 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:38.610+0000 7feba78ed640 1 -- 172.21.15.92:0/3667648748 --> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7feba0070c30 con 0x7feb8c077f70 2024-09-11T00:14:38.618 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:38.616+0000 7feb9dffb640 1 -- 172.21.15.92:0/3667648748 <== mgr.4100 v2:172.21.15.145:6800/325490785 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332523 (secure 0 0 0) 0x7feba0070c30 con 0x7feb8c077f70 2024-09-11T00:14:38.621 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:14:38.623 INFO:teuthology.orchestra.run.smithi092.stderr:dumped all 2024-09-11T00:14:38.625 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:38.620+0000 7feba78ed640 1 -- 172.21.15.92:0/3667648748 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7feb8c077f70 msgr2=0x7feb8c07a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:38.625 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:38.620+0000 7feba78ed640 1 --2- 172.21.15.92:0/3667648748 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7feb8c077f70 0x7feb8c07a430 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7feba0133580 tx=0x7feb90003d90 comp rx=0 tx=0).stop 2024-09-11T00:14:38.625 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:38.620+0000 7feba78ed640 1 -- 172.21.15.92:0/3667648748 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7feba00cfef0 msgr2=0x7feba01f7d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:38.626 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:38.620+0000 7feba78ed640 1 --2- 172.21.15.92:0/3667648748 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7feba00cfef0 0x7feba01f7d40 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7feb980099c0 tx=0x7feb98003960 comp rx=0 tx=0).stop 2024-09-11T00:14:38.626 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:38.620+0000 7feba78ed640 1 -- 172.21.15.92:0/3667648748 shutdown_connections 2024-09-11T00:14:38.626 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:38.620+0000 7feba78ed640 1 --2- 172.21.15.92:0/3667648748 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7feb8c077f70 0x7feb8c07a430 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:38.626 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:38.620+0000 7feba78ed640 1 --2- 172.21.15.92:0/3667648748 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7feba00cfef0 0x7feba01f7d40 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:38.626 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:38.620+0000 7feba78ed640 1 --2- 172.21.15.92:0/3667648748 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7feba00b2f80 0x7feba015f610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:38.626 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:38.620+0000 7feba78ed640 1 --2- 172.21.15.92:0/3667648748 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7feba006fe40 0x7feba00ce7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:38.626 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:38.620+0000 7feba78ed640 1 -- 172.21.15.92:0/3667648748 >> 172.21.15.92:0/3667648748 conn(0x7feba00b1c80 msgr2=0x7feba0074080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:14:38.626 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:38.620+0000 7feba78ed640 1 -- 172.21.15.92:0/3667648748 shutdown_connections 2024-09-11T00:14:38.626 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:38.620+0000 7feba78ed640 1 -- 172.21.15.92:0/3667648748 wait complete. 2024-09-11T00:14:38.632 INFO:teuthology.orchestra.run.smithi092.stdout:{"pg_ready":true,"pg_map":{"version":35,"stamp":"2024-09-11T00:14:38.278208+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":149,"num_write_kb":1646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":114,"ondisk_log_size":114,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219464,"kb_used_data":3240,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755256,"statfs":{"total":773094113280,"available":772869382144,"internally_reserved":0,"allocated":3317760,"data_stored":2011304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2230,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003730"},"pg_stats":[{"pgid":"2.1f","version":"20'4","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:24.883591+0000","last_change":"2024-09-11T00:14:17.626124+0000","last_active":"2024-09-11T00:14:24.883591+0000","last_peered":"2024-09-11T00:14:24.883591+0000","last_clean":"2024-09-11T00:14:24.883591+0000","last_became_active":"2024-09-11T00:14:17.625641+0000","last_became_peered":"2024-09-11T00:14:17.625641+0000","last_unstale":"2024-09-11T00:14:24.883591+0000","last_undegraded":"2024-09-11T00:14:24.883591+0000","last_fullsized":"2024-09-11T00:14:24.883591+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:16.598908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:16.598908+0000","last_clean_scrub_stamp":"2024-09-11T00:14:16.598908+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:34:04.062752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:23.649065+0000","last_change":"2024-09-11T00:14:18.635793+0000","last_active":"2024-09-11T00:14:23.649065+0000","last_peered":"2024-09-11T00:14:23.649065+0000","last_clean":"2024-09-11T00:14:23.649065+0000","last_became_active":"2024-09-11T00:14:18.635544+0000","last_became_peered":"2024-09-11T00:14:18.635544+0000","last_unstale":"2024-09-11T00:14:23.649065+0000","last_undegraded":"2024-09-11T00:14:23.649065+0000","last_fullsized":"2024-09-11T00:14:23.649065+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_clean_scrub_stamp":"2024-09-11T00:14:17.606538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:24:44.702294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:23.648231+0000","last_change":"2024-09-11T00:14:22.691295+0000","last_active":"2024-09-11T00:14:23.648231+0000","last_peered":"2024-09-11T00:14:23.648231+0000","last_clean":"2024-09-11T00:14:23.648231+0000","last_became_active":"2024-09-11T00:14:22.690445+0000","last_became_peered":"2024-09-11T00:14:22.690445+0000","last_unstale":"2024-09-11T00:14:23.648231+0000","last_undegraded":"2024-09-11T00:14:23.648231+0000","last_fullsized":"2024-09-11T00:14:23.648231+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:21.633629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:21.633629+0000","last_clean_scrub_stamp":"2024-09-11T00:14:21.633629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:15:47.491554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:23.649169+0000","last_change":"2024-09-11T00:14:17.627802+0000","last_active":"2024-09-11T00:14:23.649169+0000","last_peered":"2024-09-11T00:14:23.649169+0000","last_clean":"2024-09-11T00:14:23.649169+0000","last_became_active":"2024-09-11T00:14:17.627530+0000","last_became_peered":"2024-09-11T00:14:17.627530+0000","last_unstale":"2024-09-11T00:14:23.649169+0000","last_undegraded":"2024-09-11T00:14:23.649169+0000","last_fullsized":"2024-09-11T00:14:23.649169+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:16.598908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:16.598908+0000","last_clean_scrub_stamp":"2024-09-11T00:14:16.598908+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:34:04.062752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:24.883447+0000","last_change":"2024-09-11T00:14:18.632474+0000","last_active":"2024-09-11T00:14:24.883447+0000","last_peered":"2024-09-11T00:14:24.883447+0000","last_clean":"2024-09-11T00:14:24.883447+0000","last_became_active":"2024-09-11T00:14:18.631284+0000","last_became_peered":"2024-09-11T00:14:18.631284+0000","last_unstale":"2024-09-11T00:14:24.883447+0000","last_undegraded":"2024-09-11T00:14:24.883447+0000","last_fullsized":"2024-09-11T00:14:24.883447+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_clean_scrub_stamp":"2024-09-11T00:14:17.606538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:25:01.082594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:23.650003+0000","last_change":"2024-09-11T00:14:22.677620+0000","last_active":"2024-09-11T00:14:23.650003+0000","last_peered":"2024-09-11T00:14:23.650003+0000","last_clean":"2024-09-11T00:14:23.650003+0000","last_became_active":"2024-09-11T00:14:22.677257+0000","last_became_peered":"2024-09-11T00:14:22.677257+0000","last_unstale":"2024-09-11T00:14:23.650003+0000","last_undegraded":"2024-09-11T00:14:23.650003+0000","last_fullsized":"2024-09-11T00:14:23.650003+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:21.633629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:21.633629+0000","last_clean_scrub_stamp":"2024-09-11T00:14:21.633629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:21:42.822631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:25.443495+0000","last_change":"2024-09-11T00:14:17.636163+0000","last_active":"2024-09-11T00:14:25.443495+0000","last_peered":"2024-09-11T00:14:25.443495+0000","last_clean":"2024-09-11T00:14:25.443495+0000","last_became_active":"2024-09-11T00:14:17.635781+0000","last_became_peered":"2024-09-11T00:14:17.635781+0000","last_unstale":"2024-09-11T00:14:25.443495+0000","last_undegraded":"2024-09-11T00:14:25.443495+0000","last_fullsized":"2024-09-11T00:14:25.443495+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:16.598908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:16.598908+0000","last_clean_scrub_stamp":"2024-09-11T00:14:16.598908+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:17:54.010379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:23.650820+0000","last_change":"2024-09-11T00:14:18.632344+0000","last_active":"2024-09-11T00:14:23.650820+0000","last_peered":"2024-09-11T00:14:23.650820+0000","last_clean":"2024-09-11T00:14:23.650820+0000","last_became_active":"2024-09-11T00:14:18.632058+0000","last_became_peered":"2024-09-11T00:14:18.632058+0000","last_unstale":"2024-09-11T00:14:23.650820+0000","last_undegraded":"2024-09-11T00:14:23.650820+0000","last_fullsized":"2024-09-11T00:14:23.650820+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_clean_scrub_stamp":"2024-09-11T00:14:17.606538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:41:28.876392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:23.650371+0000","last_change":"2024-09-11T00:14:22.675694+0000","last_active":"2024-09-11T00:14:23.650371+0000","last_peered":"2024-09-11T00:14:23.650371+0000","last_clean":"2024-09-11T00:14:23.650371+0000","last_became_active":"2024-09-11T00:14:22.675123+0000","last_became_peered":"2024-09-11T00:14:22.675123+0000","last_unstale":"2024-09-11T00:14:23.650371+0000","last_undegraded":"2024-09-11T00:14:23.650371+0000","last_fullsized":"2024-09-11T00:14:23.650371+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:21.633629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:21.633629+0000","last_clean_scrub_stamp":"2024-09-11T00:14:21.633629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:55:42.669376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:25.443208+0000","last_change":"2024-09-11T00:14:17.634109+0000","last_active":"2024-09-11T00:14:25.443208+0000","last_peered":"2024-09-11T00:14:25.443208+0000","last_clean":"2024-09-11T00:14:25.443208+0000","last_became_active":"2024-09-11T00:14:17.633815+0000","last_became_peered":"2024-09-11T00:14:17.633815+0000","last_unstale":"2024-09-11T00:14:25.443208+0000","last_undegraded":"2024-09-11T00:14:25.443208+0000","last_fullsized":"2024-09-11T00:14:25.443208+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:16.598908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:16.598908+0000","last_clean_scrub_stamp":"2024-09-11T00:14:16.598908+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:43:47.266406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:23.651249+0000","last_change":"2024-09-11T00:14:18.633804+0000","last_active":"2024-09-11T00:14:23.651249+0000","last_peered":"2024-09-11T00:14:23.651249+0000","last_clean":"2024-09-11T00:14:23.651249+0000","last_became_active":"2024-09-11T00:14:18.633530+0000","last_became_peered":"2024-09-11T00:14:18.633530+0000","last_unstale":"2024-09-11T00:14:23.651249+0000","last_undegraded":"2024-09-11T00:14:23.651249+0000","last_fullsized":"2024-09-11T00:14:23.651249+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_clean_scrub_stamp":"2024-09-11T00:14:17.606538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:28:10.132283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:23.650244+0000","last_change":"2024-09-11T00:14:22.674158+0000","last_active":"2024-09-11T00:14:23.650244+0000","last_peered":"2024-09-11T00:14:23.650244+0000","last_clean":"2024-09-11T00:14:23.650244+0000","last_became_active":"2024-09-11T00:14:22.673563+0000","last_became_peered":"2024-09-11T00:14:22.673563+0000","last_unstale":"2024-09-11T00:14:23.650244+0000","last_undegraded":"2024-09-11T00:14:23.650244+0000","last_fullsized":"2024-09-11T00:14:23.650244+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:21.633629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:21.633629+0000","last_clean_scrub_stamp":"2024-09-11T00:14:21.633629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:34:20.263638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:24.934581+0000","last_change":"2024-09-11T00:14:18.641584+0000","last_active":"2024-09-11T00:14:24.934581+0000","last_peered":"2024-09-11T00:14:24.934581+0000","last_clean":"2024-09-11T00:14:24.934581+0000","last_became_active":"2024-09-11T00:14:18.641317+0000","last_became_peered":"2024-09-11T00:14:18.641317+0000","last_unstale":"2024-09-11T00:14:24.934581+0000","last_undegraded":"2024-09-11T00:14:24.934581+0000","last_fullsized":"2024-09-11T00:14:24.934581+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_clean_scrub_stamp":"2024-09-11T00:14:17.606538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:44:05.910673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:25.443377+0000","last_change":"2024-09-11T00:14:17.636350+0000","last_active":"2024-09-11T00:14:25.443377+0000","last_peered":"2024-09-11T00:14:25.443377+0000","last_clean":"2024-09-11T00:14:25.443377+0000","last_became_active":"2024-09-11T00:14:17.636071+0000","last_became_peered":"2024-09-11T00:14:17.636071+0000","last_unstale":"2024-09-11T00:14:25.443377+0000","last_undegraded":"2024-09-11T00:14:25.443377+0000","last_fullsized":"2024-09-11T00:14:25.443377+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:16.598908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:16.598908+0000","last_clean_scrub_stamp":"2024-09-11T00:14:16.598908+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:01:31.822965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:23.651799+0000","last_change":"2024-09-11T00:14:22.669178+0000","last_active":"2024-09-11T00:14:23.651799+0000","last_peered":"2024-09-11T00:14:23.651799+0000","last_clean":"2024-09-11T00:14:23.651799+0000","last_became_active":"2024-09-11T00:14:22.668916+0000","last_became_peered":"2024-09-11T00:14:22.668916+0000","last_unstale":"2024-09-11T00:14:23.651799+0000","last_undegraded":"2024-09-11T00:14:23.651799+0000","last_fullsized":"2024-09-11T00:14:23.651799+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:21.633629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:21.633629+0000","last_clean_scrub_stamp":"2024-09-11T00:14:21.633629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:52:50.029560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:23.648642+0000","last_change":"2024-09-11T00:14:18.632035+0000","last_active":"2024-09-11T00:14:23.648642+0000","last_peered":"2024-09-11T00:14:23.648642+0000","last_clean":"2024-09-11T00:14:23.648642+0000","last_became_active":"2024-09-11T00:14:18.631678+0000","last_became_peered":"2024-09-11T00:14:18.631678+0000","last_unstale":"2024-09-11T00:14:23.648642+0000","last_undegraded":"2024-09-11T00:14:23.648642+0000","last_fullsized":"2024-09-11T00:14:23.648642+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_clean_scrub_stamp":"2024-09-11T00:14:17.606538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:19:35.541198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:25.448740+0000","last_change":"2024-09-11T00:14:17.632840+0000","last_active":"2024-09-11T00:14:25.448740+0000","last_peered":"2024-09-11T00:14:25.448740+0000","last_clean":"2024-09-11T00:14:25.448740+0000","last_became_active":"2024-09-11T00:14:17.632551+0000","last_became_peered":"2024-09-11T00:14:17.632551+0000","last_unstale":"2024-09-11T00:14:25.448740+0000","last_undegraded":"2024-09-11T00:14:25.448740+0000","last_fullsized":"2024-09-11T00:14:25.448740+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:16.598908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:16.598908+0000","last_clean_scrub_stamp":"2024-09-11T00:14:16.598908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:11:19.690215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:23.651772+0000","last_change":"2024-09-11T00:14:22.675212+0000","last_active":"2024-09-11T00:14:23.651772+0000","last_peered":"2024-09-11T00:14:23.651772+0000","last_clean":"2024-09-11T00:14:23.651772+0000","last_became_active":"2024-09-11T00:14:22.674046+0000","last_became_peered":"2024-09-11T00:14:22.674046+0000","last_unstale":"2024-09-11T00:14:23.651772+0000","last_undegraded":"2024-09-11T00:14:23.651772+0000","last_fullsized":"2024-09-11T00:14:23.651772+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:21.633629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:21.633629+0000","last_clean_scrub_stamp":"2024-09-11T00:14:21.633629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:58:10.766640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:23.648499+0000","last_change":"2024-09-11T00:14:18.625163+0000","last_active":"2024-09-11T00:14:23.648499+0000","last_peered":"2024-09-11T00:14:23.648499+0000","last_clean":"2024-09-11T00:14:23.648499+0000","last_became_active":"2024-09-11T00:14:18.624834+0000","last_became_peered":"2024-09-11T00:14:18.624834+0000","last_unstale":"2024-09-11T00:14:23.648499+0000","last_undegraded":"2024-09-11T00:14:23.648499+0000","last_fullsized":"2024-09-11T00:14:23.648499+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_clean_scrub_stamp":"2024-09-11T00:14:17.606538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:27:39.530704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:25.448769+0000","last_change":"2024-09-11T00:14:17.627946+0000","last_active":"2024-09-11T00:14:25.448769+0000","last_peered":"2024-09-11T00:14:25.448769+0000","last_clean":"2024-09-11T00:14:25.448769+0000","last_became_active":"2024-09-11T00:14:17.627667+0000","last_became_peered":"2024-09-11T00:14:17.627667+0000","last_unstale":"2024-09-11T00:14:25.448769+0000","last_undegraded":"2024-09-11T00:14:25.448769+0000","last_fullsized":"2024-09-11T00:14:25.448769+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:16.598908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:16.598908+0000","last_clean_scrub_stamp":"2024-09-11T00:14:16.598908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:01:31.822965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:25.448522+0000","last_change":"2024-09-11T00:14:22.692404+0000","last_active":"2024-09-11T00:14:25.448522+0000","last_peered":"2024-09-11T00:14:25.448522+0000","last_clean":"2024-09-11T00:14:25.448522+0000","last_became_active":"2024-09-11T00:14:22.691884+0000","last_became_peered":"2024-09-11T00:14:22.691884+0000","last_unstale":"2024-09-11T00:14:25.448522+0000","last_undegraded":"2024-09-11T00:14:25.448522+0000","last_fullsized":"2024-09-11T00:14:25.448522+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:21.633629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:21.633629+0000","last_clean_scrub_stamp":"2024-09-11T00:14:21.633629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:38:50.912075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:23.650767+0000","last_change":"2024-09-11T00:14:18.623840+0000","last_active":"2024-09-11T00:14:23.650767+0000","last_peered":"2024-09-11T00:14:23.650767+0000","last_clean":"2024-09-11T00:14:23.650767+0000","last_became_active":"2024-09-11T00:14:18.623528+0000","last_became_peered":"2024-09-11T00:14:18.623528+0000","last_unstale":"2024-09-11T00:14:23.650767+0000","last_undegraded":"2024-09-11T00:14:23.650767+0000","last_fullsized":"2024-09-11T00:14:23.650767+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_clean_scrub_stamp":"2024-09-11T00:14:17.606538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:22:17.854518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:25.442955+0000","last_change":"2024-09-11T00:14:17.633107+0000","last_active":"2024-09-11T00:14:25.442955+0000","last_peered":"2024-09-11T00:14:25.442955+0000","last_clean":"2024-09-11T00:14:25.442955+0000","last_became_active":"2024-09-11T00:14:17.632860+0000","last_became_peered":"2024-09-11T00:14:17.632860+0000","last_unstale":"2024-09-11T00:14:25.442955+0000","last_undegraded":"2024-09-11T00:14:25.442955+0000","last_fullsized":"2024-09-11T00:14:25.442955+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:16.598908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:16.598908+0000","last_clean_scrub_stamp":"2024-09-11T00:14:16.598908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:24:18.954419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:23.651684+0000","last_change":"2024-09-11T00:14:22.673902+0000","last_active":"2024-09-11T00:14:23.651684+0000","last_peered":"2024-09-11T00:14:23.651684+0000","last_clean":"2024-09-11T00:14:23.651684+0000","last_became_active":"2024-09-11T00:14:22.673397+0000","last_became_peered":"2024-09-11T00:14:22.673397+0000","last_unstale":"2024-09-11T00:14:23.651684+0000","last_undegraded":"2024-09-11T00:14:23.651684+0000","last_fullsized":"2024-09-11T00:14:23.651684+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:21.633629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:21.633629+0000","last_clean_scrub_stamp":"2024-09-11T00:14:21.633629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:24:27.330659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:24.883685+0000","last_change":"2024-09-11T00:14:18.632296+0000","last_active":"2024-09-11T00:14:24.883685+0000","last_peered":"2024-09-11T00:14:24.883685+0000","last_clean":"2024-09-11T00:14:24.883685+0000","last_became_active":"2024-09-11T00:14:18.632026+0000","last_became_peered":"2024-09-11T00:14:18.632026+0000","last_unstale":"2024-09-11T00:14:24.883685+0000","last_undegraded":"2024-09-11T00:14:24.883685+0000","last_fullsized":"2024-09-11T00:14:24.883685+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_clean_scrub_stamp":"2024-09-11T00:14:17.606538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:03:25.203629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:24.935388+0000","last_change":"2024-09-11T00:14:17.636547+0000","last_active":"2024-09-11T00:14:24.935388+0000","last_peered":"2024-09-11T00:14:24.935388+0000","last_clean":"2024-09-11T00:14:24.935388+0000","last_became_active":"2024-09-11T00:14:17.636264+0000","last_became_peered":"2024-09-11T00:14:17.636264+0000","last_unstale":"2024-09-11T00:14:24.935388+0000","last_undegraded":"2024-09-11T00:14:24.935388+0000","last_fullsized":"2024-09-11T00:14:24.935388+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:16.598908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:16.598908+0000","last_clean_scrub_stamp":"2024-09-11T00:14:16.598908+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:52:38.739834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:23.650267+0000","last_change":"2024-09-11T00:14:22.688870+0000","last_active":"2024-09-11T00:14:23.650267+0000","last_peered":"2024-09-11T00:14:23.650267+0000","last_clean":"2024-09-11T00:14:23.650267+0000","last_became_active":"2024-09-11T00:14:22.688144+0000","last_became_peered":"2024-09-11T00:14:22.688144+0000","last_unstale":"2024-09-11T00:14:23.650267+0000","last_undegraded":"2024-09-11T00:14:23.650267+0000","last_fullsized":"2024-09-11T00:14:23.650267+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:21.633629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:21.633629+0000","last_clean_scrub_stamp":"2024-09-11T00:14:21.633629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:47:00.821912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:23.649305+0000","last_change":"2024-09-11T00:14:18.644563+0000","last_active":"2024-09-11T00:14:23.649305+0000","last_peered":"2024-09-11T00:14:23.649305+0000","last_clean":"2024-09-11T00:14:23.649305+0000","last_became_active":"2024-09-11T00:14:18.644258+0000","last_became_peered":"2024-09-11T00:14:18.644258+0000","last_unstale":"2024-09-11T00:14:23.649305+0000","last_undegraded":"2024-09-11T00:14:23.649305+0000","last_fullsized":"2024-09-11T00:14:23.649305+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_clean_scrub_stamp":"2024-09-11T00:14:17.606538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:28:22.113765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:25.448636+0000","last_change":"2024-09-11T00:14:17.633279+0000","last_active":"2024-09-11T00:14:25.448636+0000","last_peered":"2024-09-11T00:14:25.448636+0000","last_clean":"2024-09-11T00:14:25.448636+0000","last_became_active":"2024-09-11T00:14:17.633023+0000","last_became_peered":"2024-09-11T00:14:17.633023+0000","last_unstale":"2024-09-11T00:14:25.448636+0000","last_undegraded":"2024-09-11T00:14:25.448636+0000","last_fullsized":"2024-09-11T00:14:25.448636+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:16.598908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:16.598908+0000","last_clean_scrub_stamp":"2024-09-11T00:14:16.598908+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:24:18.954419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:23.648131+0000","last_change":"2024-09-11T00:14:22.689579+0000","last_active":"2024-09-11T00:14:23.648131+0000","last_peered":"2024-09-11T00:14:23.648131+0000","last_clean":"2024-09-11T00:14:23.648131+0000","last_became_active":"2024-09-11T00:14:22.688060+0000","last_became_peered":"2024-09-11T00:14:22.688060+0000","last_unstale":"2024-09-11T00:14:23.648131+0000","last_undegraded":"2024-09-11T00:14:23.648131+0000","last_fullsized":"2024-09-11T00:14:23.648131+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:21.633629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:21.633629+0000","last_clean_scrub_stamp":"2024-09-11T00:14:21.633629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:02:04.039334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:25.448843+0000","last_change":"2024-09-11T00:14:18.622047+0000","last_active":"2024-09-11T00:14:25.448843+0000","last_peered":"2024-09-11T00:14:25.448843+0000","last_clean":"2024-09-11T00:14:25.448843+0000","last_became_active":"2024-09-11T00:14:18.621777+0000","last_became_peered":"2024-09-11T00:14:18.621777+0000","last_unstale":"2024-09-11T00:14:25.448843+0000","last_undegraded":"2024-09-11T00:14:25.448843+0000","last_fullsized":"2024-09-11T00:14:25.448843+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_clean_scrub_stamp":"2024-09-11T00:14:17.606538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:05:45.558170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:25.443646+0000","last_change":"2024-09-11T00:14:17.631489+0000","last_active":"2024-09-11T00:14:25.443646+0000","last_peered":"2024-09-11T00:14:25.443646+0000","last_clean":"2024-09-11T00:14:25.443646+0000","last_became_active":"2024-09-11T00:14:17.631206+0000","last_became_peered":"2024-09-11T00:14:17.631206+0000","last_unstale":"2024-09-11T00:14:25.443646+0000","last_undegraded":"2024-09-11T00:14:25.443646+0000","last_fullsized":"2024-09-11T00:14:25.443646+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:16.598908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:16.598908+0000","last_clean_scrub_stamp":"2024-09-11T00:14:16.598908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:51:33.532444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:24.883278+0000","last_change":"2024-09-11T00:14:22.689420+0000","last_active":"2024-09-11T00:14:24.883278+0000","last_peered":"2024-09-11T00:14:24.883278+0000","last_clean":"2024-09-11T00:14:24.883278+0000","last_became_active":"2024-09-11T00:14:22.689043+0000","last_became_peered":"2024-09-11T00:14:22.689043+0000","last_unstale":"2024-09-11T00:14:24.883278+0000","last_undegraded":"2024-09-11T00:14:24.883278+0000","last_fullsized":"2024-09-11T00:14:24.883278+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:21.633629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:21.633629+0000","last_clean_scrub_stamp":"2024-09-11T00:14:21.633629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:25:22.425586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:23.651349+0000","last_change":"2024-09-11T00:14:18.628564+0000","last_active":"2024-09-11T00:14:23.651349+0000","last_peered":"2024-09-11T00:14:23.651349+0000","last_clean":"2024-09-11T00:14:23.651349+0000","last_became_active":"2024-09-11T00:14:18.628095+0000","last_became_peered":"2024-09-11T00:14:18.628095+0000","last_unstale":"2024-09-11T00:14:23.651349+0000","last_undegraded":"2024-09-11T00:14:23.651349+0000","last_fullsized":"2024-09-11T00:14:23.651349+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_clean_scrub_stamp":"2024-09-11T00:14:17.606538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:51:25.519292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:25.448944+0000","last_change":"2024-09-11T00:14:17.629702+0000","last_active":"2024-09-11T00:14:25.448944+0000","last_peered":"2024-09-11T00:14:25.448944+0000","last_clean":"2024-09-11T00:14:25.448944+0000","last_became_active":"2024-09-11T00:14:17.629450+0000","last_became_peered":"2024-09-11T00:14:17.629450+0000","last_unstale":"2024-09-11T00:14:25.448944+0000","last_undegraded":"2024-09-11T00:14:25.448944+0000","last_fullsized":"2024-09-11T00:14:25.448944+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:16.598908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:16.598908+0000","last_clean_scrub_stamp":"2024-09-11T00:14:16.598908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:52:22.626375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:25.448461+0000","last_change":"2024-09-11T00:14:22.665536+0000","last_active":"2024-09-11T00:14:25.448461+0000","last_peered":"2024-09-11T00:14:25.448461+0000","last_clean":"2024-09-11T00:14:25.448461+0000","last_became_active":"2024-09-11T00:14:22.663100+0000","last_became_peered":"2024-09-11T00:14:22.663100+0000","last_unstale":"2024-09-11T00:14:25.448461+0000","last_undegraded":"2024-09-11T00:14:25.448461+0000","last_fullsized":"2024-09-11T00:14:25.448461+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:21.633629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:21.633629+0000","last_clean_scrub_stamp":"2024-09-11T00:14:21.633629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:28:14.159374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:23.650922+0000","last_change":"2024-09-11T00:14:18.642032+0000","last_active":"2024-09-11T00:14:23.650922+0000","last_peered":"2024-09-11T00:14:23.650922+0000","last_clean":"2024-09-11T00:14:23.650922+0000","last_became_active":"2024-09-11T00:14:18.641783+0000","last_became_peered":"2024-09-11T00:14:18.641783+0000","last_unstale":"2024-09-11T00:14:23.650922+0000","last_undegraded":"2024-09-11T00:14:23.650922+0000","last_fullsized":"2024-09-11T00:14:23.650922+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_clean_scrub_stamp":"2024-09-11T00:14:17.606538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:06:55.661773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:23.652407+0000","last_change":"2024-09-11T00:14:17.630077+0000","last_active":"2024-09-11T00:14:23.652407+0000","last_peered":"2024-09-11T00:14:23.652407+0000","last_clean":"2024-09-11T00:14:23.652407+0000","last_became_active":"2024-09-11T00:14:17.629668+0000","last_became_peered":"2024-09-11T00:14:17.629668+0000","last_unstale":"2024-09-11T00:14:23.652407+0000","last_undegraded":"2024-09-11T00:14:23.652407+0000","last_fullsized":"2024-09-11T00:14:23.652407+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:16.598908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:16.598908+0000","last_clean_scrub_stamp":"2024-09-11T00:14:16.598908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:43:47.266406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:25.448669+0000","last_change":"2024-09-11T00:14:22.674145+0000","last_active":"2024-09-11T00:14:25.448669+0000","last_peered":"2024-09-11T00:14:25.448669+0000","last_clean":"2024-09-11T00:14:25.448669+0000","last_became_active":"2024-09-11T00:14:22.673757+0000","last_became_peered":"2024-09-11T00:14:22.673757+0000","last_unstale":"2024-09-11T00:14:25.448669+0000","last_undegraded":"2024-09-11T00:14:25.448669+0000","last_fullsized":"2024-09-11T00:14:25.448669+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:21.633629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:21.633629+0000","last_clean_scrub_stamp":"2024-09-11T00:14:21.633629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:52:37.859110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:25.448150+0000","last_change":"2024-09-11T00:14:18.621350+0000","last_active":"2024-09-11T00:14:25.448150+0000","last_peered":"2024-09-11T00:14:25.448150+0000","last_clean":"2024-09-11T00:14:25.448150+0000","last_became_active":"2024-09-11T00:14:18.621079+0000","last_became_peered":"2024-09-11T00:14:18.621079+0000","last_unstale":"2024-09-11T00:14:25.448150+0000","last_undegraded":"2024-09-11T00:14:25.448150+0000","last_fullsized":"2024-09-11T00:14:25.448150+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_clean_scrub_stamp":"2024-09-11T00:14:17.606538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:46:52.007701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:25.448126+0000","last_change":"2024-09-11T00:14:17.623009+0000","last_active":"2024-09-11T00:14:25.448126+0000","last_peered":"2024-09-11T00:14:25.448126+0000","last_clean":"2024-09-11T00:14:25.448126+0000","last_became_active":"2024-09-11T00:14:17.622719+0000","last_became_peered":"2024-09-11T00:14:17.622719+0000","last_unstale":"2024-09-11T00:14:25.448126+0000","last_undegraded":"2024-09-11T00:14:25.448126+0000","last_fullsized":"2024-09-11T00:14:25.448126+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:16.598908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:16.598908+0000","last_clean_scrub_stamp":"2024-09-11T00:14:16.598908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:22:22.640376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:25.448720+0000","last_change":"2024-09-11T00:14:22.668160+0000","last_active":"2024-09-11T00:14:25.448720+0000","last_peered":"2024-09-11T00:14:25.448720+0000","last_clean":"2024-09-11T00:14:25.448720+0000","last_became_active":"2024-09-11T00:14:22.667750+0000","last_became_peered":"2024-09-11T00:14:22.667750+0000","last_unstale":"2024-09-11T00:14:25.448720+0000","last_undegraded":"2024-09-11T00:14:25.448720+0000","last_fullsized":"2024-09-11T00:14:25.448720+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:21.633629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:21.633629+0000","last_clean_scrub_stamp":"2024-09-11T00:14:21.633629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:51:29.546383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:24.883081+0000","last_change":"2024-09-11T00:14:18.642039+0000","last_active":"2024-09-11T00:14:24.883081+0000","last_peered":"2024-09-11T00:14:24.883081+0000","last_clean":"2024-09-11T00:14:24.883081+0000","last_became_active":"2024-09-11T00:14:18.641748+0000","last_became_peered":"2024-09-11T00:14:18.641748+0000","last_unstale":"2024-09-11T00:14:24.883081+0000","last_undegraded":"2024-09-11T00:14:24.883081+0000","last_fullsized":"2024-09-11T00:14:24.883081+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_clean_scrub_stamp":"2024-09-11T00:14:17.606538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:47:41.811458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:25.442962+0000","last_change":"2024-09-11T00:14:17.631555+0000","last_active":"2024-09-11T00:14:25.442962+0000","last_peered":"2024-09-11T00:14:25.442962+0000","last_clean":"2024-09-11T00:14:25.442962+0000","last_became_active":"2024-09-11T00:14:17.631295+0000","last_became_peered":"2024-09-11T00:14:17.631295+0000","last_unstale":"2024-09-11T00:14:25.442962+0000","last_undegraded":"2024-09-11T00:14:25.442962+0000","last_fullsized":"2024-09-11T00:14:25.442962+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:16.598908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:16.598908+0000","last_clean_scrub_stamp":"2024-09-11T00:14:16.598908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:31:48.757466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:24.883605+0000","last_change":"2024-09-11T00:14:22.688647+0000","last_active":"2024-09-11T00:14:24.883605+0000","last_peered":"2024-09-11T00:14:24.883605+0000","last_clean":"2024-09-11T00:14:24.883605+0000","last_became_active":"2024-09-11T00:14:22.688255+0000","last_became_peered":"2024-09-11T00:14:22.688255+0000","last_unstale":"2024-09-11T00:14:24.883605+0000","last_undegraded":"2024-09-11T00:14:24.883605+0000","last_fullsized":"2024-09-11T00:14:24.883605+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:21.633629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:21.633629+0000","last_clean_scrub_stamp":"2024-09-11T00:14:21.633629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:12:56.442243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:23.648452+0000","last_change":"2024-09-11T00:14:18.626265+0000","last_active":"2024-09-11T00:14:23.648452+0000","last_peered":"2024-09-11T00:14:23.648452+0000","last_clean":"2024-09-11T00:14:23.648452+0000","last_became_active":"2024-09-11T00:14:18.625997+0000","last_became_peered":"2024-09-11T00:14:18.625997+0000","last_unstale":"2024-09-11T00:14:23.648452+0000","last_undegraded":"2024-09-11T00:14:23.648452+0000","last_fullsized":"2024-09-11T00:14:23.648452+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_clean_scrub_stamp":"2024-09-11T00:14:17.606538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:34:07.533694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:23.651593+0000","last_change":"2024-09-11T00:14:17.627078+0000","last_active":"2024-09-11T00:14:23.651593+0000","last_peered":"2024-09-11T00:14:23.651593+0000","last_clean":"2024-09-11T00:14:23.651593+0000","last_became_active":"2024-09-11T00:14:17.626791+0000","last_became_peered":"2024-09-11T00:14:17.626791+0000","last_unstale":"2024-09-11T00:14:23.651593+0000","last_undegraded":"2024-09-11T00:14:23.651593+0000","last_fullsized":"2024-09-11T00:14:23.651593+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:16.598908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:16.598908+0000","last_clean_scrub_stamp":"2024-09-11T00:14:16.598908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:41:57.300139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":119,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:25.443097+0000","last_change":"2024-09-11T00:14:08.221813+0000","last_active":"2024-09-11T00:14:25.443097+0000","last_peered":"2024-09-11T00:14:25.443097+0000","last_clean":"2024-09-11T00:14:25.443097+0000","last_became_active":"2024-09-11T00:14:08.220663+0000","last_became_peered":"2024-09-11T00:14:08.220663+0000","last_unstale":"2024-09-11T00:14:25.443097+0000","last_undegraded":"2024-09-11T00:14:25.443097+0000","last_fullsized":"2024-09-11T00:14:25.443097+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:06.563107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:06.563107+0000","last_clean_scrub_stamp":"2024-09-11T00:14:06.563107+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:44:49.322583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:24.935219+0000","last_change":"2024-09-11T00:14:22.692059+0000","last_active":"2024-09-11T00:14:24.935219+0000","last_peered":"2024-09-11T00:14:24.935219+0000","last_clean":"2024-09-11T00:14:24.935219+0000","last_became_active":"2024-09-11T00:14:22.691622+0000","last_became_peered":"2024-09-11T00:14:22.691622+0000","last_unstale":"2024-09-11T00:14:24.935219+0000","last_undegraded":"2024-09-11T00:14:24.935219+0000","last_fullsized":"2024-09-11T00:14:24.935219+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:21.633629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:21.633629+0000","last_clean_scrub_stamp":"2024-09-11T00:14:21.633629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:17:20.492407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:25.443365+0000","last_change":"2024-09-11T00:14:18.643287+0000","last_active":"2024-09-11T00:14:25.443365+0000","last_peered":"2024-09-11T00:14:25.443365+0000","last_clean":"2024-09-11T00:14:25.443365+0000","last_became_active":"2024-09-11T00:14:18.642274+0000","last_became_peered":"2024-09-11T00:14:18.642274+0000","last_unstale":"2024-09-11T00:14:25.443365+0000","last_undegraded":"2024-09-11T00:14:25.443365+0000","last_fullsized":"2024-09-11T00:14:25.443365+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_clean_scrub_stamp":"2024-09-11T00:14:17.606538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:28:22.113765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:25.448581+0000","last_change":"2024-09-11T00:14:17.633759+0000","last_active":"2024-09-11T00:14:25.448581+0000","last_peered":"2024-09-11T00:14:25.448581+0000","last_clean":"2024-09-11T00:14:25.448581+0000","last_became_active":"2024-09-11T00:14:17.633445+0000","last_became_peered":"2024-09-11T00:14:17.633445+0000","last_unstale":"2024-09-11T00:14:25.448581+0000","last_undegraded":"2024-09-11T00:14:25.448581+0000","last_fullsized":"2024-09-11T00:14:25.448581+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:16.598908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:16.598908+0000","last_clean_scrub_stamp":"2024-09-11T00:14:16.598908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:52:38.739834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:24.934823+0000","last_change":"2024-09-11T00:14:22.688646+0000","last_active":"2024-09-11T00:14:24.934823+0000","last_peered":"2024-09-11T00:14:24.934823+0000","last_clean":"2024-09-11T00:14:24.934823+0000","last_became_active":"2024-09-11T00:14:22.688254+0000","last_became_peered":"2024-09-11T00:14:22.688254+0000","last_unstale":"2024-09-11T00:14:24.934823+0000","last_undegraded":"2024-09-11T00:14:24.934823+0000","last_fullsized":"2024-09-11T00:14:24.934823+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:21.633629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:21.633629+0000","last_clean_scrub_stamp":"2024-09-11T00:14:21.633629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:12:15.928177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:23.650905+0000","last_change":"2024-09-11T00:14:18.629290+0000","last_active":"2024-09-11T00:14:23.650905+0000","last_peered":"2024-09-11T00:14:23.650905+0000","last_clean":"2024-09-11T00:14:23.650905+0000","last_became_active":"2024-09-11T00:14:18.629028+0000","last_became_peered":"2024-09-11T00:14:18.629028+0000","last_unstale":"2024-09-11T00:14:23.650905+0000","last_undegraded":"2024-09-11T00:14:23.650905+0000","last_fullsized":"2024-09-11T00:14:23.650905+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_clean_scrub_stamp":"2024-09-11T00:14:17.606538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:49:46.087276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:25.448972+0000","last_change":"2024-09-11T00:14:17.634168+0000","last_active":"2024-09-11T00:14:25.448972+0000","last_peered":"2024-09-11T00:14:25.448972+0000","last_clean":"2024-09-11T00:14:25.448972+0000","last_became_active":"2024-09-11T00:14:17.633920+0000","last_became_peered":"2024-09-11T00:14:17.633920+0000","last_unstale":"2024-09-11T00:14:25.448972+0000","last_undegraded":"2024-09-11T00:14:25.448972+0000","last_fullsized":"2024-09-11T00:14:25.448972+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:16.598908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:16.598908+0000","last_clean_scrub_stamp":"2024-09-11T00:14:16.598908+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:31:48.757466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:24.883419+0000","last_change":"2024-09-11T00:14:22.669596+0000","last_active":"2024-09-11T00:14:24.883419+0000","last_peered":"2024-09-11T00:14:24.883419+0000","last_clean":"2024-09-11T00:14:24.883419+0000","last_became_active":"2024-09-11T00:14:22.669123+0000","last_became_peered":"2024-09-11T00:14:22.669123+0000","last_unstale":"2024-09-11T00:14:24.883419+0000","last_undegraded":"2024-09-11T00:14:24.883419+0000","last_fullsized":"2024-09-11T00:14:24.883419+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:21.633629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:21.633629+0000","last_clean_scrub_stamp":"2024-09-11T00:14:21.633629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:07:41.648631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:25.443770+0000","last_change":"2024-09-11T00:14:18.647802+0000","last_active":"2024-09-11T00:14:25.443770+0000","last_peered":"2024-09-11T00:14:25.443770+0000","last_clean":"2024-09-11T00:14:25.443770+0000","last_became_active":"2024-09-11T00:14:18.647512+0000","last_became_peered":"2024-09-11T00:14:18.647512+0000","last_unstale":"2024-09-11T00:14:25.443770+0000","last_undegraded":"2024-09-11T00:14:25.443770+0000","last_fullsized":"2024-09-11T00:14:25.443770+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_clean_scrub_stamp":"2024-09-11T00:14:17.606538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:04:59.988406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:25.448274+0000","last_change":"2024-09-11T00:14:17.624944+0000","last_active":"2024-09-11T00:14:25.448274+0000","last_peered":"2024-09-11T00:14:25.448274+0000","last_clean":"2024-09-11T00:14:25.448274+0000","last_became_active":"2024-09-11T00:14:17.624613+0000","last_became_peered":"2024-09-11T00:14:17.624613+0000","last_unstale":"2024-09-11T00:14:25.448274+0000","last_undegraded":"2024-09-11T00:14:25.448274+0000","last_fullsized":"2024-09-11T00:14:25.448274+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:16.598908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:16.598908+0000","last_clean_scrub_stamp":"2024-09-11T00:14:16.598908+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:30:53.963229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:23.650179+0000","last_change":"2024-09-11T00:14:22.689788+0000","last_active":"2024-09-11T00:14:23.650179+0000","last_peered":"2024-09-11T00:14:23.650179+0000","last_clean":"2024-09-11T00:14:23.650179+0000","last_became_active":"2024-09-11T00:14:22.689360+0000","last_became_peered":"2024-09-11T00:14:22.689360+0000","last_unstale":"2024-09-11T00:14:23.650179+0000","last_undegraded":"2024-09-11T00:14:23.650179+0000","last_fullsized":"2024-09-11T00:14:23.650179+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:21.633629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:21.633629+0000","last_clean_scrub_stamp":"2024-09-11T00:14:21.633629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:07:21.973974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:25.443628+0000","last_change":"2024-09-11T00:14:18.645675+0000","last_active":"2024-09-11T00:14:25.443628+0000","last_peered":"2024-09-11T00:14:25.443628+0000","last_clean":"2024-09-11T00:14:25.443628+0000","last_became_active":"2024-09-11T00:14:18.645400+0000","last_became_peered":"2024-09-11T00:14:18.645400+0000","last_unstale":"2024-09-11T00:14:25.443628+0000","last_undegraded":"2024-09-11T00:14:25.443628+0000","last_fullsized":"2024-09-11T00:14:25.443628+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_clean_scrub_stamp":"2024-09-11T00:14:17.606538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:18:45.202473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:23.652104+0000","last_change":"2024-09-11T00:14:17.634002+0000","last_active":"2024-09-11T00:14:23.652104+0000","last_peered":"2024-09-11T00:14:23.652104+0000","last_clean":"2024-09-11T00:14:23.652104+0000","last_became_active":"2024-09-11T00:14:17.633722+0000","last_became_peered":"2024-09-11T00:14:17.633722+0000","last_unstale":"2024-09-11T00:14:23.652104+0000","last_undegraded":"2024-09-11T00:14:23.652104+0000","last_fullsized":"2024-09-11T00:14:23.652104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:16.598908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:16.598908+0000","last_clean_scrub_stamp":"2024-09-11T00:14:16.598908+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:38:48.805212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:23.649985+0000","last_change":"2024-09-11T00:14:22.674989+0000","last_active":"2024-09-11T00:14:23.649985+0000","last_peered":"2024-09-11T00:14:23.649985+0000","last_clean":"2024-09-11T00:14:23.649985+0000","last_became_active":"2024-09-11T00:14:22.674093+0000","last_became_peered":"2024-09-11T00:14:22.674093+0000","last_unstale":"2024-09-11T00:14:23.649985+0000","last_undegraded":"2024-09-11T00:14:23.649985+0000","last_fullsized":"2024-09-11T00:14:23.649985+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:21.633629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:21.633629+0000","last_clean_scrub_stamp":"2024-09-11T00:14:21.633629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:51:34.161600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:25.443210+0000","last_change":"2024-09-11T00:14:18.645760+0000","last_active":"2024-09-11T00:14:25.443210+0000","last_peered":"2024-09-11T00:14:25.443210+0000","last_clean":"2024-09-11T00:14:25.443210+0000","last_became_active":"2024-09-11T00:14:18.645462+0000","last_became_peered":"2024-09-11T00:14:18.645462+0000","last_unstale":"2024-09-11T00:14:25.443210+0000","last_undegraded":"2024-09-11T00:14:25.443210+0000","last_fullsized":"2024-09-11T00:14:25.443210+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_clean_scrub_stamp":"2024-09-11T00:14:17.606538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:05:22.680084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":31,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:25.447934+0000","last_change":"2024-09-11T00:14:17.628485+0000","last_active":"2024-09-11T00:14:25.447934+0000","last_peered":"2024-09-11T00:14:25.447934+0000","last_clean":"2024-09-11T00:14:25.447934+0000","last_became_active":"2024-09-11T00:14:17.628222+0000","last_became_peered":"2024-09-11T00:14:17.628222+0000","last_unstale":"2024-09-11T00:14:25.447934+0000","last_undegraded":"2024-09-11T00:14:25.447934+0000","last_fullsized":"2024-09-11T00:14:25.447934+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:16.598908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:16.598908+0000","last_clean_scrub_stamp":"2024-09-11T00:14:16.598908+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:10:29.159080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:24.883394+0000","last_change":"2024-09-11T00:14:22.667660+0000","last_active":"2024-09-11T00:14:24.883394+0000","last_peered":"2024-09-11T00:14:24.883394+0000","last_clean":"2024-09-11T00:14:24.883394+0000","last_became_active":"2024-09-11T00:14:22.667251+0000","last_became_peered":"2024-09-11T00:14:22.667251+0000","last_unstale":"2024-09-11T00:14:24.883394+0000","last_undegraded":"2024-09-11T00:14:24.883394+0000","last_fullsized":"2024-09-11T00:14:24.883394+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:21.633629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:21.633629+0000","last_clean_scrub_stamp":"2024-09-11T00:14:21.633629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:49:50.114367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:24.934702+0000","last_change":"2024-09-11T00:14:18.638920+0000","last_active":"2024-09-11T00:14:24.934702+0000","last_peered":"2024-09-11T00:14:24.934702+0000","last_clean":"2024-09-11T00:14:24.934702+0000","last_became_active":"2024-09-11T00:14:18.638610+0000","last_became_peered":"2024-09-11T00:14:18.638610+0000","last_unstale":"2024-09-11T00:14:24.934702+0000","last_undegraded":"2024-09-11T00:14:24.934702+0000","last_fullsized":"2024-09-11T00:14:24.934702+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_clean_scrub_stamp":"2024-09-11T00:14:17.606538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:54:59.724551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:24.934755+0000","last_change":"2024-09-11T00:14:17.637068+0000","last_active":"2024-09-11T00:14:24.934755+0000","last_peered":"2024-09-11T00:14:24.934755+0000","last_clean":"2024-09-11T00:14:24.934755+0000","last_became_active":"2024-09-11T00:14:17.636624+0000","last_became_peered":"2024-09-11T00:14:17.636624+0000","last_unstale":"2024-09-11T00:14:24.934755+0000","last_undegraded":"2024-09-11T00:14:24.934755+0000","last_fullsized":"2024-09-11T00:14:24.934755+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:16.598908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:16.598908+0000","last_clean_scrub_stamp":"2024-09-11T00:14:16.598908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:10:29.159080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:23.649270+0000","last_change":"2024-09-11T00:14:22.690799+0000","last_active":"2024-09-11T00:14:23.649270+0000","last_peered":"2024-09-11T00:14:23.649270+0000","last_clean":"2024-09-11T00:14:23.649270+0000","last_became_active":"2024-09-11T00:14:22.690297+0000","last_became_peered":"2024-09-11T00:14:22.690297+0000","last_unstale":"2024-09-11T00:14:23.649270+0000","last_undegraded":"2024-09-11T00:14:23.649270+0000","last_fullsized":"2024-09-11T00:14:23.649270+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:21.633629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:21.633629+0000","last_clean_scrub_stamp":"2024-09-11T00:14:21.633629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:22:53.801030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:25.443367+0000","last_change":"2024-09-11T00:14:18.642784+0000","last_active":"2024-09-11T00:14:25.443367+0000","last_peered":"2024-09-11T00:14:25.443367+0000","last_clean":"2024-09-11T00:14:25.443367+0000","last_became_active":"2024-09-11T00:14:18.642508+0000","last_became_peered":"2024-09-11T00:14:18.642508+0000","last_unstale":"2024-09-11T00:14:25.443367+0000","last_undegraded":"2024-09-11T00:14:25.443367+0000","last_fullsized":"2024-09-11T00:14:25.443367+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_clean_scrub_stamp":"2024-09-11T00:14:17.606538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:25:18.398495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:23.652298+0000","last_change":"2024-09-11T00:14:17.623667+0000","last_active":"2024-09-11T00:14:23.652298+0000","last_peered":"2024-09-11T00:14:23.652298+0000","last_clean":"2024-09-11T00:14:23.652298+0000","last_became_active":"2024-09-11T00:14:17.623380+0000","last_became_peered":"2024-09-11T00:14:17.623380+0000","last_unstale":"2024-09-11T00:14:23.652298+0000","last_undegraded":"2024-09-11T00:14:23.652298+0000","last_fullsized":"2024-09-11T00:14:23.652298+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:16.598908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:16.598908+0000","last_clean_scrub_stamp":"2024-09-11T00:14:16.598908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:42:38.574433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:23.648776+0000","last_change":"2024-09-11T00:14:22.688511+0000","last_active":"2024-09-11T00:14:23.648776+0000","last_peered":"2024-09-11T00:14:23.648776+0000","last_clean":"2024-09-11T00:14:23.648776+0000","last_became_active":"2024-09-11T00:14:22.688105+0000","last_became_peered":"2024-09-11T00:14:22.688105+0000","last_unstale":"2024-09-11T00:14:23.648776+0000","last_undegraded":"2024-09-11T00:14:23.648776+0000","last_fullsized":"2024-09-11T00:14:23.648776+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:21.633629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:21.633629+0000","last_clean_scrub_stamp":"2024-09-11T00:14:21.633629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:23:20.020672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:24.883270+0000","last_change":"2024-09-11T00:14:18.641786+0000","last_active":"2024-09-11T00:14:24.883270+0000","last_peered":"2024-09-11T00:14:24.883270+0000","last_clean":"2024-09-11T00:14:24.883270+0000","last_became_active":"2024-09-11T00:14:18.641529+0000","last_became_peered":"2024-09-11T00:14:18.641529+0000","last_unstale":"2024-09-11T00:14:24.883270+0000","last_undegraded":"2024-09-11T00:14:24.883270+0000","last_fullsized":"2024-09-11T00:14:24.883270+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_clean_scrub_stamp":"2024-09-11T00:14:17.606538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:35:44.502418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:24.883594+0000","last_change":"2024-09-11T00:14:17.635250+0000","last_active":"2024-09-11T00:14:24.883594+0000","last_peered":"2024-09-11T00:14:24.883594+0000","last_clean":"2024-09-11T00:14:24.883594+0000","last_became_active":"2024-09-11T00:14:17.634962+0000","last_became_peered":"2024-09-11T00:14:17.634962+0000","last_unstale":"2024-09-11T00:14:24.883594+0000","last_undegraded":"2024-09-11T00:14:24.883594+0000","last_fullsized":"2024-09-11T00:14:24.883594+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:16.598908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:16.598908+0000","last_clean_scrub_stamp":"2024-09-11T00:14:16.598908+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:02:04.954945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:23.651089+0000","last_change":"2024-09-11T00:14:22.688665+0000","last_active":"2024-09-11T00:14:23.651089+0000","last_peered":"2024-09-11T00:14:23.651089+0000","last_clean":"2024-09-11T00:14:23.651089+0000","last_became_active":"2024-09-11T00:14:22.688285+0000","last_became_peered":"2024-09-11T00:14:22.688285+0000","last_unstale":"2024-09-11T00:14:23.651089+0000","last_undegraded":"2024-09-11T00:14:23.651089+0000","last_fullsized":"2024-09-11T00:14:23.651089+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:21.633629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:21.633629+0000","last_clean_scrub_stamp":"2024-09-11T00:14:21.633629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:14:32.578348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:25.443331+0000","last_change":"2024-09-11T00:14:18.644136+0000","last_active":"2024-09-11T00:14:25.443331+0000","last_peered":"2024-09-11T00:14:25.443331+0000","last_clean":"2024-09-11T00:14:25.443331+0000","last_became_active":"2024-09-11T00:14:18.642976+0000","last_became_peered":"2024-09-11T00:14:18.642976+0000","last_unstale":"2024-09-11T00:14:25.443331+0000","last_undegraded":"2024-09-11T00:14:25.443331+0000","last_fullsized":"2024-09-11T00:14:25.443331+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_clean_scrub_stamp":"2024-09-11T00:14:17.606538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:58:16.831016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"25'9","reported_seq":32,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:28.050349+0000","last_change":"2024-09-11T00:14:17.633618+0000","last_active":"2024-09-11T00:14:28.050349+0000","last_peered":"2024-09-11T00:14:28.050349+0000","last_clean":"2024-09-11T00:14:28.050349+0000","last_became_active":"2024-09-11T00:14:17.632701+0000","last_became_peered":"2024-09-11T00:14:17.632701+0000","last_unstale":"2024-09-11T00:14:28.050349+0000","last_undegraded":"2024-09-11T00:14:28.050349+0000","last_fullsized":"2024-09-11T00:14:28.050349+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:16.598908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:16.598908+0000","last_clean_scrub_stamp":"2024-09-11T00:14:16.598908+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:10:37.852358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:25.448757+0000","last_change":"2024-09-11T00:14:22.664837+0000","last_active":"2024-09-11T00:14:25.448757+0000","last_peered":"2024-09-11T00:14:25.448757+0000","last_clean":"2024-09-11T00:14:25.448757+0000","last_became_active":"2024-09-11T00:14:22.663868+0000","last_became_peered":"2024-09-11T00:14:22.663868+0000","last_unstale":"2024-09-11T00:14:25.448757+0000","last_undegraded":"2024-09-11T00:14:25.448757+0000","last_fullsized":"2024-09-11T00:14:25.448757+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:21.633629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:21.633629+0000","last_clean_scrub_stamp":"2024-09-11T00:14:21.633629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:51:23.630707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:23.652267+0000","last_change":"2024-09-11T00:14:18.641013+0000","last_active":"2024-09-11T00:14:23.652267+0000","last_peered":"2024-09-11T00:14:23.652267+0000","last_clean":"2024-09-11T00:14:23.652267+0000","last_became_active":"2024-09-11T00:14:18.640690+0000","last_became_peered":"2024-09-11T00:14:18.640690+0000","last_unstale":"2024-09-11T00:14:23.652267+0000","last_undegraded":"2024-09-11T00:14:23.652267+0000","last_fullsized":"2024-09-11T00:14:23.652267+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_clean_scrub_stamp":"2024-09-11T00:14:17.606538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:22:59.454003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:25.448873+0000","last_change":"2024-09-11T00:14:17.637712+0000","last_active":"2024-09-11T00:14:25.448873+0000","last_peered":"2024-09-11T00:14:25.448873+0000","last_clean":"2024-09-11T00:14:25.448873+0000","last_became_active":"2024-09-11T00:14:17.637463+0000","last_became_peered":"2024-09-11T00:14:17.637463+0000","last_unstale":"2024-09-11T00:14:25.448873+0000","last_undegraded":"2024-09-11T00:14:25.448873+0000","last_fullsized":"2024-09-11T00:14:25.448873+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:16.598908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:16.598908+0000","last_clean_scrub_stamp":"2024-09-11T00:14:16.598908+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:43:47.266406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:23.650677+0000","last_change":"2024-09-11T00:14:22.664447+0000","last_active":"2024-09-11T00:14:23.650677+0000","last_peered":"2024-09-11T00:14:23.650677+0000","last_clean":"2024-09-11T00:14:23.650677+0000","last_became_active":"2024-09-11T00:14:22.663920+0000","last_became_peered":"2024-09-11T00:14:22.663920+0000","last_unstale":"2024-09-11T00:14:23.650677+0000","last_undegraded":"2024-09-11T00:14:23.650677+0000","last_fullsized":"2024-09-11T00:14:23.650677+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:21.633629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:21.633629+0000","last_clean_scrub_stamp":"2024-09-11T00:14:21.633629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:55:56.768777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:24.883554+0000","last_change":"2024-09-11T00:14:18.630232+0000","last_active":"2024-09-11T00:14:24.883554+0000","last_peered":"2024-09-11T00:14:24.883554+0000","last_clean":"2024-09-11T00:14:24.883554+0000","last_became_active":"2024-09-11T00:14:18.629885+0000","last_became_peered":"2024-09-11T00:14:18.629885+0000","last_unstale":"2024-09-11T00:14:24.883554+0000","last_undegraded":"2024-09-11T00:14:24.883554+0000","last_fullsized":"2024-09-11T00:14:24.883554+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_clean_scrub_stamp":"2024-09-11T00:14:17.606538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:05:45.558170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:23.650676+0000","last_change":"2024-09-11T00:14:17.632228+0000","last_active":"2024-09-11T00:14:23.650676+0000","last_peered":"2024-09-11T00:14:23.650676+0000","last_clean":"2024-09-11T00:14:23.650676+0000","last_became_active":"2024-09-11T00:14:17.631908+0000","last_became_peered":"2024-09-11T00:14:17.631908+0000","last_unstale":"2024-09-11T00:14:23.650676+0000","last_undegraded":"2024-09-11T00:14:23.650676+0000","last_fullsized":"2024-09-11T00:14:23.650676+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:16.598908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:16.598908+0000","last_clean_scrub_stamp":"2024-09-11T00:14:16.598908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:11:19.690215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:23.648399+0000","last_change":"2024-09-11T00:14:22.671970+0000","last_active":"2024-09-11T00:14:23.648399+0000","last_peered":"2024-09-11T00:14:23.648399+0000","last_clean":"2024-09-11T00:14:23.648399+0000","last_became_active":"2024-09-11T00:14:22.671536+0000","last_became_peered":"2024-09-11T00:14:22.671536+0000","last_unstale":"2024-09-11T00:14:23.648399+0000","last_undegraded":"2024-09-11T00:14:23.648399+0000","last_fullsized":"2024-09-11T00:14:23.648399+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:21.633629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:21.633629+0000","last_clean_scrub_stamp":"2024-09-11T00:14:21.633629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:42:10.576151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:23.650561+0000","last_change":"2024-09-11T00:14:18.639664+0000","last_active":"2024-09-11T00:14:23.650561+0000","last_peered":"2024-09-11T00:14:23.650561+0000","last_clean":"2024-09-11T00:14:23.650561+0000","last_became_active":"2024-09-11T00:14:18.639215+0000","last_became_peered":"2024-09-11T00:14:18.639215+0000","last_unstale":"2024-09-11T00:14:23.650561+0000","last_undegraded":"2024-09-11T00:14:23.650561+0000","last_fullsized":"2024-09-11T00:14:23.650561+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_clean_scrub_stamp":"2024-09-11T00:14:17.606538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:38:46.884984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:24.935237+0000","last_change":"2024-09-11T00:14:17.638296+0000","last_active":"2024-09-11T00:14:24.935237+0000","last_peered":"2024-09-11T00:14:24.935237+0000","last_clean":"2024-09-11T00:14:24.935237+0000","last_became_active":"2024-09-11T00:14:17.637629+0000","last_became_peered":"2024-09-11T00:14:17.637629+0000","last_unstale":"2024-09-11T00:14:24.935237+0000","last_undegraded":"2024-09-11T00:14:24.935237+0000","last_fullsized":"2024-09-11T00:14:24.935237+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:16.598908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:16.598908+0000","last_clean_scrub_stamp":"2024-09-11T00:14:16.598908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:30:53.963229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:23.648342+0000","last_change":"2024-09-11T00:14:22.692320+0000","last_active":"2024-09-11T00:14:23.648342+0000","last_peered":"2024-09-11T00:14:23.648342+0000","last_clean":"2024-09-11T00:14:23.648342+0000","last_became_active":"2024-09-11T00:14:22.691110+0000","last_became_peered":"2024-09-11T00:14:22.691110+0000","last_unstale":"2024-09-11T00:14:23.648342+0000","last_undegraded":"2024-09-11T00:14:23.648342+0000","last_fullsized":"2024-09-11T00:14:23.648342+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:21.633629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:21.633629+0000","last_clean_scrub_stamp":"2024-09-11T00:14:21.633629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:19:13.639166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:24.883414+0000","last_change":"2024-09-11T00:14:22.692131+0000","last_active":"2024-09-11T00:14:24.883414+0000","last_peered":"2024-09-11T00:14:24.883414+0000","last_clean":"2024-09-11T00:14:24.883414+0000","last_became_active":"2024-09-11T00:14:22.691743+0000","last_became_peered":"2024-09-11T00:14:22.691743+0000","last_unstale":"2024-09-11T00:14:24.883414+0000","last_undegraded":"2024-09-11T00:14:24.883414+0000","last_fullsized":"2024-09-11T00:14:24.883414+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:21.633629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:21.633629+0000","last_clean_scrub_stamp":"2024-09-11T00:14:21.633629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:18:49.229564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:25.448449+0000","last_change":"2024-09-11T00:14:18.627489+0000","last_active":"2024-09-11T00:14:25.448449+0000","last_peered":"2024-09-11T00:14:25.448449+0000","last_clean":"2024-09-11T00:14:25.448449+0000","last_became_active":"2024-09-11T00:14:18.627227+0000","last_became_peered":"2024-09-11T00:14:18.627227+0000","last_unstale":"2024-09-11T00:14:25.448449+0000","last_undegraded":"2024-09-11T00:14:25.448449+0000","last_fullsized":"2024-09-11T00:14:25.448449+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_clean_scrub_stamp":"2024-09-11T00:14:17.606538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:20:59.721295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:23.650568+0000","last_change":"2024-09-11T00:14:17.633563+0000","last_active":"2024-09-11T00:14:23.650568+0000","last_peered":"2024-09-11T00:14:23.650568+0000","last_clean":"2024-09-11T00:14:23.650568+0000","last_became_active":"2024-09-11T00:14:17.633316+0000","last_became_peered":"2024-09-11T00:14:17.633316+0000","last_unstale":"2024-09-11T00:14:23.650568+0000","last_undegraded":"2024-09-11T00:14:23.650568+0000","last_fullsized":"2024-09-11T00:14:23.650568+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:16.598908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:16.598908+0000","last_clean_scrub_stamp":"2024-09-11T00:14:16.598908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:52:22.626375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:24.935339+0000","last_change":"2024-09-11T00:14:22.670666+0000","last_active":"2024-09-11T00:14:24.935339+0000","last_peered":"2024-09-11T00:14:24.935339+0000","last_clean":"2024-09-11T00:14:24.935339+0000","last_became_active":"2024-09-11T00:14:22.670286+0000","last_became_peered":"2024-09-11T00:14:22.670286+0000","last_unstale":"2024-09-11T00:14:24.935339+0000","last_undegraded":"2024-09-11T00:14:24.935339+0000","last_fullsized":"2024-09-11T00:14:24.935339+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:21.633629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:21.633629+0000","last_clean_scrub_stamp":"2024-09-11T00:14:21.633629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:53:06.573918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:23.648370+0000","last_change":"2024-09-11T00:14:18.634072+0000","last_active":"2024-09-11T00:14:23.648370+0000","last_peered":"2024-09-11T00:14:23.648370+0000","last_clean":"2024-09-11T00:14:23.648370+0000","last_became_active":"2024-09-11T00:14:18.633811+0000","last_became_peered":"2024-09-11T00:14:18.633811+0000","last_unstale":"2024-09-11T00:14:23.648370+0000","last_undegraded":"2024-09-11T00:14:23.648370+0000","last_fullsized":"2024-09-11T00:14:23.648370+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_clean_scrub_stamp":"2024-09-11T00:14:17.606538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:35:44.502418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:23.648649+0000","last_change":"2024-09-11T00:14:17.631993+0000","last_active":"2024-09-11T00:14:23.648649+0000","last_peered":"2024-09-11T00:14:23.648649+0000","last_clean":"2024-09-11T00:14:23.648649+0000","last_became_active":"2024-09-11T00:14:17.631645+0000","last_became_peered":"2024-09-11T00:14:17.631645+0000","last_unstale":"2024-09-11T00:14:23.648649+0000","last_undegraded":"2024-09-11T00:14:23.648649+0000","last_fullsized":"2024-09-11T00:14:23.648649+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:16.598908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:16.598908+0000","last_clean_scrub_stamp":"2024-09-11T00:14:16.598908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:55:22.582535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:24.934838+0000","last_change":"2024-09-11T00:14:17.634075+0000","last_active":"2024-09-11T00:14:24.934838+0000","last_peered":"2024-09-11T00:14:24.934838+0000","last_clean":"2024-09-11T00:14:24.934838+0000","last_became_active":"2024-09-11T00:14:17.633595+0000","last_became_peered":"2024-09-11T00:14:17.633595+0000","last_unstale":"2024-09-11T00:14:24.934838+0000","last_undegraded":"2024-09-11T00:14:24.934838+0000","last_fullsized":"2024-09-11T00:14:24.934838+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:16.598908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:16.598908+0000","last_clean_scrub_stamp":"2024-09-11T00:14:16.598908+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:51:02.481656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:24.883579+0000","last_change":"2024-09-11T00:14:18.642731+0000","last_active":"2024-09-11T00:14:24.883579+0000","last_peered":"2024-09-11T00:14:24.883579+0000","last_clean":"2024-09-11T00:14:24.883579+0000","last_became_active":"2024-09-11T00:14:18.642296+0000","last_became_peered":"2024-09-11T00:14:18.642296+0000","last_unstale":"2024-09-11T00:14:24.883579+0000","last_undegraded":"2024-09-11T00:14:24.883579+0000","last_fullsized":"2024-09-11T00:14:24.883579+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_clean_scrub_stamp":"2024-09-11T00:14:17.606538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:49:06.208715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:25.448556+0000","last_change":"2024-09-11T00:14:22.674116+0000","last_active":"2024-09-11T00:14:25.448556+0000","last_peered":"2024-09-11T00:14:25.448556+0000","last_clean":"2024-09-11T00:14:25.448556+0000","last_became_active":"2024-09-11T00:14:22.673701+0000","last_became_peered":"2024-09-11T00:14:22.673701+0000","last_unstale":"2024-09-11T00:14:25.448556+0000","last_undegraded":"2024-09-11T00:14:25.448556+0000","last_fullsized":"2024-09-11T00:14:25.448556+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:21.633629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:21.633629+0000","last_clean_scrub_stamp":"2024-09-11T00:14:21.633629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:22:35.167801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:23.648729+0000","last_change":"2024-09-11T00:14:17.632276+0000","last_active":"2024-09-11T00:14:23.648729+0000","last_peered":"2024-09-11T00:14:23.648729+0000","last_clean":"2024-09-11T00:14:23.648729+0000","last_became_active":"2024-09-11T00:14:17.631820+0000","last_became_peered":"2024-09-11T00:14:17.631820+0000","last_unstale":"2024-09-11T00:14:23.648729+0000","last_undegraded":"2024-09-11T00:14:23.648729+0000","last_fullsized":"2024-09-11T00:14:23.648729+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:16.598908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:16.598908+0000","last_clean_scrub_stamp":"2024-09-11T00:14:16.598908+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:20:56.408317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:23.650684+0000","last_change":"2024-09-11T00:14:18.631229+0000","last_active":"2024-09-11T00:14:23.650684+0000","last_peered":"2024-09-11T00:14:23.650684+0000","last_clean":"2024-09-11T00:14:23.650684+0000","last_became_active":"2024-09-11T00:14:18.630830+0000","last_became_peered":"2024-09-11T00:14:18.630830+0000","last_unstale":"2024-09-11T00:14:23.650684+0000","last_undegraded":"2024-09-11T00:14:23.650684+0000","last_fullsized":"2024-09-11T00:14:23.650684+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_clean_scrub_stamp":"2024-09-11T00:14:17.606538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:39:00.086315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:23.649013+0000","last_change":"2024-09-11T00:14:22.675138+0000","last_active":"2024-09-11T00:14:23.649013+0000","last_peered":"2024-09-11T00:14:23.649013+0000","last_clean":"2024-09-11T00:14:23.649013+0000","last_became_active":"2024-09-11T00:14:22.674701+0000","last_became_peered":"2024-09-11T00:14:22.674701+0000","last_unstale":"2024-09-11T00:14:23.649013+0000","last_undegraded":"2024-09-11T00:14:23.649013+0000","last_fullsized":"2024-09-11T00:14:23.649013+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:21.633629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:21.633629+0000","last_clean_scrub_stamp":"2024-09-11T00:14:21.633629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:16:25.651997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:24.934564+0000","last_change":"2024-09-11T00:14:18.639301+0000","last_active":"2024-09-11T00:14:24.934564+0000","last_peered":"2024-09-11T00:14:24.934564+0000","last_clean":"2024-09-11T00:14:24.934564+0000","last_became_active":"2024-09-11T00:14:18.639038+0000","last_became_peered":"2024-09-11T00:14:18.639038+0000","last_unstale":"2024-09-11T00:14:24.934564+0000","last_undegraded":"2024-09-11T00:14:24.934564+0000","last_fullsized":"2024-09-11T00:14:24.934564+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_clean_scrub_stamp":"2024-09-11T00:14:17.606538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:24:12.007225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:25.448031+0000","last_change":"2024-09-11T00:14:18.623623+0000","last_active":"2024-09-11T00:14:25.448031+0000","last_peered":"2024-09-11T00:14:25.448031+0000","last_clean":"2024-09-11T00:14:25.448031+0000","last_became_active":"2024-09-11T00:14:18.623328+0000","last_became_peered":"2024-09-11T00:14:18.623328+0000","last_unstale":"2024-09-11T00:14:25.448031+0000","last_undegraded":"2024-09-11T00:14:25.448031+0000","last_fullsized":"2024-09-11T00:14:25.448031+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_clean_scrub_stamp":"2024-09-11T00:14:17.606538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:00:51.172893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:23.652194+0000","last_change":"2024-09-11T00:14:18.628493+0000","last_active":"2024-09-11T00:14:23.652194+0000","last_peered":"2024-09-11T00:14:23.652194+0000","last_clean":"2024-09-11T00:14:23.652194+0000","last_became_active":"2024-09-11T00:14:18.628040+0000","last_became_peered":"2024-09-11T00:14:18.628040+0000","last_unstale":"2024-09-11T00:14:23.652194+0000","last_undegraded":"2024-09-11T00:14:23.652194+0000","last_fullsized":"2024-09-11T00:14:23.652194+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_clean_scrub_stamp":"2024-09-11T00:14:17.606538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:24:40.790020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:24.883499+0000","last_change":"2024-09-11T00:14:18.633950+0000","last_active":"2024-09-11T00:14:24.883499+0000","last_peered":"2024-09-11T00:14:24.883499+0000","last_clean":"2024-09-11T00:14:24.883499+0000","last_became_active":"2024-09-11T00:14:18.633147+0000","last_became_peered":"2024-09-11T00:14:18.633147+0000","last_unstale":"2024-09-11T00:14:24.883499+0000","last_undegraded":"2024-09-11T00:14:24.883499+0000","last_fullsized":"2024-09-11T00:14:24.883499+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_clean_scrub_stamp":"2024-09-11T00:14:17.606538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:46:52.007701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:23.648966+0000","last_change":"2024-09-11T00:14:18.626152+0000","last_active":"2024-09-11T00:14:23.648966+0000","last_peered":"2024-09-11T00:14:23.648966+0000","last_clean":"2024-09-11T00:14:23.648966+0000","last_became_active":"2024-09-11T00:14:18.625885+0000","last_became_peered":"2024-09-11T00:14:18.625885+0000","last_unstale":"2024-09-11T00:14:23.648966+0000","last_undegraded":"2024-09-11T00:14:23.648966+0000","last_fullsized":"2024-09-11T00:14:23.648966+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_clean_scrub_stamp":"2024-09-11T00:14:17.606538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:11:01.606959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:25.448276+0000","last_change":"2024-09-11T00:14:18.626762+0000","last_active":"2024-09-11T00:14:25.448276+0000","last_peered":"2024-09-11T00:14:25.448276+0000","last_clean":"2024-09-11T00:14:25.448276+0000","last_became_active":"2024-09-11T00:14:18.626537+0000","last_became_peered":"2024-09-11T00:14:18.626537+0000","last_unstale":"2024-09-11T00:14:25.448276+0000","last_undegraded":"2024-09-11T00:14:25.448276+0000","last_fullsized":"2024-09-11T00:14:25.448276+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_clean_scrub_stamp":"2024-09-11T00:14:17.606538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:03:25.203629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:24.935246+0000","last_change":"2024-09-11T00:14:18.642453+0000","last_active":"2024-09-11T00:14:24.935246+0000","last_peered":"2024-09-11T00:14:24.935246+0000","last_clean":"2024-09-11T00:14:24.935246+0000","last_became_active":"2024-09-11T00:14:18.642172+0000","last_became_peered":"2024-09-11T00:14:18.642172+0000","last_unstale":"2024-09-11T00:14:24.935246+0000","last_undegraded":"2024-09-11T00:14:24.935246+0000","last_fullsized":"2024-09-11T00:14:24.935246+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_clean_scrub_stamp":"2024-09-11T00:14:17.606538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:48:16.815773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:23.649246+0000","last_change":"2024-09-11T00:14:18.628632+0000","last_active":"2024-09-11T00:14:23.649246+0000","last_peered":"2024-09-11T00:14:23.649246+0000","last_clean":"2024-09-11T00:14:23.649246+0000","last_became_active":"2024-09-11T00:14:18.628308+0000","last_became_peered":"2024-09-11T00:14:18.628308+0000","last_unstale":"2024-09-11T00:14:23.649246+0000","last_undegraded":"2024-09-11T00:14:23.649246+0000","last_fullsized":"2024-09-11T00:14:23.649246+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_clean_scrub_stamp":"2024-09-11T00:14:17.606538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:24:40.790020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:23.650453+0000","last_change":"2024-09-11T00:14:18.630942+0000","last_active":"2024-09-11T00:14:23.650453+0000","last_peered":"2024-09-11T00:14:23.650453+0000","last_clean":"2024-09-11T00:14:23.650453+0000","last_became_active":"2024-09-11T00:14:18.630223+0000","last_became_peered":"2024-09-11T00:14:18.630223+0000","last_unstale":"2024-09-11T00:14:23.650453+0000","last_undegraded":"2024-09-11T00:14:23.650453+0000","last_fullsized":"2024-09-11T00:14:23.650453+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_clean_scrub_stamp":"2024-09-11T00:14:17.606538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:34:07.533694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:23.648607+0000","last_change":"2024-09-11T00:14:18.628072+0000","last_active":"2024-09-11T00:14:23.648607+0000","last_peered":"2024-09-11T00:14:23.648607+0000","last_clean":"2024-09-11T00:14:23.648607+0000","last_became_active":"2024-09-11T00:14:18.627801+0000","last_became_peered":"2024-09-11T00:14:18.627801+0000","last_unstale":"2024-09-11T00:14:23.648607+0000","last_undegraded":"2024-09-11T00:14:23.648607+0000","last_fullsized":"2024-09-11T00:14:23.648607+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_clean_scrub_stamp":"2024-09-11T00:14:17.606538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:27:57.991308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:23.652067+0000","last_change":"2024-09-11T00:14:18.633583+0000","last_active":"2024-09-11T00:14:23.652067+0000","last_peered":"2024-09-11T00:14:23.652067+0000","last_clean":"2024-09-11T00:14:23.652067+0000","last_became_active":"2024-09-11T00:14:18.633263+0000","last_became_peered":"2024-09-11T00:14:18.633263+0000","last_unstale":"2024-09-11T00:14:23.652067+0000","last_undegraded":"2024-09-11T00:14:23.652067+0000","last_fullsized":"2024-09-11T00:14:23.652067+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_clean_scrub_stamp":"2024-09-11T00:14:17.606538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:24:44.702294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:24.883238+0000","last_change":"2024-09-11T00:14:18.642759+0000","last_active":"2024-09-11T00:14:24.883238+0000","last_peered":"2024-09-11T00:14:24.883238+0000","last_clean":"2024-09-11T00:14:24.883238+0000","last_became_active":"2024-09-11T00:14:18.642466+0000","last_became_peered":"2024-09-11T00:14:18.642466+0000","last_unstale":"2024-09-11T00:14:24.883238+0000","last_undegraded":"2024-09-11T00:14:24.883238+0000","last_fullsized":"2024-09-11T00:14:24.883238+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_clean_scrub_stamp":"2024-09-11T00:14:17.606538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:54:15.924007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:24.934959+0000","last_change":"2024-09-11T00:14:18.647847+0000","last_active":"2024-09-11T00:14:24.934959+0000","last_peered":"2024-09-11T00:14:24.934959+0000","last_clean":"2024-09-11T00:14:24.934959+0000","last_became_active":"2024-09-11T00:14:18.647379+0000","last_became_peered":"2024-09-11T00:14:18.647379+0000","last_unstale":"2024-09-11T00:14:24.934959+0000","last_undegraded":"2024-09-11T00:14:24.934959+0000","last_fullsized":"2024-09-11T00:14:24.934959+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_clean_scrub_stamp":"2024-09-11T00:14:17.606538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:18:09.026105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:25.443565+0000","last_change":"2024-09-11T00:14:18.643993+0000","last_active":"2024-09-11T00:14:25.443565+0000","last_peered":"2024-09-11T00:14:25.443565+0000","last_clean":"2024-09-11T00:14:25.443565+0000","last_became_active":"2024-09-11T00:14:18.642576+0000","last_became_peered":"2024-09-11T00:14:18.642576+0000","last_unstale":"2024-09-11T00:14:25.443565+0000","last_undegraded":"2024-09-11T00:14:25.443565+0000","last_fullsized":"2024-09-11T00:14:25.443565+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_clean_scrub_stamp":"2024-09-11T00:14:17.606538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:49:46.087276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:25.448220+0000","last_change":"2024-09-11T00:14:18.634965+0000","last_active":"2024-09-11T00:14:25.448220+0000","last_peered":"2024-09-11T00:14:25.448220+0000","last_clean":"2024-09-11T00:14:25.448220+0000","last_became_active":"2024-09-11T00:14:18.634667+0000","last_became_peered":"2024-09-11T00:14:18.634667+0000","last_unstale":"2024-09-11T00:14:25.448220+0000","last_undegraded":"2024-09-11T00:14:25.448220+0000","last_fullsized":"2024-09-11T00:14:25.448220+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_clean_scrub_stamp":"2024-09-11T00:14:17.606538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:05:38.063905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:23.650745+0000","last_change":"2024-09-11T00:14:18.645434+0000","last_active":"2024-09-11T00:14:23.650745+0000","last_peered":"2024-09-11T00:14:23.650745+0000","last_clean":"2024-09-11T00:14:23.650745+0000","last_became_active":"2024-09-11T00:14:18.645012+0000","last_became_peered":"2024-09-11T00:14:18.645012+0000","last_unstale":"2024-09-11T00:14:23.650745+0000","last_undegraded":"2024-09-11T00:14:23.650745+0000","last_fullsized":"2024-09-11T00:14:23.650745+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_clean_scrub_stamp":"2024-09-11T00:14:17.606538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:07:37.621540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:23.650343+0000","last_change":"2024-09-11T00:14:18.635751+0000","last_active":"2024-09-11T00:14:23.650343+0000","last_peered":"2024-09-11T00:14:23.650343+0000","last_clean":"2024-09-11T00:14:23.650343+0000","last_became_active":"2024-09-11T00:14:18.635450+0000","last_became_peered":"2024-09-11T00:14:18.635450+0000","last_unstale":"2024-09-11T00:14:23.650343+0000","last_undegraded":"2024-09-11T00:14:23.650343+0000","last_fullsized":"2024-09-11T00:14:23.650343+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_clean_scrub_stamp":"2024-09-11T00:14:17.606538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:13:02.693352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:25.448536+0000","last_change":"2024-09-11T00:14:18.623006+0000","last_active":"2024-09-11T00:14:25.448536+0000","last_peered":"2024-09-11T00:14:25.448536+0000","last_clean":"2024-09-11T00:14:25.448536+0000","last_became_active":"2024-09-11T00:14:18.622744+0000","last_became_peered":"2024-09-11T00:14:18.622744+0000","last_unstale":"2024-09-11T00:14:25.448536+0000","last_undegraded":"2024-09-11T00:14:25.448536+0000","last_fullsized":"2024-09-11T00:14:25.448536+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_clean_scrub_stamp":"2024-09-11T00:14:17.606538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:25:01.082594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:24.883243+0000","last_change":"2024-09-11T00:14:18.631985+0000","last_active":"2024-09-11T00:14:24.883243+0000","last_peered":"2024-09-11T00:14:24.883243+0000","last_clean":"2024-09-11T00:14:24.883243+0000","last_became_active":"2024-09-11T00:14:18.631307+0000","last_became_peered":"2024-09-11T00:14:18.631307+0000","last_unstale":"2024-09-11T00:14:24.883243+0000","last_undegraded":"2024-09-11T00:14:24.883243+0000","last_fullsized":"2024-09-11T00:14:24.883243+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_clean_scrub_stamp":"2024-09-11T00:14:17.606538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:40:30.015285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:23.648594+0000","last_change":"2024-09-11T00:14:18.633438+0000","last_active":"2024-09-11T00:14:23.648594+0000","last_peered":"2024-09-11T00:14:23.648594+0000","last_clean":"2024-09-11T00:14:23.648594+0000","last_became_active":"2024-09-11T00:14:18.633192+0000","last_became_peered":"2024-09-11T00:14:18.633192+0000","last_unstale":"2024-09-11T00:14:23.648594+0000","last_undegraded":"2024-09-11T00:14:23.648594+0000","last_fullsized":"2024-09-11T00:14:23.648594+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_clean_scrub_stamp":"2024-09-11T00:14:17.606538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:13:02.693352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:23.652159+0000","last_change":"2024-09-11T00:14:18.640308+0000","last_active":"2024-09-11T00:14:23.652159+0000","last_peered":"2024-09-11T00:14:23.652159+0000","last_clean":"2024-09-11T00:14:23.652159+0000","last_became_active":"2024-09-11T00:14:18.640051+0000","last_became_peered":"2024-09-11T00:14:18.640051+0000","last_unstale":"2024-09-11T00:14:23.652159+0000","last_undegraded":"2024-09-11T00:14:23.652159+0000","last_fullsized":"2024-09-11T00:14:23.652159+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_clean_scrub_stamp":"2024-09-11T00:14:17.606538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:11:16.975202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:24.935109+0000","last_change":"2024-09-11T00:14:18.636880+0000","last_active":"2024-09-11T00:14:24.935109+0000","last_peered":"2024-09-11T00:14:24.935109+0000","last_clean":"2024-09-11T00:14:24.935109+0000","last_became_active":"2024-09-11T00:14:18.636592+0000","last_became_peered":"2024-09-11T00:14:18.636592+0000","last_unstale":"2024-09-11T00:14:24.935109+0000","last_undegraded":"2024-09-11T00:14:24.935109+0000","last_fullsized":"2024-09-11T00:14:24.935109+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_clean_scrub_stamp":"2024-09-11T00:14:17.606538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:05:21.082012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:24.935192+0000","last_change":"2024-09-11T00:14:18.638064+0000","last_active":"2024-09-11T00:14:24.935192+0000","last_peered":"2024-09-11T00:14:24.935192+0000","last_clean":"2024-09-11T00:14:24.935192+0000","last_became_active":"2024-09-11T00:14:18.637558+0000","last_became_peered":"2024-09-11T00:14:18.637558+0000","last_unstale":"2024-09-11T00:14:24.935192+0000","last_undegraded":"2024-09-11T00:14:24.935192+0000","last_fullsized":"2024-09-11T00:14:24.935192+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_clean_scrub_stamp":"2024-09-11T00:14:17.606538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:09:24.787612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:25.443755+0000","last_change":"2024-09-11T00:14:18.641166+0000","last_active":"2024-09-11T00:14:25.443755+0000","last_peered":"2024-09-11T00:14:25.443755+0000","last_clean":"2024-09-11T00:14:25.443755+0000","last_became_active":"2024-09-11T00:14:18.640456+0000","last_became_peered":"2024-09-11T00:14:18.640456+0000","last_unstale":"2024-09-11T00:14:25.443755+0000","last_undegraded":"2024-09-11T00:14:25.443755+0000","last_fullsized":"2024-09-11T00:14:25.443755+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_clean_scrub_stamp":"2024-09-11T00:14:17.606538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:12:52.415152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:23.648235+0000","last_change":"2024-09-11T00:14:18.626919+0000","last_active":"2024-09-11T00:14:23.648235+0000","last_peered":"2024-09-11T00:14:23.648235+0000","last_clean":"2024-09-11T00:14:23.648235+0000","last_became_active":"2024-09-11T00:14:18.626280+0000","last_became_peered":"2024-09-11T00:14:18.626280+0000","last_unstale":"2024-09-11T00:14:23.648235+0000","last_undegraded":"2024-09-11T00:14:23.648235+0000","last_fullsized":"2024-09-11T00:14:23.648235+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_clean_scrub_stamp":"2024-09-11T00:14:17.606538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:29:21.396079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:25.443235+0000","last_change":"2024-09-11T00:14:18.640550+0000","last_active":"2024-09-11T00:14:25.443235+0000","last_peered":"2024-09-11T00:14:25.443235+0000","last_clean":"2024-09-11T00:14:25.443235+0000","last_became_active":"2024-09-11T00:14:18.640248+0000","last_became_peered":"2024-09-11T00:14:18.640248+0000","last_unstale":"2024-09-11T00:14:25.443235+0000","last_undegraded":"2024-09-11T00:14:25.443235+0000","last_fullsized":"2024-09-11T00:14:25.443235+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_clean_scrub_stamp":"2024-09-11T00:14:17.606538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:51:39.692232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:23.651967+0000","last_change":"2024-09-11T00:14:18.631295+0000","last_active":"2024-09-11T00:14:23.651967+0000","last_peered":"2024-09-11T00:14:23.651967+0000","last_clean":"2024-09-11T00:14:23.651967+0000","last_became_active":"2024-09-11T00:14:18.630629+0000","last_became_peered":"2024-09-11T00:14:18.630629+0000","last_unstale":"2024-09-11T00:14:23.651967+0000","last_undegraded":"2024-09-11T00:14:23.651967+0000","last_fullsized":"2024-09-11T00:14:23.651967+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_clean_scrub_stamp":"2024-09-11T00:14:17.606538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:11:01.606959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:25.443198+0000","last_change":"2024-09-11T00:14:18.632354+0000","last_active":"2024-09-11T00:14:25.443198+0000","last_peered":"2024-09-11T00:14:25.443198+0000","last_clean":"2024-09-11T00:14:25.443198+0000","last_became_active":"2024-09-11T00:14:18.632105+0000","last_became_peered":"2024-09-11T00:14:18.632105+0000","last_unstale":"2024-09-11T00:14:25.443198+0000","last_undegraded":"2024-09-11T00:14:25.443198+0000","last_fullsized":"2024-09-11T00:14:25.443198+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_clean_scrub_stamp":"2024-09-11T00:14:17.606538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:28:22.300564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:23.650364+0000","last_change":"2024-09-11T00:14:18.630513+0000","last_active":"2024-09-11T00:14:23.650364+0000","last_peered":"2024-09-11T00:14:23.650364+0000","last_clean":"2024-09-11T00:14:23.650364+0000","last_became_active":"2024-09-11T00:14:18.629735+0000","last_became_peered":"2024-09-11T00:14:18.629735+0000","last_unstale":"2024-09-11T00:14:23.650364+0000","last_undegraded":"2024-09-11T00:14:23.650364+0000","last_fullsized":"2024-09-11T00:14:23.650364+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_clean_scrub_stamp":"2024-09-11T00:14:17.606538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:28:22.300564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:24.883388+0000","last_change":"2024-09-11T00:14:18.630607+0000","last_active":"2024-09-11T00:14:24.883388+0000","last_peered":"2024-09-11T00:14:24.883388+0000","last_clean":"2024-09-11T00:14:24.883388+0000","last_became_active":"2024-09-11T00:14:18.629273+0000","last_became_peered":"2024-09-11T00:14:18.629273+0000","last_unstale":"2024-09-11T00:14:24.883388+0000","last_undegraded":"2024-09-11T00:14:24.883388+0000","last_fullsized":"2024-09-11T00:14:24.883388+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_clean_scrub_stamp":"2024-09-11T00:14:17.606538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:41:33.040042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:25.448538+0000","last_change":"2024-09-11T00:14:18.628576+0000","last_active":"2024-09-11T00:14:25.448538+0000","last_peered":"2024-09-11T00:14:25.448538+0000","last_clean":"2024-09-11T00:14:25.448538+0000","last_became_active":"2024-09-11T00:14:18.628238+0000","last_became_peered":"2024-09-11T00:14:18.628238+0000","last_unstale":"2024-09-11T00:14:25.448538+0000","last_undegraded":"2024-09-11T00:14:25.448538+0000","last_fullsized":"2024-09-11T00:14:25.448538+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_clean_scrub_stamp":"2024-09-11T00:14:17.606538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:49:06.208715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:25.443654+0000","last_change":"2024-09-11T00:14:18.644648+0000","last_active":"2024-09-11T00:14:25.443654+0000","last_peered":"2024-09-11T00:14:25.443654+0000","last_clean":"2024-09-11T00:14:25.443654+0000","last_became_active":"2024-09-11T00:14:18.644076+0000","last_became_peered":"2024-09-11T00:14:18.644076+0000","last_unstale":"2024-09-11T00:14:25.443654+0000","last_undegraded":"2024-09-11T00:14:25.443654+0000","last_fullsized":"2024-09-11T00:14:25.443654+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_clean_scrub_stamp":"2024-09-11T00:14:17.606538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:07:37.621540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509449,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27864,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343976,"statfs":{"total":96636764160,"available":96608231424,"internally_reserved":0,"allocated":856064,"data_stored":693611,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509449,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":262144,"data_stored":102751,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509448,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":270336,"data_stored":102787,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509448,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":270336,"data_stored":106503,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509450,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":266240,"data_stored":102821,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509449,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27872,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343968,"statfs":{"total":96636764160,"available":96608223232,"internally_reserved":0,"allocated":864256,"data_stored":693667,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542153,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":258048,"data_stored":102661,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574857,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":270336,"data_stored":106503,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T00:14:38.638 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T00:14:38.775 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:38.773+0000 7f69086b6640 1 -- 172.21.15.92:0/542189899 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6900144780 msgr2=0x7f69000b3da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:38.775 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:38.773+0000 7f69086b6640 1 --2- 172.21.15.92:0/542189899 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6900144780 0x7f69000b3da0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f68f0005fd0 tx=0x7f68f002aa10 comp rx=0 tx=0).stop 2024-09-11T00:14:38.775 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:38.773+0000 7f69086b6640 1 -- 172.21.15.92:0/542189899 shutdown_connections 2024-09-11T00:14:38.775 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:38.773+0000 7f69086b6640 1 --2- 172.21.15.92:0/542189899 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6900072680 0x7f6900072aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:38.775 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:38.773+0000 7f69086b6640 1 --2- 172.21.15.92:0/542189899 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6900144780 0x7f69000b3da0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:38.776 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:38.773+0000 7f69086b6640 1 -- 172.21.15.92:0/542189899 >> 172.21.15.92:0/542189899 conn(0x7f69000b1760 msgr2=0x7f69000b1b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:14:38.776 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:38.773+0000 7f69086b6640 1 -- 172.21.15.92:0/542189899 shutdown_connections 2024-09-11T00:14:38.776 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:38.773+0000 7f69086b6640 1 -- 172.21.15.92:0/542189899 wait complete. 2024-09-11T00:14:38.776 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:38.774+0000 7f69086b6640 1 Processor -- start 2024-09-11T00:14:38.776 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:38.774+0000 7f69086b6640 1 -- start start 2024-09-11T00:14:38.778 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:38.775+0000 7f69086b6640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6900072680 0x7f69001f59e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:38.778 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:38.775+0000 7f69086b6640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f69000ceb00 0x7f6900150ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:38.778 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:38.775+0000 7f69086b6640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6900144780 0x7f690013f0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:38.779 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:38.775+0000 7f69086b6640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f690015d070 con 0x7f69000ceb00 2024-09-11T00:14:38.779 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:38.775+0000 7f69086b6640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f690015cef0 con 0x7f6900144780 2024-09-11T00:14:38.779 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:38.775+0000 7f69086b6640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f69000cef70 con 0x7f6900072680 2024-09-11T00:14:38.779 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:38.775+0000 7f6905c51640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f69000ceb00 0x7f6900150ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:38.779 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:38.775+0000 7f6905c51640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f69000ceb00 0x7f6900150ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:50264/0 (socket says 172.21.15.92:50264) 2024-09-11T00:14:38.779 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:38.775+0000 7f6905c51640 1 -- 172.21.15.92:0/2223827281 learned_addr learned my addr 172.21.15.92:0/2223827281 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-11T00:14:38.779 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:38.775+0000 7f6906452640 1 --2- 172.21.15.92:0/2223827281 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6900072680 0x7f69001f59e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:38.779 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:38.776+0000 7f6906c53640 1 --2- 172.21.15.92:0/2223827281 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6900144780 0x7f690013f0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:38.779 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:38.776+0000 7f6905c51640 1 -- 172.21.15.92:0/2223827281 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6900072680 msgr2=0x7f69001f59e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:38.779 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:38.776+0000 7f6905c51640 1 --2- 172.21.15.92:0/2223827281 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6900072680 0x7f69001f59e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:38.779 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:38.776+0000 7f6905c51640 1 -- 172.21.15.92:0/2223827281 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6900144780 msgr2=0x7f690013f0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:38.779 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:38.776+0000 7f6905c51640 1 --2- 172.21.15.92:0/2223827281 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6900144780 0x7f690013f0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:38.779 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:38.776+0000 7f6905c51640 1 -- 172.21.15.92:0/2223827281 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6900150400 con 0x7f69000ceb00 2024-09-11T00:14:38.780 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:38.776+0000 7f6906c53640 1 --2- 172.21.15.92:0/2223827281 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6900144780 0x7f690013f0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:14:38.780 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:38.776+0000 7f6905c51640 1 --2- 172.21.15.92:0/2223827281 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f69000ceb00 0x7f6900150ec0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f68f400d770 tx=0x7f68f400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:14:38.780 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:38.776+0000 7f68feffd640 1 -- 172.21.15.92:0/2223827281 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68f4017070 con 0x7f69000ceb00 2024-09-11T00:14:38.780 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:38.776+0000 7f68feffd640 1 -- 172.21.15.92:0/2223827281 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f68f4009d20 con 0x7f69000ceb00 2024-09-11T00:14:38.780 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:38.776+0000 7f69086b6640 1 -- 172.21.15.92:0/2223827281 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f690013f880 con 0x7f69000ceb00 2024-09-11T00:14:38.780 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:38.776+0000 7f68feffd640 1 -- 172.21.15.92:0/2223827281 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68f4005280 con 0x7f69000ceb00 2024-09-11T00:14:38.780 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:38.776+0000 7f69086b6640 1 -- 172.21.15.92:0/2223827281 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69001506c0 con 0x7f69000ceb00 2024-09-11T00:14:38.780 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:38.777+0000 7f69086b6640 1 -- 172.21.15.92:0/2223827281 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f690006ad20 con 0x7f69000ceb00 2024-09-11T00:14:38.781 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:38.778+0000 7f68feffd640 1 -- 172.21.15.92:0/2223827281 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f68f4005420 con 0x7f69000ceb00 2024-09-11T00:14:38.781 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:38.778+0000 7f68feffd640 1 --2- 172.21.15.92:0/2223827281 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f68ec077f70 0x7f68ec07a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:38.781 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:38.778+0000 7f68feffd640 1 -- 172.21.15.92:0/2223827281 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f68f409a270 con 0x7f69000ceb00 2024-09-11T00:14:38.781 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:38.778+0000 7f6906452640 1 --2- 172.21.15.92:0/2223827281 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f68ec077f70 0x7f68ec07a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:38.781 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:38.779+0000 7f6906452640 1 --2- 172.21.15.92:0/2223827281 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f68ec077f70 0x7f68ec07a430 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f68f0035000 tx=0x7f68f0004ab0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:14:38.783 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:38.782+0000 7f68feffd640 1 -- 172.21.15.92:0/2223827281 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f690006ad20 con 0x7f69000ceb00 2024-09-11T00:14:38.957 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:38.955+0000 7f69086b6640 1 -- 172.21.15.92:0/2223827281 --> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f69000cf420 con 0x7f68ec077f70 2024-09-11T00:14:38.962 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:38.961+0000 7f68feffd640 1 -- 172.21.15.92:0/2223827281 <== mgr.4100 v2:172.21.15.145:6800/325490785 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332523 (secure 0 0 0) 0x7f69000cf420 con 0x7f68ec077f70 2024-09-11T00:14:38.966 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:14:38.967 INFO:teuthology.orchestra.run.smithi092.stderr:dumped all 2024-09-11T00:14:38.969 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:38.964+0000 7f69086b6640 1 -- 172.21.15.92:0/2223827281 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f68ec077f70 msgr2=0x7f68ec07a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:38.969 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:38.964+0000 7f69086b6640 1 --2- 172.21.15.92:0/2223827281 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f68ec077f70 0x7f68ec07a430 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f68f0035000 tx=0x7f68f0004ab0 comp rx=0 tx=0).stop 2024-09-11T00:14:38.969 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:38.964+0000 7f69086b6640 1 -- 172.21.15.92:0/2223827281 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f69000ceb00 msgr2=0x7f6900150ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:38.969 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:38.964+0000 7f69086b6640 1 --2- 172.21.15.92:0/2223827281 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f69000ceb00 0x7f6900150ec0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f68f400d770 tx=0x7f68f400dc30 comp rx=0 tx=0).stop 2024-09-11T00:14:38.969 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:38.964+0000 7f69086b6640 1 -- 172.21.15.92:0/2223827281 shutdown_connections 2024-09-11T00:14:38.969 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:38.964+0000 7f69086b6640 1 --2- 172.21.15.92:0/2223827281 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f68ec077f70 0x7f68ec07a430 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:38.969 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:38.964+0000 7f69086b6640 1 --2- 172.21.15.92:0/2223827281 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6900144780 0x7f690013f0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:38.970 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:38.964+0000 7f69086b6640 1 --2- 172.21.15.92:0/2223827281 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f69000ceb00 0x7f6900150ec0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:38.970 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:38.964+0000 7f69086b6640 1 --2- 172.21.15.92:0/2223827281 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6900072680 0x7f69001f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:38.970 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:38.964+0000 7f69086b6640 1 -- 172.21.15.92:0/2223827281 >> 172.21.15.92:0/2223827281 conn(0x7f69000b1760 msgr2=0x7f690015ee60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:14:38.970 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:38.965+0000 7f69086b6640 1 -- 172.21.15.92:0/2223827281 shutdown_connections 2024-09-11T00:14:38.970 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:38.965+0000 7f69086b6640 1 -- 172.21.15.92:0/2223827281 wait complete. 2024-09-11T00:14:38.977 INFO:teuthology.orchestra.run.smithi092.stdout:{"pg_ready":true,"pg_map":{"version":35,"stamp":"2024-09-11T00:14:38.278208+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":149,"num_write_kb":1646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":114,"ondisk_log_size":114,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219464,"kb_used_data":3240,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755256,"statfs":{"total":773094113280,"available":772869382144,"internally_reserved":0,"allocated":3317760,"data_stored":2011304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2230,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003730"},"pg_stats":[{"pgid":"2.1f","version":"20'4","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:24.883591+0000","last_change":"2024-09-11T00:14:17.626124+0000","last_active":"2024-09-11T00:14:24.883591+0000","last_peered":"2024-09-11T00:14:24.883591+0000","last_clean":"2024-09-11T00:14:24.883591+0000","last_became_active":"2024-09-11T00:14:17.625641+0000","last_became_peered":"2024-09-11T00:14:17.625641+0000","last_unstale":"2024-09-11T00:14:24.883591+0000","last_undegraded":"2024-09-11T00:14:24.883591+0000","last_fullsized":"2024-09-11T00:14:24.883591+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:16.598908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:16.598908+0000","last_clean_scrub_stamp":"2024-09-11T00:14:16.598908+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:34:04.062752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:23.649065+0000","last_change":"2024-09-11T00:14:18.635793+0000","last_active":"2024-09-11T00:14:23.649065+0000","last_peered":"2024-09-11T00:14:23.649065+0000","last_clean":"2024-09-11T00:14:23.649065+0000","last_became_active":"2024-09-11T00:14:18.635544+0000","last_became_peered":"2024-09-11T00:14:18.635544+0000","last_unstale":"2024-09-11T00:14:23.649065+0000","last_undegraded":"2024-09-11T00:14:23.649065+0000","last_fullsized":"2024-09-11T00:14:23.649065+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_clean_scrub_stamp":"2024-09-11T00:14:17.606538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:24:44.702294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:23.648231+0000","last_change":"2024-09-11T00:14:22.691295+0000","last_active":"2024-09-11T00:14:23.648231+0000","last_peered":"2024-09-11T00:14:23.648231+0000","last_clean":"2024-09-11T00:14:23.648231+0000","last_became_active":"2024-09-11T00:14:22.690445+0000","last_became_peered":"2024-09-11T00:14:22.690445+0000","last_unstale":"2024-09-11T00:14:23.648231+0000","last_undegraded":"2024-09-11T00:14:23.648231+0000","last_fullsized":"2024-09-11T00:14:23.648231+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:21.633629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:21.633629+0000","last_clean_scrub_stamp":"2024-09-11T00:14:21.633629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:15:47.491554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:23.649169+0000","last_change":"2024-09-11T00:14:17.627802+0000","last_active":"2024-09-11T00:14:23.649169+0000","last_peered":"2024-09-11T00:14:23.649169+0000","last_clean":"2024-09-11T00:14:23.649169+0000","last_became_active":"2024-09-11T00:14:17.627530+0000","last_became_peered":"2024-09-11T00:14:17.627530+0000","last_unstale":"2024-09-11T00:14:23.649169+0000","last_undegraded":"2024-09-11T00:14:23.649169+0000","last_fullsized":"2024-09-11T00:14:23.649169+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:16.598908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:16.598908+0000","last_clean_scrub_stamp":"2024-09-11T00:14:16.598908+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:34:04.062752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:24.883447+0000","last_change":"2024-09-11T00:14:18.632474+0000","last_active":"2024-09-11T00:14:24.883447+0000","last_peered":"2024-09-11T00:14:24.883447+0000","last_clean":"2024-09-11T00:14:24.883447+0000","last_became_active":"2024-09-11T00:14:18.631284+0000","last_became_peered":"2024-09-11T00:14:18.631284+0000","last_unstale":"2024-09-11T00:14:24.883447+0000","last_undegraded":"2024-09-11T00:14:24.883447+0000","last_fullsized":"2024-09-11T00:14:24.883447+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_clean_scrub_stamp":"2024-09-11T00:14:17.606538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:25:01.082594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:23.650003+0000","last_change":"2024-09-11T00:14:22.677620+0000","last_active":"2024-09-11T00:14:23.650003+0000","last_peered":"2024-09-11T00:14:23.650003+0000","last_clean":"2024-09-11T00:14:23.650003+0000","last_became_active":"2024-09-11T00:14:22.677257+0000","last_became_peered":"2024-09-11T00:14:22.677257+0000","last_unstale":"2024-09-11T00:14:23.650003+0000","last_undegraded":"2024-09-11T00:14:23.650003+0000","last_fullsized":"2024-09-11T00:14:23.650003+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:21.633629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:21.633629+0000","last_clean_scrub_stamp":"2024-09-11T00:14:21.633629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:21:42.822631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:25.443495+0000","last_change":"2024-09-11T00:14:17.636163+0000","last_active":"2024-09-11T00:14:25.443495+0000","last_peered":"2024-09-11T00:14:25.443495+0000","last_clean":"2024-09-11T00:14:25.443495+0000","last_became_active":"2024-09-11T00:14:17.635781+0000","last_became_peered":"2024-09-11T00:14:17.635781+0000","last_unstale":"2024-09-11T00:14:25.443495+0000","last_undegraded":"2024-09-11T00:14:25.443495+0000","last_fullsized":"2024-09-11T00:14:25.443495+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:16.598908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:16.598908+0000","last_clean_scrub_stamp":"2024-09-11T00:14:16.598908+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:17:54.010379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:23.650820+0000","last_change":"2024-09-11T00:14:18.632344+0000","last_active":"2024-09-11T00:14:23.650820+0000","last_peered":"2024-09-11T00:14:23.650820+0000","last_clean":"2024-09-11T00:14:23.650820+0000","last_became_active":"2024-09-11T00:14:18.632058+0000","last_became_peered":"2024-09-11T00:14:18.632058+0000","last_unstale":"2024-09-11T00:14:23.650820+0000","last_undegraded":"2024-09-11T00:14:23.650820+0000","last_fullsized":"2024-09-11T00:14:23.650820+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_clean_scrub_stamp":"2024-09-11T00:14:17.606538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:41:28.876392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:23.650371+0000","last_change":"2024-09-11T00:14:22.675694+0000","last_active":"2024-09-11T00:14:23.650371+0000","last_peered":"2024-09-11T00:14:23.650371+0000","last_clean":"2024-09-11T00:14:23.650371+0000","last_became_active":"2024-09-11T00:14:22.675123+0000","last_became_peered":"2024-09-11T00:14:22.675123+0000","last_unstale":"2024-09-11T00:14:23.650371+0000","last_undegraded":"2024-09-11T00:14:23.650371+0000","last_fullsized":"2024-09-11T00:14:23.650371+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:21.633629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:21.633629+0000","last_clean_scrub_stamp":"2024-09-11T00:14:21.633629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:55:42.669376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:25.443208+0000","last_change":"2024-09-11T00:14:17.634109+0000","last_active":"2024-09-11T00:14:25.443208+0000","last_peered":"2024-09-11T00:14:25.443208+0000","last_clean":"2024-09-11T00:14:25.443208+0000","last_became_active":"2024-09-11T00:14:17.633815+0000","last_became_peered":"2024-09-11T00:14:17.633815+0000","last_unstale":"2024-09-11T00:14:25.443208+0000","last_undegraded":"2024-09-11T00:14:25.443208+0000","last_fullsized":"2024-09-11T00:14:25.443208+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:16.598908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:16.598908+0000","last_clean_scrub_stamp":"2024-09-11T00:14:16.598908+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:43:47.266406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:23.651249+0000","last_change":"2024-09-11T00:14:18.633804+0000","last_active":"2024-09-11T00:14:23.651249+0000","last_peered":"2024-09-11T00:14:23.651249+0000","last_clean":"2024-09-11T00:14:23.651249+0000","last_became_active":"2024-09-11T00:14:18.633530+0000","last_became_peered":"2024-09-11T00:14:18.633530+0000","last_unstale":"2024-09-11T00:14:23.651249+0000","last_undegraded":"2024-09-11T00:14:23.651249+0000","last_fullsized":"2024-09-11T00:14:23.651249+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_clean_scrub_stamp":"2024-09-11T00:14:17.606538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:28:10.132283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:23.650244+0000","last_change":"2024-09-11T00:14:22.674158+0000","last_active":"2024-09-11T00:14:23.650244+0000","last_peered":"2024-09-11T00:14:23.650244+0000","last_clean":"2024-09-11T00:14:23.650244+0000","last_became_active":"2024-09-11T00:14:22.673563+0000","last_became_peered":"2024-09-11T00:14:22.673563+0000","last_unstale":"2024-09-11T00:14:23.650244+0000","last_undegraded":"2024-09-11T00:14:23.650244+0000","last_fullsized":"2024-09-11T00:14:23.650244+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:21.633629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:21.633629+0000","last_clean_scrub_stamp":"2024-09-11T00:14:21.633629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:34:20.263638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:24.934581+0000","last_change":"2024-09-11T00:14:18.641584+0000","last_active":"2024-09-11T00:14:24.934581+0000","last_peered":"2024-09-11T00:14:24.934581+0000","last_clean":"2024-09-11T00:14:24.934581+0000","last_became_active":"2024-09-11T00:14:18.641317+0000","last_became_peered":"2024-09-11T00:14:18.641317+0000","last_unstale":"2024-09-11T00:14:24.934581+0000","last_undegraded":"2024-09-11T00:14:24.934581+0000","last_fullsized":"2024-09-11T00:14:24.934581+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_clean_scrub_stamp":"2024-09-11T00:14:17.606538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:44:05.910673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:25.443377+0000","last_change":"2024-09-11T00:14:17.636350+0000","last_active":"2024-09-11T00:14:25.443377+0000","last_peered":"2024-09-11T00:14:25.443377+0000","last_clean":"2024-09-11T00:14:25.443377+0000","last_became_active":"2024-09-11T00:14:17.636071+0000","last_became_peered":"2024-09-11T00:14:17.636071+0000","last_unstale":"2024-09-11T00:14:25.443377+0000","last_undegraded":"2024-09-11T00:14:25.443377+0000","last_fullsized":"2024-09-11T00:14:25.443377+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:16.598908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:16.598908+0000","last_clean_scrub_stamp":"2024-09-11T00:14:16.598908+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:01:31.822965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:23.651799+0000","last_change":"2024-09-11T00:14:22.669178+0000","last_active":"2024-09-11T00:14:23.651799+0000","last_peered":"2024-09-11T00:14:23.651799+0000","last_clean":"2024-09-11T00:14:23.651799+0000","last_became_active":"2024-09-11T00:14:22.668916+0000","last_became_peered":"2024-09-11T00:14:22.668916+0000","last_unstale":"2024-09-11T00:14:23.651799+0000","last_undegraded":"2024-09-11T00:14:23.651799+0000","last_fullsized":"2024-09-11T00:14:23.651799+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:21.633629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:21.633629+0000","last_clean_scrub_stamp":"2024-09-11T00:14:21.633629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:52:50.029560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:23.648642+0000","last_change":"2024-09-11T00:14:18.632035+0000","last_active":"2024-09-11T00:14:23.648642+0000","last_peered":"2024-09-11T00:14:23.648642+0000","last_clean":"2024-09-11T00:14:23.648642+0000","last_became_active":"2024-09-11T00:14:18.631678+0000","last_became_peered":"2024-09-11T00:14:18.631678+0000","last_unstale":"2024-09-11T00:14:23.648642+0000","last_undegraded":"2024-09-11T00:14:23.648642+0000","last_fullsized":"2024-09-11T00:14:23.648642+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_clean_scrub_stamp":"2024-09-11T00:14:17.606538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:19:35.541198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:25.448740+0000","last_change":"2024-09-11T00:14:17.632840+0000","last_active":"2024-09-11T00:14:25.448740+0000","last_peered":"2024-09-11T00:14:25.448740+0000","last_clean":"2024-09-11T00:14:25.448740+0000","last_became_active":"2024-09-11T00:14:17.632551+0000","last_became_peered":"2024-09-11T00:14:17.632551+0000","last_unstale":"2024-09-11T00:14:25.448740+0000","last_undegraded":"2024-09-11T00:14:25.448740+0000","last_fullsized":"2024-09-11T00:14:25.448740+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:16.598908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:16.598908+0000","last_clean_scrub_stamp":"2024-09-11T00:14:16.598908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:11:19.690215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:23.651772+0000","last_change":"2024-09-11T00:14:22.675212+0000","last_active":"2024-09-11T00:14:23.651772+0000","last_peered":"2024-09-11T00:14:23.651772+0000","last_clean":"2024-09-11T00:14:23.651772+0000","last_became_active":"2024-09-11T00:14:22.674046+0000","last_became_peered":"2024-09-11T00:14:22.674046+0000","last_unstale":"2024-09-11T00:14:23.651772+0000","last_undegraded":"2024-09-11T00:14:23.651772+0000","last_fullsized":"2024-09-11T00:14:23.651772+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:21.633629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:21.633629+0000","last_clean_scrub_stamp":"2024-09-11T00:14:21.633629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:58:10.766640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:23.648499+0000","last_change":"2024-09-11T00:14:18.625163+0000","last_active":"2024-09-11T00:14:23.648499+0000","last_peered":"2024-09-11T00:14:23.648499+0000","last_clean":"2024-09-11T00:14:23.648499+0000","last_became_active":"2024-09-11T00:14:18.624834+0000","last_became_peered":"2024-09-11T00:14:18.624834+0000","last_unstale":"2024-09-11T00:14:23.648499+0000","last_undegraded":"2024-09-11T00:14:23.648499+0000","last_fullsized":"2024-09-11T00:14:23.648499+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_clean_scrub_stamp":"2024-09-11T00:14:17.606538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:27:39.530704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:25.448769+0000","last_change":"2024-09-11T00:14:17.627946+0000","last_active":"2024-09-11T00:14:25.448769+0000","last_peered":"2024-09-11T00:14:25.448769+0000","last_clean":"2024-09-11T00:14:25.448769+0000","last_became_active":"2024-09-11T00:14:17.627667+0000","last_became_peered":"2024-09-11T00:14:17.627667+0000","last_unstale":"2024-09-11T00:14:25.448769+0000","last_undegraded":"2024-09-11T00:14:25.448769+0000","last_fullsized":"2024-09-11T00:14:25.448769+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:16.598908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:16.598908+0000","last_clean_scrub_stamp":"2024-09-11T00:14:16.598908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:01:31.822965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:25.448522+0000","last_change":"2024-09-11T00:14:22.692404+0000","last_active":"2024-09-11T00:14:25.448522+0000","last_peered":"2024-09-11T00:14:25.448522+0000","last_clean":"2024-09-11T00:14:25.448522+0000","last_became_active":"2024-09-11T00:14:22.691884+0000","last_became_peered":"2024-09-11T00:14:22.691884+0000","last_unstale":"2024-09-11T00:14:25.448522+0000","last_undegraded":"2024-09-11T00:14:25.448522+0000","last_fullsized":"2024-09-11T00:14:25.448522+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:21.633629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:21.633629+0000","last_clean_scrub_stamp":"2024-09-11T00:14:21.633629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:38:50.912075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:23.650767+0000","last_change":"2024-09-11T00:14:18.623840+0000","last_active":"2024-09-11T00:14:23.650767+0000","last_peered":"2024-09-11T00:14:23.650767+0000","last_clean":"2024-09-11T00:14:23.650767+0000","last_became_active":"2024-09-11T00:14:18.623528+0000","last_became_peered":"2024-09-11T00:14:18.623528+0000","last_unstale":"2024-09-11T00:14:23.650767+0000","last_undegraded":"2024-09-11T00:14:23.650767+0000","last_fullsized":"2024-09-11T00:14:23.650767+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_clean_scrub_stamp":"2024-09-11T00:14:17.606538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:22:17.854518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:25.442955+0000","last_change":"2024-09-11T00:14:17.633107+0000","last_active":"2024-09-11T00:14:25.442955+0000","last_peered":"2024-09-11T00:14:25.442955+0000","last_clean":"2024-09-11T00:14:25.442955+0000","last_became_active":"2024-09-11T00:14:17.632860+0000","last_became_peered":"2024-09-11T00:14:17.632860+0000","last_unstale":"2024-09-11T00:14:25.442955+0000","last_undegraded":"2024-09-11T00:14:25.442955+0000","last_fullsized":"2024-09-11T00:14:25.442955+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:16.598908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:16.598908+0000","last_clean_scrub_stamp":"2024-09-11T00:14:16.598908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:24:18.954419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:23.651684+0000","last_change":"2024-09-11T00:14:22.673902+0000","last_active":"2024-09-11T00:14:23.651684+0000","last_peered":"2024-09-11T00:14:23.651684+0000","last_clean":"2024-09-11T00:14:23.651684+0000","last_became_active":"2024-09-11T00:14:22.673397+0000","last_became_peered":"2024-09-11T00:14:22.673397+0000","last_unstale":"2024-09-11T00:14:23.651684+0000","last_undegraded":"2024-09-11T00:14:23.651684+0000","last_fullsized":"2024-09-11T00:14:23.651684+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:21.633629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:21.633629+0000","last_clean_scrub_stamp":"2024-09-11T00:14:21.633629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:24:27.330659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:24.883685+0000","last_change":"2024-09-11T00:14:18.632296+0000","last_active":"2024-09-11T00:14:24.883685+0000","last_peered":"2024-09-11T00:14:24.883685+0000","last_clean":"2024-09-11T00:14:24.883685+0000","last_became_active":"2024-09-11T00:14:18.632026+0000","last_became_peered":"2024-09-11T00:14:18.632026+0000","last_unstale":"2024-09-11T00:14:24.883685+0000","last_undegraded":"2024-09-11T00:14:24.883685+0000","last_fullsized":"2024-09-11T00:14:24.883685+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_clean_scrub_stamp":"2024-09-11T00:14:17.606538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:03:25.203629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:24.935388+0000","last_change":"2024-09-11T00:14:17.636547+0000","last_active":"2024-09-11T00:14:24.935388+0000","last_peered":"2024-09-11T00:14:24.935388+0000","last_clean":"2024-09-11T00:14:24.935388+0000","last_became_active":"2024-09-11T00:14:17.636264+0000","last_became_peered":"2024-09-11T00:14:17.636264+0000","last_unstale":"2024-09-11T00:14:24.935388+0000","last_undegraded":"2024-09-11T00:14:24.935388+0000","last_fullsized":"2024-09-11T00:14:24.935388+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:16.598908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:16.598908+0000","last_clean_scrub_stamp":"2024-09-11T00:14:16.598908+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:52:38.739834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:23.650267+0000","last_change":"2024-09-11T00:14:22.688870+0000","last_active":"2024-09-11T00:14:23.650267+0000","last_peered":"2024-09-11T00:14:23.650267+0000","last_clean":"2024-09-11T00:14:23.650267+0000","last_became_active":"2024-09-11T00:14:22.688144+0000","last_became_peered":"2024-09-11T00:14:22.688144+0000","last_unstale":"2024-09-11T00:14:23.650267+0000","last_undegraded":"2024-09-11T00:14:23.650267+0000","last_fullsized":"2024-09-11T00:14:23.650267+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:21.633629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:21.633629+0000","last_clean_scrub_stamp":"2024-09-11T00:14:21.633629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:47:00.821912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:23.649305+0000","last_change":"2024-09-11T00:14:18.644563+0000","last_active":"2024-09-11T00:14:23.649305+0000","last_peered":"2024-09-11T00:14:23.649305+0000","last_clean":"2024-09-11T00:14:23.649305+0000","last_became_active":"2024-09-11T00:14:18.644258+0000","last_became_peered":"2024-09-11T00:14:18.644258+0000","last_unstale":"2024-09-11T00:14:23.649305+0000","last_undegraded":"2024-09-11T00:14:23.649305+0000","last_fullsized":"2024-09-11T00:14:23.649305+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_clean_scrub_stamp":"2024-09-11T00:14:17.606538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:28:22.113765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:25.448636+0000","last_change":"2024-09-11T00:14:17.633279+0000","last_active":"2024-09-11T00:14:25.448636+0000","last_peered":"2024-09-11T00:14:25.448636+0000","last_clean":"2024-09-11T00:14:25.448636+0000","last_became_active":"2024-09-11T00:14:17.633023+0000","last_became_peered":"2024-09-11T00:14:17.633023+0000","last_unstale":"2024-09-11T00:14:25.448636+0000","last_undegraded":"2024-09-11T00:14:25.448636+0000","last_fullsized":"2024-09-11T00:14:25.448636+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:16.598908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:16.598908+0000","last_clean_scrub_stamp":"2024-09-11T00:14:16.598908+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:24:18.954419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:23.648131+0000","last_change":"2024-09-11T00:14:22.689579+0000","last_active":"2024-09-11T00:14:23.648131+0000","last_peered":"2024-09-11T00:14:23.648131+0000","last_clean":"2024-09-11T00:14:23.648131+0000","last_became_active":"2024-09-11T00:14:22.688060+0000","last_became_peered":"2024-09-11T00:14:22.688060+0000","last_unstale":"2024-09-11T00:14:23.648131+0000","last_undegraded":"2024-09-11T00:14:23.648131+0000","last_fullsized":"2024-09-11T00:14:23.648131+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:21.633629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:21.633629+0000","last_clean_scrub_stamp":"2024-09-11T00:14:21.633629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:02:04.039334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:25.448843+0000","last_change":"2024-09-11T00:14:18.622047+0000","last_active":"2024-09-11T00:14:25.448843+0000","last_peered":"2024-09-11T00:14:25.448843+0000","last_clean":"2024-09-11T00:14:25.448843+0000","last_became_active":"2024-09-11T00:14:18.621777+0000","last_became_peered":"2024-09-11T00:14:18.621777+0000","last_unstale":"2024-09-11T00:14:25.448843+0000","last_undegraded":"2024-09-11T00:14:25.448843+0000","last_fullsized":"2024-09-11T00:14:25.448843+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_clean_scrub_stamp":"2024-09-11T00:14:17.606538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:05:45.558170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:25.443646+0000","last_change":"2024-09-11T00:14:17.631489+0000","last_active":"2024-09-11T00:14:25.443646+0000","last_peered":"2024-09-11T00:14:25.443646+0000","last_clean":"2024-09-11T00:14:25.443646+0000","last_became_active":"2024-09-11T00:14:17.631206+0000","last_became_peered":"2024-09-11T00:14:17.631206+0000","last_unstale":"2024-09-11T00:14:25.443646+0000","last_undegraded":"2024-09-11T00:14:25.443646+0000","last_fullsized":"2024-09-11T00:14:25.443646+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:16.598908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:16.598908+0000","last_clean_scrub_stamp":"2024-09-11T00:14:16.598908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:51:33.532444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:24.883278+0000","last_change":"2024-09-11T00:14:22.689420+0000","last_active":"2024-09-11T00:14:24.883278+0000","last_peered":"2024-09-11T00:14:24.883278+0000","last_clean":"2024-09-11T00:14:24.883278+0000","last_became_active":"2024-09-11T00:14:22.689043+0000","last_became_peered":"2024-09-11T00:14:22.689043+0000","last_unstale":"2024-09-11T00:14:24.883278+0000","last_undegraded":"2024-09-11T00:14:24.883278+0000","last_fullsized":"2024-09-11T00:14:24.883278+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:21.633629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:21.633629+0000","last_clean_scrub_stamp":"2024-09-11T00:14:21.633629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:25:22.425586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:23.651349+0000","last_change":"2024-09-11T00:14:18.628564+0000","last_active":"2024-09-11T00:14:23.651349+0000","last_peered":"2024-09-11T00:14:23.651349+0000","last_clean":"2024-09-11T00:14:23.651349+0000","last_became_active":"2024-09-11T00:14:18.628095+0000","last_became_peered":"2024-09-11T00:14:18.628095+0000","last_unstale":"2024-09-11T00:14:23.651349+0000","last_undegraded":"2024-09-11T00:14:23.651349+0000","last_fullsized":"2024-09-11T00:14:23.651349+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_clean_scrub_stamp":"2024-09-11T00:14:17.606538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:51:25.519292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:25.448944+0000","last_change":"2024-09-11T00:14:17.629702+0000","last_active":"2024-09-11T00:14:25.448944+0000","last_peered":"2024-09-11T00:14:25.448944+0000","last_clean":"2024-09-11T00:14:25.448944+0000","last_became_active":"2024-09-11T00:14:17.629450+0000","last_became_peered":"2024-09-11T00:14:17.629450+0000","last_unstale":"2024-09-11T00:14:25.448944+0000","last_undegraded":"2024-09-11T00:14:25.448944+0000","last_fullsized":"2024-09-11T00:14:25.448944+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:16.598908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:16.598908+0000","last_clean_scrub_stamp":"2024-09-11T00:14:16.598908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:52:22.626375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:25.448461+0000","last_change":"2024-09-11T00:14:22.665536+0000","last_active":"2024-09-11T00:14:25.448461+0000","last_peered":"2024-09-11T00:14:25.448461+0000","last_clean":"2024-09-11T00:14:25.448461+0000","last_became_active":"2024-09-11T00:14:22.663100+0000","last_became_peered":"2024-09-11T00:14:22.663100+0000","last_unstale":"2024-09-11T00:14:25.448461+0000","last_undegraded":"2024-09-11T00:14:25.448461+0000","last_fullsized":"2024-09-11T00:14:25.448461+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:21.633629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:21.633629+0000","last_clean_scrub_stamp":"2024-09-11T00:14:21.633629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:28:14.159374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:23.650922+0000","last_change":"2024-09-11T00:14:18.642032+0000","last_active":"2024-09-11T00:14:23.650922+0000","last_peered":"2024-09-11T00:14:23.650922+0000","last_clean":"2024-09-11T00:14:23.650922+0000","last_became_active":"2024-09-11T00:14:18.641783+0000","last_became_peered":"2024-09-11T00:14:18.641783+0000","last_unstale":"2024-09-11T00:14:23.650922+0000","last_undegraded":"2024-09-11T00:14:23.650922+0000","last_fullsized":"2024-09-11T00:14:23.650922+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_clean_scrub_stamp":"2024-09-11T00:14:17.606538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:06:55.661773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:23.652407+0000","last_change":"2024-09-11T00:14:17.630077+0000","last_active":"2024-09-11T00:14:23.652407+0000","last_peered":"2024-09-11T00:14:23.652407+0000","last_clean":"2024-09-11T00:14:23.652407+0000","last_became_active":"2024-09-11T00:14:17.629668+0000","last_became_peered":"2024-09-11T00:14:17.629668+0000","last_unstale":"2024-09-11T00:14:23.652407+0000","last_undegraded":"2024-09-11T00:14:23.652407+0000","last_fullsized":"2024-09-11T00:14:23.652407+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:16.598908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:16.598908+0000","last_clean_scrub_stamp":"2024-09-11T00:14:16.598908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:43:47.266406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:25.448669+0000","last_change":"2024-09-11T00:14:22.674145+0000","last_active":"2024-09-11T00:14:25.448669+0000","last_peered":"2024-09-11T00:14:25.448669+0000","last_clean":"2024-09-11T00:14:25.448669+0000","last_became_active":"2024-09-11T00:14:22.673757+0000","last_became_peered":"2024-09-11T00:14:22.673757+0000","last_unstale":"2024-09-11T00:14:25.448669+0000","last_undegraded":"2024-09-11T00:14:25.448669+0000","last_fullsized":"2024-09-11T00:14:25.448669+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:21.633629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:21.633629+0000","last_clean_scrub_stamp":"2024-09-11T00:14:21.633629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:52:37.859110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:25.448150+0000","last_change":"2024-09-11T00:14:18.621350+0000","last_active":"2024-09-11T00:14:25.448150+0000","last_peered":"2024-09-11T00:14:25.448150+0000","last_clean":"2024-09-11T00:14:25.448150+0000","last_became_active":"2024-09-11T00:14:18.621079+0000","last_became_peered":"2024-09-11T00:14:18.621079+0000","last_unstale":"2024-09-11T00:14:25.448150+0000","last_undegraded":"2024-09-11T00:14:25.448150+0000","last_fullsized":"2024-09-11T00:14:25.448150+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_clean_scrub_stamp":"2024-09-11T00:14:17.606538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:46:52.007701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:25.448126+0000","last_change":"2024-09-11T00:14:17.623009+0000","last_active":"2024-09-11T00:14:25.448126+0000","last_peered":"2024-09-11T00:14:25.448126+0000","last_clean":"2024-09-11T00:14:25.448126+0000","last_became_active":"2024-09-11T00:14:17.622719+0000","last_became_peered":"2024-09-11T00:14:17.622719+0000","last_unstale":"2024-09-11T00:14:25.448126+0000","last_undegraded":"2024-09-11T00:14:25.448126+0000","last_fullsized":"2024-09-11T00:14:25.448126+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:16.598908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:16.598908+0000","last_clean_scrub_stamp":"2024-09-11T00:14:16.598908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:22:22.640376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:25.448720+0000","last_change":"2024-09-11T00:14:22.668160+0000","last_active":"2024-09-11T00:14:25.448720+0000","last_peered":"2024-09-11T00:14:25.448720+0000","last_clean":"2024-09-11T00:14:25.448720+0000","last_became_active":"2024-09-11T00:14:22.667750+0000","last_became_peered":"2024-09-11T00:14:22.667750+0000","last_unstale":"2024-09-11T00:14:25.448720+0000","last_undegraded":"2024-09-11T00:14:25.448720+0000","last_fullsized":"2024-09-11T00:14:25.448720+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:21.633629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:21.633629+0000","last_clean_scrub_stamp":"2024-09-11T00:14:21.633629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:51:29.546383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:24.883081+0000","last_change":"2024-09-11T00:14:18.642039+0000","last_active":"2024-09-11T00:14:24.883081+0000","last_peered":"2024-09-11T00:14:24.883081+0000","last_clean":"2024-09-11T00:14:24.883081+0000","last_became_active":"2024-09-11T00:14:18.641748+0000","last_became_peered":"2024-09-11T00:14:18.641748+0000","last_unstale":"2024-09-11T00:14:24.883081+0000","last_undegraded":"2024-09-11T00:14:24.883081+0000","last_fullsized":"2024-09-11T00:14:24.883081+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_clean_scrub_stamp":"2024-09-11T00:14:17.606538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:47:41.811458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:25.442962+0000","last_change":"2024-09-11T00:14:17.631555+0000","last_active":"2024-09-11T00:14:25.442962+0000","last_peered":"2024-09-11T00:14:25.442962+0000","last_clean":"2024-09-11T00:14:25.442962+0000","last_became_active":"2024-09-11T00:14:17.631295+0000","last_became_peered":"2024-09-11T00:14:17.631295+0000","last_unstale":"2024-09-11T00:14:25.442962+0000","last_undegraded":"2024-09-11T00:14:25.442962+0000","last_fullsized":"2024-09-11T00:14:25.442962+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:16.598908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:16.598908+0000","last_clean_scrub_stamp":"2024-09-11T00:14:16.598908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:31:48.757466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:24.883605+0000","last_change":"2024-09-11T00:14:22.688647+0000","last_active":"2024-09-11T00:14:24.883605+0000","last_peered":"2024-09-11T00:14:24.883605+0000","last_clean":"2024-09-11T00:14:24.883605+0000","last_became_active":"2024-09-11T00:14:22.688255+0000","last_became_peered":"2024-09-11T00:14:22.688255+0000","last_unstale":"2024-09-11T00:14:24.883605+0000","last_undegraded":"2024-09-11T00:14:24.883605+0000","last_fullsized":"2024-09-11T00:14:24.883605+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:21.633629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:21.633629+0000","last_clean_scrub_stamp":"2024-09-11T00:14:21.633629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:12:56.442243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:23.648452+0000","last_change":"2024-09-11T00:14:18.626265+0000","last_active":"2024-09-11T00:14:23.648452+0000","last_peered":"2024-09-11T00:14:23.648452+0000","last_clean":"2024-09-11T00:14:23.648452+0000","last_became_active":"2024-09-11T00:14:18.625997+0000","last_became_peered":"2024-09-11T00:14:18.625997+0000","last_unstale":"2024-09-11T00:14:23.648452+0000","last_undegraded":"2024-09-11T00:14:23.648452+0000","last_fullsized":"2024-09-11T00:14:23.648452+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_clean_scrub_stamp":"2024-09-11T00:14:17.606538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:34:07.533694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:23.651593+0000","last_change":"2024-09-11T00:14:17.627078+0000","last_active":"2024-09-11T00:14:23.651593+0000","last_peered":"2024-09-11T00:14:23.651593+0000","last_clean":"2024-09-11T00:14:23.651593+0000","last_became_active":"2024-09-11T00:14:17.626791+0000","last_became_peered":"2024-09-11T00:14:17.626791+0000","last_unstale":"2024-09-11T00:14:23.651593+0000","last_undegraded":"2024-09-11T00:14:23.651593+0000","last_fullsized":"2024-09-11T00:14:23.651593+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:16.598908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:16.598908+0000","last_clean_scrub_stamp":"2024-09-11T00:14:16.598908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:41:57.300139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":119,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:25.443097+0000","last_change":"2024-09-11T00:14:08.221813+0000","last_active":"2024-09-11T00:14:25.443097+0000","last_peered":"2024-09-11T00:14:25.443097+0000","last_clean":"2024-09-11T00:14:25.443097+0000","last_became_active":"2024-09-11T00:14:08.220663+0000","last_became_peered":"2024-09-11T00:14:08.220663+0000","last_unstale":"2024-09-11T00:14:25.443097+0000","last_undegraded":"2024-09-11T00:14:25.443097+0000","last_fullsized":"2024-09-11T00:14:25.443097+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:06.563107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:06.563107+0000","last_clean_scrub_stamp":"2024-09-11T00:14:06.563107+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:44:49.322583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:24.935219+0000","last_change":"2024-09-11T00:14:22.692059+0000","last_active":"2024-09-11T00:14:24.935219+0000","last_peered":"2024-09-11T00:14:24.935219+0000","last_clean":"2024-09-11T00:14:24.935219+0000","last_became_active":"2024-09-11T00:14:22.691622+0000","last_became_peered":"2024-09-11T00:14:22.691622+0000","last_unstale":"2024-09-11T00:14:24.935219+0000","last_undegraded":"2024-09-11T00:14:24.935219+0000","last_fullsized":"2024-09-11T00:14:24.935219+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:21.633629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:21.633629+0000","last_clean_scrub_stamp":"2024-09-11T00:14:21.633629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:17:20.492407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:25.443365+0000","last_change":"2024-09-11T00:14:18.643287+0000","last_active":"2024-09-11T00:14:25.443365+0000","last_peered":"2024-09-11T00:14:25.443365+0000","last_clean":"2024-09-11T00:14:25.443365+0000","last_became_active":"2024-09-11T00:14:18.642274+0000","last_became_peered":"2024-09-11T00:14:18.642274+0000","last_unstale":"2024-09-11T00:14:25.443365+0000","last_undegraded":"2024-09-11T00:14:25.443365+0000","last_fullsized":"2024-09-11T00:14:25.443365+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_clean_scrub_stamp":"2024-09-11T00:14:17.606538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:28:22.113765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:25.448581+0000","last_change":"2024-09-11T00:14:17.633759+0000","last_active":"2024-09-11T00:14:25.448581+0000","last_peered":"2024-09-11T00:14:25.448581+0000","last_clean":"2024-09-11T00:14:25.448581+0000","last_became_active":"2024-09-11T00:14:17.633445+0000","last_became_peered":"2024-09-11T00:14:17.633445+0000","last_unstale":"2024-09-11T00:14:25.448581+0000","last_undegraded":"2024-09-11T00:14:25.448581+0000","last_fullsized":"2024-09-11T00:14:25.448581+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:16.598908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:16.598908+0000","last_clean_scrub_stamp":"2024-09-11T00:14:16.598908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:52:38.739834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:24.934823+0000","last_change":"2024-09-11T00:14:22.688646+0000","last_active":"2024-09-11T00:14:24.934823+0000","last_peered":"2024-09-11T00:14:24.934823+0000","last_clean":"2024-09-11T00:14:24.934823+0000","last_became_active":"2024-09-11T00:14:22.688254+0000","last_became_peered":"2024-09-11T00:14:22.688254+0000","last_unstale":"2024-09-11T00:14:24.934823+0000","last_undegraded":"2024-09-11T00:14:24.934823+0000","last_fullsized":"2024-09-11T00:14:24.934823+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:21.633629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:21.633629+0000","last_clean_scrub_stamp":"2024-09-11T00:14:21.633629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:12:15.928177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:23.650905+0000","last_change":"2024-09-11T00:14:18.629290+0000","last_active":"2024-09-11T00:14:23.650905+0000","last_peered":"2024-09-11T00:14:23.650905+0000","last_clean":"2024-09-11T00:14:23.650905+0000","last_became_active":"2024-09-11T00:14:18.629028+0000","last_became_peered":"2024-09-11T00:14:18.629028+0000","last_unstale":"2024-09-11T00:14:23.650905+0000","last_undegraded":"2024-09-11T00:14:23.650905+0000","last_fullsized":"2024-09-11T00:14:23.650905+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_clean_scrub_stamp":"2024-09-11T00:14:17.606538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:49:46.087276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:25.448972+0000","last_change":"2024-09-11T00:14:17.634168+0000","last_active":"2024-09-11T00:14:25.448972+0000","last_peered":"2024-09-11T00:14:25.448972+0000","last_clean":"2024-09-11T00:14:25.448972+0000","last_became_active":"2024-09-11T00:14:17.633920+0000","last_became_peered":"2024-09-11T00:14:17.633920+0000","last_unstale":"2024-09-11T00:14:25.448972+0000","last_undegraded":"2024-09-11T00:14:25.448972+0000","last_fullsized":"2024-09-11T00:14:25.448972+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:16.598908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:16.598908+0000","last_clean_scrub_stamp":"2024-09-11T00:14:16.598908+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:31:48.757466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:24.883419+0000","last_change":"2024-09-11T00:14:22.669596+0000","last_active":"2024-09-11T00:14:24.883419+0000","last_peered":"2024-09-11T00:14:24.883419+0000","last_clean":"2024-09-11T00:14:24.883419+0000","last_became_active":"2024-09-11T00:14:22.669123+0000","last_became_peered":"2024-09-11T00:14:22.669123+0000","last_unstale":"2024-09-11T00:14:24.883419+0000","last_undegraded":"2024-09-11T00:14:24.883419+0000","last_fullsized":"2024-09-11T00:14:24.883419+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:21.633629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:21.633629+0000","last_clean_scrub_stamp":"2024-09-11T00:14:21.633629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:07:41.648631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:25.443770+0000","last_change":"2024-09-11T00:14:18.647802+0000","last_active":"2024-09-11T00:14:25.443770+0000","last_peered":"2024-09-11T00:14:25.443770+0000","last_clean":"2024-09-11T00:14:25.443770+0000","last_became_active":"2024-09-11T00:14:18.647512+0000","last_became_peered":"2024-09-11T00:14:18.647512+0000","last_unstale":"2024-09-11T00:14:25.443770+0000","last_undegraded":"2024-09-11T00:14:25.443770+0000","last_fullsized":"2024-09-11T00:14:25.443770+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_clean_scrub_stamp":"2024-09-11T00:14:17.606538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:04:59.988406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:25.448274+0000","last_change":"2024-09-11T00:14:17.624944+0000","last_active":"2024-09-11T00:14:25.448274+0000","last_peered":"2024-09-11T00:14:25.448274+0000","last_clean":"2024-09-11T00:14:25.448274+0000","last_became_active":"2024-09-11T00:14:17.624613+0000","last_became_peered":"2024-09-11T00:14:17.624613+0000","last_unstale":"2024-09-11T00:14:25.448274+0000","last_undegraded":"2024-09-11T00:14:25.448274+0000","last_fullsized":"2024-09-11T00:14:25.448274+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:16.598908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:16.598908+0000","last_clean_scrub_stamp":"2024-09-11T00:14:16.598908+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:30:53.963229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:23.650179+0000","last_change":"2024-09-11T00:14:22.689788+0000","last_active":"2024-09-11T00:14:23.650179+0000","last_peered":"2024-09-11T00:14:23.650179+0000","last_clean":"2024-09-11T00:14:23.650179+0000","last_became_active":"2024-09-11T00:14:22.689360+0000","last_became_peered":"2024-09-11T00:14:22.689360+0000","last_unstale":"2024-09-11T00:14:23.650179+0000","last_undegraded":"2024-09-11T00:14:23.650179+0000","last_fullsized":"2024-09-11T00:14:23.650179+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:21.633629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:21.633629+0000","last_clean_scrub_stamp":"2024-09-11T00:14:21.633629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:07:21.973974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:25.443628+0000","last_change":"2024-09-11T00:14:18.645675+0000","last_active":"2024-09-11T00:14:25.443628+0000","last_peered":"2024-09-11T00:14:25.443628+0000","last_clean":"2024-09-11T00:14:25.443628+0000","last_became_active":"2024-09-11T00:14:18.645400+0000","last_became_peered":"2024-09-11T00:14:18.645400+0000","last_unstale":"2024-09-11T00:14:25.443628+0000","last_undegraded":"2024-09-11T00:14:25.443628+0000","last_fullsized":"2024-09-11T00:14:25.443628+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_clean_scrub_stamp":"2024-09-11T00:14:17.606538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:18:45.202473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:23.652104+0000","last_change":"2024-09-11T00:14:17.634002+0000","last_active":"2024-09-11T00:14:23.652104+0000","last_peered":"2024-09-11T00:14:23.652104+0000","last_clean":"2024-09-11T00:14:23.652104+0000","last_became_active":"2024-09-11T00:14:17.633722+0000","last_became_peered":"2024-09-11T00:14:17.633722+0000","last_unstale":"2024-09-11T00:14:23.652104+0000","last_undegraded":"2024-09-11T00:14:23.652104+0000","last_fullsized":"2024-09-11T00:14:23.652104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:16.598908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:16.598908+0000","last_clean_scrub_stamp":"2024-09-11T00:14:16.598908+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:38:48.805212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:23.649985+0000","last_change":"2024-09-11T00:14:22.674989+0000","last_active":"2024-09-11T00:14:23.649985+0000","last_peered":"2024-09-11T00:14:23.649985+0000","last_clean":"2024-09-11T00:14:23.649985+0000","last_became_active":"2024-09-11T00:14:22.674093+0000","last_became_peered":"2024-09-11T00:14:22.674093+0000","last_unstale":"2024-09-11T00:14:23.649985+0000","last_undegraded":"2024-09-11T00:14:23.649985+0000","last_fullsized":"2024-09-11T00:14:23.649985+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:21.633629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:21.633629+0000","last_clean_scrub_stamp":"2024-09-11T00:14:21.633629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:51:34.161600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:25.443210+0000","last_change":"2024-09-11T00:14:18.645760+0000","last_active":"2024-09-11T00:14:25.443210+0000","last_peered":"2024-09-11T00:14:25.443210+0000","last_clean":"2024-09-11T00:14:25.443210+0000","last_became_active":"2024-09-11T00:14:18.645462+0000","last_became_peered":"2024-09-11T00:14:18.645462+0000","last_unstale":"2024-09-11T00:14:25.443210+0000","last_undegraded":"2024-09-11T00:14:25.443210+0000","last_fullsized":"2024-09-11T00:14:25.443210+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_clean_scrub_stamp":"2024-09-11T00:14:17.606538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:05:22.680084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":31,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:25.447934+0000","last_change":"2024-09-11T00:14:17.628485+0000","last_active":"2024-09-11T00:14:25.447934+0000","last_peered":"2024-09-11T00:14:25.447934+0000","last_clean":"2024-09-11T00:14:25.447934+0000","last_became_active":"2024-09-11T00:14:17.628222+0000","last_became_peered":"2024-09-11T00:14:17.628222+0000","last_unstale":"2024-09-11T00:14:25.447934+0000","last_undegraded":"2024-09-11T00:14:25.447934+0000","last_fullsized":"2024-09-11T00:14:25.447934+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:16.598908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:16.598908+0000","last_clean_scrub_stamp":"2024-09-11T00:14:16.598908+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:10:29.159080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:24.883394+0000","last_change":"2024-09-11T00:14:22.667660+0000","last_active":"2024-09-11T00:14:24.883394+0000","last_peered":"2024-09-11T00:14:24.883394+0000","last_clean":"2024-09-11T00:14:24.883394+0000","last_became_active":"2024-09-11T00:14:22.667251+0000","last_became_peered":"2024-09-11T00:14:22.667251+0000","last_unstale":"2024-09-11T00:14:24.883394+0000","last_undegraded":"2024-09-11T00:14:24.883394+0000","last_fullsized":"2024-09-11T00:14:24.883394+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:21.633629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:21.633629+0000","last_clean_scrub_stamp":"2024-09-11T00:14:21.633629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:49:50.114367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:24.934702+0000","last_change":"2024-09-11T00:14:18.638920+0000","last_active":"2024-09-11T00:14:24.934702+0000","last_peered":"2024-09-11T00:14:24.934702+0000","last_clean":"2024-09-11T00:14:24.934702+0000","last_became_active":"2024-09-11T00:14:18.638610+0000","last_became_peered":"2024-09-11T00:14:18.638610+0000","last_unstale":"2024-09-11T00:14:24.934702+0000","last_undegraded":"2024-09-11T00:14:24.934702+0000","last_fullsized":"2024-09-11T00:14:24.934702+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_clean_scrub_stamp":"2024-09-11T00:14:17.606538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:54:59.724551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:24.934755+0000","last_change":"2024-09-11T00:14:17.637068+0000","last_active":"2024-09-11T00:14:24.934755+0000","last_peered":"2024-09-11T00:14:24.934755+0000","last_clean":"2024-09-11T00:14:24.934755+0000","last_became_active":"2024-09-11T00:14:17.636624+0000","last_became_peered":"2024-09-11T00:14:17.636624+0000","last_unstale":"2024-09-11T00:14:24.934755+0000","last_undegraded":"2024-09-11T00:14:24.934755+0000","last_fullsized":"2024-09-11T00:14:24.934755+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:16.598908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:16.598908+0000","last_clean_scrub_stamp":"2024-09-11T00:14:16.598908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:10:29.159080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:23.649270+0000","last_change":"2024-09-11T00:14:22.690799+0000","last_active":"2024-09-11T00:14:23.649270+0000","last_peered":"2024-09-11T00:14:23.649270+0000","last_clean":"2024-09-11T00:14:23.649270+0000","last_became_active":"2024-09-11T00:14:22.690297+0000","last_became_peered":"2024-09-11T00:14:22.690297+0000","last_unstale":"2024-09-11T00:14:23.649270+0000","last_undegraded":"2024-09-11T00:14:23.649270+0000","last_fullsized":"2024-09-11T00:14:23.649270+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:21.633629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:21.633629+0000","last_clean_scrub_stamp":"2024-09-11T00:14:21.633629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:22:53.801030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:25.443367+0000","last_change":"2024-09-11T00:14:18.642784+0000","last_active":"2024-09-11T00:14:25.443367+0000","last_peered":"2024-09-11T00:14:25.443367+0000","last_clean":"2024-09-11T00:14:25.443367+0000","last_became_active":"2024-09-11T00:14:18.642508+0000","last_became_peered":"2024-09-11T00:14:18.642508+0000","last_unstale":"2024-09-11T00:14:25.443367+0000","last_undegraded":"2024-09-11T00:14:25.443367+0000","last_fullsized":"2024-09-11T00:14:25.443367+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_clean_scrub_stamp":"2024-09-11T00:14:17.606538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:25:18.398495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:23.652298+0000","last_change":"2024-09-11T00:14:17.623667+0000","last_active":"2024-09-11T00:14:23.652298+0000","last_peered":"2024-09-11T00:14:23.652298+0000","last_clean":"2024-09-11T00:14:23.652298+0000","last_became_active":"2024-09-11T00:14:17.623380+0000","last_became_peered":"2024-09-11T00:14:17.623380+0000","last_unstale":"2024-09-11T00:14:23.652298+0000","last_undegraded":"2024-09-11T00:14:23.652298+0000","last_fullsized":"2024-09-11T00:14:23.652298+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:16.598908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:16.598908+0000","last_clean_scrub_stamp":"2024-09-11T00:14:16.598908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:42:38.574433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:23.648776+0000","last_change":"2024-09-11T00:14:22.688511+0000","last_active":"2024-09-11T00:14:23.648776+0000","last_peered":"2024-09-11T00:14:23.648776+0000","last_clean":"2024-09-11T00:14:23.648776+0000","last_became_active":"2024-09-11T00:14:22.688105+0000","last_became_peered":"2024-09-11T00:14:22.688105+0000","last_unstale":"2024-09-11T00:14:23.648776+0000","last_undegraded":"2024-09-11T00:14:23.648776+0000","last_fullsized":"2024-09-11T00:14:23.648776+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:21.633629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:21.633629+0000","last_clean_scrub_stamp":"2024-09-11T00:14:21.633629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:23:20.020672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:24.883270+0000","last_change":"2024-09-11T00:14:18.641786+0000","last_active":"2024-09-11T00:14:24.883270+0000","last_peered":"2024-09-11T00:14:24.883270+0000","last_clean":"2024-09-11T00:14:24.883270+0000","last_became_active":"2024-09-11T00:14:18.641529+0000","last_became_peered":"2024-09-11T00:14:18.641529+0000","last_unstale":"2024-09-11T00:14:24.883270+0000","last_undegraded":"2024-09-11T00:14:24.883270+0000","last_fullsized":"2024-09-11T00:14:24.883270+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_clean_scrub_stamp":"2024-09-11T00:14:17.606538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:35:44.502418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:24.883594+0000","last_change":"2024-09-11T00:14:17.635250+0000","last_active":"2024-09-11T00:14:24.883594+0000","last_peered":"2024-09-11T00:14:24.883594+0000","last_clean":"2024-09-11T00:14:24.883594+0000","last_became_active":"2024-09-11T00:14:17.634962+0000","last_became_peered":"2024-09-11T00:14:17.634962+0000","last_unstale":"2024-09-11T00:14:24.883594+0000","last_undegraded":"2024-09-11T00:14:24.883594+0000","last_fullsized":"2024-09-11T00:14:24.883594+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:16.598908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:16.598908+0000","last_clean_scrub_stamp":"2024-09-11T00:14:16.598908+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:02:04.954945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:23.651089+0000","last_change":"2024-09-11T00:14:22.688665+0000","last_active":"2024-09-11T00:14:23.651089+0000","last_peered":"2024-09-11T00:14:23.651089+0000","last_clean":"2024-09-11T00:14:23.651089+0000","last_became_active":"2024-09-11T00:14:22.688285+0000","last_became_peered":"2024-09-11T00:14:22.688285+0000","last_unstale":"2024-09-11T00:14:23.651089+0000","last_undegraded":"2024-09-11T00:14:23.651089+0000","last_fullsized":"2024-09-11T00:14:23.651089+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:21.633629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:21.633629+0000","last_clean_scrub_stamp":"2024-09-11T00:14:21.633629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:14:32.578348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:25.443331+0000","last_change":"2024-09-11T00:14:18.644136+0000","last_active":"2024-09-11T00:14:25.443331+0000","last_peered":"2024-09-11T00:14:25.443331+0000","last_clean":"2024-09-11T00:14:25.443331+0000","last_became_active":"2024-09-11T00:14:18.642976+0000","last_became_peered":"2024-09-11T00:14:18.642976+0000","last_unstale":"2024-09-11T00:14:25.443331+0000","last_undegraded":"2024-09-11T00:14:25.443331+0000","last_fullsized":"2024-09-11T00:14:25.443331+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_clean_scrub_stamp":"2024-09-11T00:14:17.606538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:58:16.831016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"25'9","reported_seq":32,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:28.050349+0000","last_change":"2024-09-11T00:14:17.633618+0000","last_active":"2024-09-11T00:14:28.050349+0000","last_peered":"2024-09-11T00:14:28.050349+0000","last_clean":"2024-09-11T00:14:28.050349+0000","last_became_active":"2024-09-11T00:14:17.632701+0000","last_became_peered":"2024-09-11T00:14:17.632701+0000","last_unstale":"2024-09-11T00:14:28.050349+0000","last_undegraded":"2024-09-11T00:14:28.050349+0000","last_fullsized":"2024-09-11T00:14:28.050349+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:16.598908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:16.598908+0000","last_clean_scrub_stamp":"2024-09-11T00:14:16.598908+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:10:37.852358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:25.448757+0000","last_change":"2024-09-11T00:14:22.664837+0000","last_active":"2024-09-11T00:14:25.448757+0000","last_peered":"2024-09-11T00:14:25.448757+0000","last_clean":"2024-09-11T00:14:25.448757+0000","last_became_active":"2024-09-11T00:14:22.663868+0000","last_became_peered":"2024-09-11T00:14:22.663868+0000","last_unstale":"2024-09-11T00:14:25.448757+0000","last_undegraded":"2024-09-11T00:14:25.448757+0000","last_fullsized":"2024-09-11T00:14:25.448757+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:21.633629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:21.633629+0000","last_clean_scrub_stamp":"2024-09-11T00:14:21.633629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:51:23.630707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:23.652267+0000","last_change":"2024-09-11T00:14:18.641013+0000","last_active":"2024-09-11T00:14:23.652267+0000","last_peered":"2024-09-11T00:14:23.652267+0000","last_clean":"2024-09-11T00:14:23.652267+0000","last_became_active":"2024-09-11T00:14:18.640690+0000","last_became_peered":"2024-09-11T00:14:18.640690+0000","last_unstale":"2024-09-11T00:14:23.652267+0000","last_undegraded":"2024-09-11T00:14:23.652267+0000","last_fullsized":"2024-09-11T00:14:23.652267+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_clean_scrub_stamp":"2024-09-11T00:14:17.606538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:22:59.454003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:25.448873+0000","last_change":"2024-09-11T00:14:17.637712+0000","last_active":"2024-09-11T00:14:25.448873+0000","last_peered":"2024-09-11T00:14:25.448873+0000","last_clean":"2024-09-11T00:14:25.448873+0000","last_became_active":"2024-09-11T00:14:17.637463+0000","last_became_peered":"2024-09-11T00:14:17.637463+0000","last_unstale":"2024-09-11T00:14:25.448873+0000","last_undegraded":"2024-09-11T00:14:25.448873+0000","last_fullsized":"2024-09-11T00:14:25.448873+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:16.598908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:16.598908+0000","last_clean_scrub_stamp":"2024-09-11T00:14:16.598908+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:43:47.266406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:23.650677+0000","last_change":"2024-09-11T00:14:22.664447+0000","last_active":"2024-09-11T00:14:23.650677+0000","last_peered":"2024-09-11T00:14:23.650677+0000","last_clean":"2024-09-11T00:14:23.650677+0000","last_became_active":"2024-09-11T00:14:22.663920+0000","last_became_peered":"2024-09-11T00:14:22.663920+0000","last_unstale":"2024-09-11T00:14:23.650677+0000","last_undegraded":"2024-09-11T00:14:23.650677+0000","last_fullsized":"2024-09-11T00:14:23.650677+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:21.633629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:21.633629+0000","last_clean_scrub_stamp":"2024-09-11T00:14:21.633629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:55:56.768777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:24.883554+0000","last_change":"2024-09-11T00:14:18.630232+0000","last_active":"2024-09-11T00:14:24.883554+0000","last_peered":"2024-09-11T00:14:24.883554+0000","last_clean":"2024-09-11T00:14:24.883554+0000","last_became_active":"2024-09-11T00:14:18.629885+0000","last_became_peered":"2024-09-11T00:14:18.629885+0000","last_unstale":"2024-09-11T00:14:24.883554+0000","last_undegraded":"2024-09-11T00:14:24.883554+0000","last_fullsized":"2024-09-11T00:14:24.883554+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_clean_scrub_stamp":"2024-09-11T00:14:17.606538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:05:45.558170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:23.650676+0000","last_change":"2024-09-11T00:14:17.632228+0000","last_active":"2024-09-11T00:14:23.650676+0000","last_peered":"2024-09-11T00:14:23.650676+0000","last_clean":"2024-09-11T00:14:23.650676+0000","last_became_active":"2024-09-11T00:14:17.631908+0000","last_became_peered":"2024-09-11T00:14:17.631908+0000","last_unstale":"2024-09-11T00:14:23.650676+0000","last_undegraded":"2024-09-11T00:14:23.650676+0000","last_fullsized":"2024-09-11T00:14:23.650676+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:16.598908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:16.598908+0000","last_clean_scrub_stamp":"2024-09-11T00:14:16.598908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:11:19.690215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:23.648399+0000","last_change":"2024-09-11T00:14:22.671970+0000","last_active":"2024-09-11T00:14:23.648399+0000","last_peered":"2024-09-11T00:14:23.648399+0000","last_clean":"2024-09-11T00:14:23.648399+0000","last_became_active":"2024-09-11T00:14:22.671536+0000","last_became_peered":"2024-09-11T00:14:22.671536+0000","last_unstale":"2024-09-11T00:14:23.648399+0000","last_undegraded":"2024-09-11T00:14:23.648399+0000","last_fullsized":"2024-09-11T00:14:23.648399+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:21.633629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:21.633629+0000","last_clean_scrub_stamp":"2024-09-11T00:14:21.633629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:42:10.576151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:23.650561+0000","last_change":"2024-09-11T00:14:18.639664+0000","last_active":"2024-09-11T00:14:23.650561+0000","last_peered":"2024-09-11T00:14:23.650561+0000","last_clean":"2024-09-11T00:14:23.650561+0000","last_became_active":"2024-09-11T00:14:18.639215+0000","last_became_peered":"2024-09-11T00:14:18.639215+0000","last_unstale":"2024-09-11T00:14:23.650561+0000","last_undegraded":"2024-09-11T00:14:23.650561+0000","last_fullsized":"2024-09-11T00:14:23.650561+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_clean_scrub_stamp":"2024-09-11T00:14:17.606538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:38:46.884984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:24.935237+0000","last_change":"2024-09-11T00:14:17.638296+0000","last_active":"2024-09-11T00:14:24.935237+0000","last_peered":"2024-09-11T00:14:24.935237+0000","last_clean":"2024-09-11T00:14:24.935237+0000","last_became_active":"2024-09-11T00:14:17.637629+0000","last_became_peered":"2024-09-11T00:14:17.637629+0000","last_unstale":"2024-09-11T00:14:24.935237+0000","last_undegraded":"2024-09-11T00:14:24.935237+0000","last_fullsized":"2024-09-11T00:14:24.935237+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:16.598908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:16.598908+0000","last_clean_scrub_stamp":"2024-09-11T00:14:16.598908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:30:53.963229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:23.648342+0000","last_change":"2024-09-11T00:14:22.692320+0000","last_active":"2024-09-11T00:14:23.648342+0000","last_peered":"2024-09-11T00:14:23.648342+0000","last_clean":"2024-09-11T00:14:23.648342+0000","last_became_active":"2024-09-11T00:14:22.691110+0000","last_became_peered":"2024-09-11T00:14:22.691110+0000","last_unstale":"2024-09-11T00:14:23.648342+0000","last_undegraded":"2024-09-11T00:14:23.648342+0000","last_fullsized":"2024-09-11T00:14:23.648342+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:21.633629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:21.633629+0000","last_clean_scrub_stamp":"2024-09-11T00:14:21.633629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:19:13.639166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:24.883414+0000","last_change":"2024-09-11T00:14:22.692131+0000","last_active":"2024-09-11T00:14:24.883414+0000","last_peered":"2024-09-11T00:14:24.883414+0000","last_clean":"2024-09-11T00:14:24.883414+0000","last_became_active":"2024-09-11T00:14:22.691743+0000","last_became_peered":"2024-09-11T00:14:22.691743+0000","last_unstale":"2024-09-11T00:14:24.883414+0000","last_undegraded":"2024-09-11T00:14:24.883414+0000","last_fullsized":"2024-09-11T00:14:24.883414+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:21.633629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:21.633629+0000","last_clean_scrub_stamp":"2024-09-11T00:14:21.633629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:18:49.229564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:25.448449+0000","last_change":"2024-09-11T00:14:18.627489+0000","last_active":"2024-09-11T00:14:25.448449+0000","last_peered":"2024-09-11T00:14:25.448449+0000","last_clean":"2024-09-11T00:14:25.448449+0000","last_became_active":"2024-09-11T00:14:18.627227+0000","last_became_peered":"2024-09-11T00:14:18.627227+0000","last_unstale":"2024-09-11T00:14:25.448449+0000","last_undegraded":"2024-09-11T00:14:25.448449+0000","last_fullsized":"2024-09-11T00:14:25.448449+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_clean_scrub_stamp":"2024-09-11T00:14:17.606538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:20:59.721295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:23.650568+0000","last_change":"2024-09-11T00:14:17.633563+0000","last_active":"2024-09-11T00:14:23.650568+0000","last_peered":"2024-09-11T00:14:23.650568+0000","last_clean":"2024-09-11T00:14:23.650568+0000","last_became_active":"2024-09-11T00:14:17.633316+0000","last_became_peered":"2024-09-11T00:14:17.633316+0000","last_unstale":"2024-09-11T00:14:23.650568+0000","last_undegraded":"2024-09-11T00:14:23.650568+0000","last_fullsized":"2024-09-11T00:14:23.650568+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:16.598908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:16.598908+0000","last_clean_scrub_stamp":"2024-09-11T00:14:16.598908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:52:22.626375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:24.935339+0000","last_change":"2024-09-11T00:14:22.670666+0000","last_active":"2024-09-11T00:14:24.935339+0000","last_peered":"2024-09-11T00:14:24.935339+0000","last_clean":"2024-09-11T00:14:24.935339+0000","last_became_active":"2024-09-11T00:14:22.670286+0000","last_became_peered":"2024-09-11T00:14:22.670286+0000","last_unstale":"2024-09-11T00:14:24.935339+0000","last_undegraded":"2024-09-11T00:14:24.935339+0000","last_fullsized":"2024-09-11T00:14:24.935339+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:21.633629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:21.633629+0000","last_clean_scrub_stamp":"2024-09-11T00:14:21.633629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:53:06.573918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:23.648370+0000","last_change":"2024-09-11T00:14:18.634072+0000","last_active":"2024-09-11T00:14:23.648370+0000","last_peered":"2024-09-11T00:14:23.648370+0000","last_clean":"2024-09-11T00:14:23.648370+0000","last_became_active":"2024-09-11T00:14:18.633811+0000","last_became_peered":"2024-09-11T00:14:18.633811+0000","last_unstale":"2024-09-11T00:14:23.648370+0000","last_undegraded":"2024-09-11T00:14:23.648370+0000","last_fullsized":"2024-09-11T00:14:23.648370+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_clean_scrub_stamp":"2024-09-11T00:14:17.606538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:35:44.502418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:23.648649+0000","last_change":"2024-09-11T00:14:17.631993+0000","last_active":"2024-09-11T00:14:23.648649+0000","last_peered":"2024-09-11T00:14:23.648649+0000","last_clean":"2024-09-11T00:14:23.648649+0000","last_became_active":"2024-09-11T00:14:17.631645+0000","last_became_peered":"2024-09-11T00:14:17.631645+0000","last_unstale":"2024-09-11T00:14:23.648649+0000","last_undegraded":"2024-09-11T00:14:23.648649+0000","last_fullsized":"2024-09-11T00:14:23.648649+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:16.598908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:16.598908+0000","last_clean_scrub_stamp":"2024-09-11T00:14:16.598908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:55:22.582535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:24.934838+0000","last_change":"2024-09-11T00:14:17.634075+0000","last_active":"2024-09-11T00:14:24.934838+0000","last_peered":"2024-09-11T00:14:24.934838+0000","last_clean":"2024-09-11T00:14:24.934838+0000","last_became_active":"2024-09-11T00:14:17.633595+0000","last_became_peered":"2024-09-11T00:14:17.633595+0000","last_unstale":"2024-09-11T00:14:24.934838+0000","last_undegraded":"2024-09-11T00:14:24.934838+0000","last_fullsized":"2024-09-11T00:14:24.934838+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:16.598908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:16.598908+0000","last_clean_scrub_stamp":"2024-09-11T00:14:16.598908+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:51:02.481656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:24.883579+0000","last_change":"2024-09-11T00:14:18.642731+0000","last_active":"2024-09-11T00:14:24.883579+0000","last_peered":"2024-09-11T00:14:24.883579+0000","last_clean":"2024-09-11T00:14:24.883579+0000","last_became_active":"2024-09-11T00:14:18.642296+0000","last_became_peered":"2024-09-11T00:14:18.642296+0000","last_unstale":"2024-09-11T00:14:24.883579+0000","last_undegraded":"2024-09-11T00:14:24.883579+0000","last_fullsized":"2024-09-11T00:14:24.883579+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_clean_scrub_stamp":"2024-09-11T00:14:17.606538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:49:06.208715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:25.448556+0000","last_change":"2024-09-11T00:14:22.674116+0000","last_active":"2024-09-11T00:14:25.448556+0000","last_peered":"2024-09-11T00:14:25.448556+0000","last_clean":"2024-09-11T00:14:25.448556+0000","last_became_active":"2024-09-11T00:14:22.673701+0000","last_became_peered":"2024-09-11T00:14:22.673701+0000","last_unstale":"2024-09-11T00:14:25.448556+0000","last_undegraded":"2024-09-11T00:14:25.448556+0000","last_fullsized":"2024-09-11T00:14:25.448556+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:21.633629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:21.633629+0000","last_clean_scrub_stamp":"2024-09-11T00:14:21.633629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:22:35.167801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:23.648729+0000","last_change":"2024-09-11T00:14:17.632276+0000","last_active":"2024-09-11T00:14:23.648729+0000","last_peered":"2024-09-11T00:14:23.648729+0000","last_clean":"2024-09-11T00:14:23.648729+0000","last_became_active":"2024-09-11T00:14:17.631820+0000","last_became_peered":"2024-09-11T00:14:17.631820+0000","last_unstale":"2024-09-11T00:14:23.648729+0000","last_undegraded":"2024-09-11T00:14:23.648729+0000","last_fullsized":"2024-09-11T00:14:23.648729+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:16.598908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:16.598908+0000","last_clean_scrub_stamp":"2024-09-11T00:14:16.598908+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:20:56.408317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:23.650684+0000","last_change":"2024-09-11T00:14:18.631229+0000","last_active":"2024-09-11T00:14:23.650684+0000","last_peered":"2024-09-11T00:14:23.650684+0000","last_clean":"2024-09-11T00:14:23.650684+0000","last_became_active":"2024-09-11T00:14:18.630830+0000","last_became_peered":"2024-09-11T00:14:18.630830+0000","last_unstale":"2024-09-11T00:14:23.650684+0000","last_undegraded":"2024-09-11T00:14:23.650684+0000","last_fullsized":"2024-09-11T00:14:23.650684+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_clean_scrub_stamp":"2024-09-11T00:14:17.606538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:39:00.086315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:23.649013+0000","last_change":"2024-09-11T00:14:22.675138+0000","last_active":"2024-09-11T00:14:23.649013+0000","last_peered":"2024-09-11T00:14:23.649013+0000","last_clean":"2024-09-11T00:14:23.649013+0000","last_became_active":"2024-09-11T00:14:22.674701+0000","last_became_peered":"2024-09-11T00:14:22.674701+0000","last_unstale":"2024-09-11T00:14:23.649013+0000","last_undegraded":"2024-09-11T00:14:23.649013+0000","last_fullsized":"2024-09-11T00:14:23.649013+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:21.633629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:21.633629+0000","last_clean_scrub_stamp":"2024-09-11T00:14:21.633629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:16:25.651997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:24.934564+0000","last_change":"2024-09-11T00:14:18.639301+0000","last_active":"2024-09-11T00:14:24.934564+0000","last_peered":"2024-09-11T00:14:24.934564+0000","last_clean":"2024-09-11T00:14:24.934564+0000","last_became_active":"2024-09-11T00:14:18.639038+0000","last_became_peered":"2024-09-11T00:14:18.639038+0000","last_unstale":"2024-09-11T00:14:24.934564+0000","last_undegraded":"2024-09-11T00:14:24.934564+0000","last_fullsized":"2024-09-11T00:14:24.934564+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_clean_scrub_stamp":"2024-09-11T00:14:17.606538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:24:12.007225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:25.448031+0000","last_change":"2024-09-11T00:14:18.623623+0000","last_active":"2024-09-11T00:14:25.448031+0000","last_peered":"2024-09-11T00:14:25.448031+0000","last_clean":"2024-09-11T00:14:25.448031+0000","last_became_active":"2024-09-11T00:14:18.623328+0000","last_became_peered":"2024-09-11T00:14:18.623328+0000","last_unstale":"2024-09-11T00:14:25.448031+0000","last_undegraded":"2024-09-11T00:14:25.448031+0000","last_fullsized":"2024-09-11T00:14:25.448031+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_clean_scrub_stamp":"2024-09-11T00:14:17.606538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:00:51.172893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:23.652194+0000","last_change":"2024-09-11T00:14:18.628493+0000","last_active":"2024-09-11T00:14:23.652194+0000","last_peered":"2024-09-11T00:14:23.652194+0000","last_clean":"2024-09-11T00:14:23.652194+0000","last_became_active":"2024-09-11T00:14:18.628040+0000","last_became_peered":"2024-09-11T00:14:18.628040+0000","last_unstale":"2024-09-11T00:14:23.652194+0000","last_undegraded":"2024-09-11T00:14:23.652194+0000","last_fullsized":"2024-09-11T00:14:23.652194+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_clean_scrub_stamp":"2024-09-11T00:14:17.606538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:24:40.790020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:24.883499+0000","last_change":"2024-09-11T00:14:18.633950+0000","last_active":"2024-09-11T00:14:24.883499+0000","last_peered":"2024-09-11T00:14:24.883499+0000","last_clean":"2024-09-11T00:14:24.883499+0000","last_became_active":"2024-09-11T00:14:18.633147+0000","last_became_peered":"2024-09-11T00:14:18.633147+0000","last_unstale":"2024-09-11T00:14:24.883499+0000","last_undegraded":"2024-09-11T00:14:24.883499+0000","last_fullsized":"2024-09-11T00:14:24.883499+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_clean_scrub_stamp":"2024-09-11T00:14:17.606538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:46:52.007701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:23.648966+0000","last_change":"2024-09-11T00:14:18.626152+0000","last_active":"2024-09-11T00:14:23.648966+0000","last_peered":"2024-09-11T00:14:23.648966+0000","last_clean":"2024-09-11T00:14:23.648966+0000","last_became_active":"2024-09-11T00:14:18.625885+0000","last_became_peered":"2024-09-11T00:14:18.625885+0000","last_unstale":"2024-09-11T00:14:23.648966+0000","last_undegraded":"2024-09-11T00:14:23.648966+0000","last_fullsized":"2024-09-11T00:14:23.648966+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_clean_scrub_stamp":"2024-09-11T00:14:17.606538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:11:01.606959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:25.448276+0000","last_change":"2024-09-11T00:14:18.626762+0000","last_active":"2024-09-11T00:14:25.448276+0000","last_peered":"2024-09-11T00:14:25.448276+0000","last_clean":"2024-09-11T00:14:25.448276+0000","last_became_active":"2024-09-11T00:14:18.626537+0000","last_became_peered":"2024-09-11T00:14:18.626537+0000","last_unstale":"2024-09-11T00:14:25.448276+0000","last_undegraded":"2024-09-11T00:14:25.448276+0000","last_fullsized":"2024-09-11T00:14:25.448276+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_clean_scrub_stamp":"2024-09-11T00:14:17.606538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:03:25.203629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:24.935246+0000","last_change":"2024-09-11T00:14:18.642453+0000","last_active":"2024-09-11T00:14:24.935246+0000","last_peered":"2024-09-11T00:14:24.935246+0000","last_clean":"2024-09-11T00:14:24.935246+0000","last_became_active":"2024-09-11T00:14:18.642172+0000","last_became_peered":"2024-09-11T00:14:18.642172+0000","last_unstale":"2024-09-11T00:14:24.935246+0000","last_undegraded":"2024-09-11T00:14:24.935246+0000","last_fullsized":"2024-09-11T00:14:24.935246+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_clean_scrub_stamp":"2024-09-11T00:14:17.606538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:48:16.815773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:23.649246+0000","last_change":"2024-09-11T00:14:18.628632+0000","last_active":"2024-09-11T00:14:23.649246+0000","last_peered":"2024-09-11T00:14:23.649246+0000","last_clean":"2024-09-11T00:14:23.649246+0000","last_became_active":"2024-09-11T00:14:18.628308+0000","last_became_peered":"2024-09-11T00:14:18.628308+0000","last_unstale":"2024-09-11T00:14:23.649246+0000","last_undegraded":"2024-09-11T00:14:23.649246+0000","last_fullsized":"2024-09-11T00:14:23.649246+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_clean_scrub_stamp":"2024-09-11T00:14:17.606538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:24:40.790020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:23.650453+0000","last_change":"2024-09-11T00:14:18.630942+0000","last_active":"2024-09-11T00:14:23.650453+0000","last_peered":"2024-09-11T00:14:23.650453+0000","last_clean":"2024-09-11T00:14:23.650453+0000","last_became_active":"2024-09-11T00:14:18.630223+0000","last_became_peered":"2024-09-11T00:14:18.630223+0000","last_unstale":"2024-09-11T00:14:23.650453+0000","last_undegraded":"2024-09-11T00:14:23.650453+0000","last_fullsized":"2024-09-11T00:14:23.650453+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_clean_scrub_stamp":"2024-09-11T00:14:17.606538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:34:07.533694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:23.648607+0000","last_change":"2024-09-11T00:14:18.628072+0000","last_active":"2024-09-11T00:14:23.648607+0000","last_peered":"2024-09-11T00:14:23.648607+0000","last_clean":"2024-09-11T00:14:23.648607+0000","last_became_active":"2024-09-11T00:14:18.627801+0000","last_became_peered":"2024-09-11T00:14:18.627801+0000","last_unstale":"2024-09-11T00:14:23.648607+0000","last_undegraded":"2024-09-11T00:14:23.648607+0000","last_fullsized":"2024-09-11T00:14:23.648607+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_clean_scrub_stamp":"2024-09-11T00:14:17.606538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:27:57.991308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:23.652067+0000","last_change":"2024-09-11T00:14:18.633583+0000","last_active":"2024-09-11T00:14:23.652067+0000","last_peered":"2024-09-11T00:14:23.652067+0000","last_clean":"2024-09-11T00:14:23.652067+0000","last_became_active":"2024-09-11T00:14:18.633263+0000","last_became_peered":"2024-09-11T00:14:18.633263+0000","last_unstale":"2024-09-11T00:14:23.652067+0000","last_undegraded":"2024-09-11T00:14:23.652067+0000","last_fullsized":"2024-09-11T00:14:23.652067+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_clean_scrub_stamp":"2024-09-11T00:14:17.606538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:24:44.702294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:24.883238+0000","last_change":"2024-09-11T00:14:18.642759+0000","last_active":"2024-09-11T00:14:24.883238+0000","last_peered":"2024-09-11T00:14:24.883238+0000","last_clean":"2024-09-11T00:14:24.883238+0000","last_became_active":"2024-09-11T00:14:18.642466+0000","last_became_peered":"2024-09-11T00:14:18.642466+0000","last_unstale":"2024-09-11T00:14:24.883238+0000","last_undegraded":"2024-09-11T00:14:24.883238+0000","last_fullsized":"2024-09-11T00:14:24.883238+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_clean_scrub_stamp":"2024-09-11T00:14:17.606538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:54:15.924007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:24.934959+0000","last_change":"2024-09-11T00:14:18.647847+0000","last_active":"2024-09-11T00:14:24.934959+0000","last_peered":"2024-09-11T00:14:24.934959+0000","last_clean":"2024-09-11T00:14:24.934959+0000","last_became_active":"2024-09-11T00:14:18.647379+0000","last_became_peered":"2024-09-11T00:14:18.647379+0000","last_unstale":"2024-09-11T00:14:24.934959+0000","last_undegraded":"2024-09-11T00:14:24.934959+0000","last_fullsized":"2024-09-11T00:14:24.934959+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_clean_scrub_stamp":"2024-09-11T00:14:17.606538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:18:09.026105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:25.443565+0000","last_change":"2024-09-11T00:14:18.643993+0000","last_active":"2024-09-11T00:14:25.443565+0000","last_peered":"2024-09-11T00:14:25.443565+0000","last_clean":"2024-09-11T00:14:25.443565+0000","last_became_active":"2024-09-11T00:14:18.642576+0000","last_became_peered":"2024-09-11T00:14:18.642576+0000","last_unstale":"2024-09-11T00:14:25.443565+0000","last_undegraded":"2024-09-11T00:14:25.443565+0000","last_fullsized":"2024-09-11T00:14:25.443565+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_clean_scrub_stamp":"2024-09-11T00:14:17.606538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:49:46.087276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:25.448220+0000","last_change":"2024-09-11T00:14:18.634965+0000","last_active":"2024-09-11T00:14:25.448220+0000","last_peered":"2024-09-11T00:14:25.448220+0000","last_clean":"2024-09-11T00:14:25.448220+0000","last_became_active":"2024-09-11T00:14:18.634667+0000","last_became_peered":"2024-09-11T00:14:18.634667+0000","last_unstale":"2024-09-11T00:14:25.448220+0000","last_undegraded":"2024-09-11T00:14:25.448220+0000","last_fullsized":"2024-09-11T00:14:25.448220+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_clean_scrub_stamp":"2024-09-11T00:14:17.606538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:05:38.063905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:23.650745+0000","last_change":"2024-09-11T00:14:18.645434+0000","last_active":"2024-09-11T00:14:23.650745+0000","last_peered":"2024-09-11T00:14:23.650745+0000","last_clean":"2024-09-11T00:14:23.650745+0000","last_became_active":"2024-09-11T00:14:18.645012+0000","last_became_peered":"2024-09-11T00:14:18.645012+0000","last_unstale":"2024-09-11T00:14:23.650745+0000","last_undegraded":"2024-09-11T00:14:23.650745+0000","last_fullsized":"2024-09-11T00:14:23.650745+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_clean_scrub_stamp":"2024-09-11T00:14:17.606538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:07:37.621540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:23.650343+0000","last_change":"2024-09-11T00:14:18.635751+0000","last_active":"2024-09-11T00:14:23.650343+0000","last_peered":"2024-09-11T00:14:23.650343+0000","last_clean":"2024-09-11T00:14:23.650343+0000","last_became_active":"2024-09-11T00:14:18.635450+0000","last_became_peered":"2024-09-11T00:14:18.635450+0000","last_unstale":"2024-09-11T00:14:23.650343+0000","last_undegraded":"2024-09-11T00:14:23.650343+0000","last_fullsized":"2024-09-11T00:14:23.650343+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_clean_scrub_stamp":"2024-09-11T00:14:17.606538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:13:02.693352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:25.448536+0000","last_change":"2024-09-11T00:14:18.623006+0000","last_active":"2024-09-11T00:14:25.448536+0000","last_peered":"2024-09-11T00:14:25.448536+0000","last_clean":"2024-09-11T00:14:25.448536+0000","last_became_active":"2024-09-11T00:14:18.622744+0000","last_became_peered":"2024-09-11T00:14:18.622744+0000","last_unstale":"2024-09-11T00:14:25.448536+0000","last_undegraded":"2024-09-11T00:14:25.448536+0000","last_fullsized":"2024-09-11T00:14:25.448536+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_clean_scrub_stamp":"2024-09-11T00:14:17.606538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:25:01.082594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:24.883243+0000","last_change":"2024-09-11T00:14:18.631985+0000","last_active":"2024-09-11T00:14:24.883243+0000","last_peered":"2024-09-11T00:14:24.883243+0000","last_clean":"2024-09-11T00:14:24.883243+0000","last_became_active":"2024-09-11T00:14:18.631307+0000","last_became_peered":"2024-09-11T00:14:18.631307+0000","last_unstale":"2024-09-11T00:14:24.883243+0000","last_undegraded":"2024-09-11T00:14:24.883243+0000","last_fullsized":"2024-09-11T00:14:24.883243+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_clean_scrub_stamp":"2024-09-11T00:14:17.606538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:40:30.015285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:23.648594+0000","last_change":"2024-09-11T00:14:18.633438+0000","last_active":"2024-09-11T00:14:23.648594+0000","last_peered":"2024-09-11T00:14:23.648594+0000","last_clean":"2024-09-11T00:14:23.648594+0000","last_became_active":"2024-09-11T00:14:18.633192+0000","last_became_peered":"2024-09-11T00:14:18.633192+0000","last_unstale":"2024-09-11T00:14:23.648594+0000","last_undegraded":"2024-09-11T00:14:23.648594+0000","last_fullsized":"2024-09-11T00:14:23.648594+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_clean_scrub_stamp":"2024-09-11T00:14:17.606538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:13:02.693352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:23.652159+0000","last_change":"2024-09-11T00:14:18.640308+0000","last_active":"2024-09-11T00:14:23.652159+0000","last_peered":"2024-09-11T00:14:23.652159+0000","last_clean":"2024-09-11T00:14:23.652159+0000","last_became_active":"2024-09-11T00:14:18.640051+0000","last_became_peered":"2024-09-11T00:14:18.640051+0000","last_unstale":"2024-09-11T00:14:23.652159+0000","last_undegraded":"2024-09-11T00:14:23.652159+0000","last_fullsized":"2024-09-11T00:14:23.652159+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_clean_scrub_stamp":"2024-09-11T00:14:17.606538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:11:16.975202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:24.935109+0000","last_change":"2024-09-11T00:14:18.636880+0000","last_active":"2024-09-11T00:14:24.935109+0000","last_peered":"2024-09-11T00:14:24.935109+0000","last_clean":"2024-09-11T00:14:24.935109+0000","last_became_active":"2024-09-11T00:14:18.636592+0000","last_became_peered":"2024-09-11T00:14:18.636592+0000","last_unstale":"2024-09-11T00:14:24.935109+0000","last_undegraded":"2024-09-11T00:14:24.935109+0000","last_fullsized":"2024-09-11T00:14:24.935109+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_clean_scrub_stamp":"2024-09-11T00:14:17.606538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:05:21.082012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:24.935192+0000","last_change":"2024-09-11T00:14:18.638064+0000","last_active":"2024-09-11T00:14:24.935192+0000","last_peered":"2024-09-11T00:14:24.935192+0000","last_clean":"2024-09-11T00:14:24.935192+0000","last_became_active":"2024-09-11T00:14:18.637558+0000","last_became_peered":"2024-09-11T00:14:18.637558+0000","last_unstale":"2024-09-11T00:14:24.935192+0000","last_undegraded":"2024-09-11T00:14:24.935192+0000","last_fullsized":"2024-09-11T00:14:24.935192+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_clean_scrub_stamp":"2024-09-11T00:14:17.606538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:09:24.787612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:25.443755+0000","last_change":"2024-09-11T00:14:18.641166+0000","last_active":"2024-09-11T00:14:25.443755+0000","last_peered":"2024-09-11T00:14:25.443755+0000","last_clean":"2024-09-11T00:14:25.443755+0000","last_became_active":"2024-09-11T00:14:18.640456+0000","last_became_peered":"2024-09-11T00:14:18.640456+0000","last_unstale":"2024-09-11T00:14:25.443755+0000","last_undegraded":"2024-09-11T00:14:25.443755+0000","last_fullsized":"2024-09-11T00:14:25.443755+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_clean_scrub_stamp":"2024-09-11T00:14:17.606538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:12:52.415152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:23.648235+0000","last_change":"2024-09-11T00:14:18.626919+0000","last_active":"2024-09-11T00:14:23.648235+0000","last_peered":"2024-09-11T00:14:23.648235+0000","last_clean":"2024-09-11T00:14:23.648235+0000","last_became_active":"2024-09-11T00:14:18.626280+0000","last_became_peered":"2024-09-11T00:14:18.626280+0000","last_unstale":"2024-09-11T00:14:23.648235+0000","last_undegraded":"2024-09-11T00:14:23.648235+0000","last_fullsized":"2024-09-11T00:14:23.648235+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_clean_scrub_stamp":"2024-09-11T00:14:17.606538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:29:21.396079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:25.443235+0000","last_change":"2024-09-11T00:14:18.640550+0000","last_active":"2024-09-11T00:14:25.443235+0000","last_peered":"2024-09-11T00:14:25.443235+0000","last_clean":"2024-09-11T00:14:25.443235+0000","last_became_active":"2024-09-11T00:14:18.640248+0000","last_became_peered":"2024-09-11T00:14:18.640248+0000","last_unstale":"2024-09-11T00:14:25.443235+0000","last_undegraded":"2024-09-11T00:14:25.443235+0000","last_fullsized":"2024-09-11T00:14:25.443235+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_clean_scrub_stamp":"2024-09-11T00:14:17.606538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:51:39.692232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:23.651967+0000","last_change":"2024-09-11T00:14:18.631295+0000","last_active":"2024-09-11T00:14:23.651967+0000","last_peered":"2024-09-11T00:14:23.651967+0000","last_clean":"2024-09-11T00:14:23.651967+0000","last_became_active":"2024-09-11T00:14:18.630629+0000","last_became_peered":"2024-09-11T00:14:18.630629+0000","last_unstale":"2024-09-11T00:14:23.651967+0000","last_undegraded":"2024-09-11T00:14:23.651967+0000","last_fullsized":"2024-09-11T00:14:23.651967+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_clean_scrub_stamp":"2024-09-11T00:14:17.606538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:11:01.606959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:25.443198+0000","last_change":"2024-09-11T00:14:18.632354+0000","last_active":"2024-09-11T00:14:25.443198+0000","last_peered":"2024-09-11T00:14:25.443198+0000","last_clean":"2024-09-11T00:14:25.443198+0000","last_became_active":"2024-09-11T00:14:18.632105+0000","last_became_peered":"2024-09-11T00:14:18.632105+0000","last_unstale":"2024-09-11T00:14:25.443198+0000","last_undegraded":"2024-09-11T00:14:25.443198+0000","last_fullsized":"2024-09-11T00:14:25.443198+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_clean_scrub_stamp":"2024-09-11T00:14:17.606538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:28:22.300564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:23.650364+0000","last_change":"2024-09-11T00:14:18.630513+0000","last_active":"2024-09-11T00:14:23.650364+0000","last_peered":"2024-09-11T00:14:23.650364+0000","last_clean":"2024-09-11T00:14:23.650364+0000","last_became_active":"2024-09-11T00:14:18.629735+0000","last_became_peered":"2024-09-11T00:14:18.629735+0000","last_unstale":"2024-09-11T00:14:23.650364+0000","last_undegraded":"2024-09-11T00:14:23.650364+0000","last_fullsized":"2024-09-11T00:14:23.650364+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_clean_scrub_stamp":"2024-09-11T00:14:17.606538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:28:22.300564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:24.883388+0000","last_change":"2024-09-11T00:14:18.630607+0000","last_active":"2024-09-11T00:14:24.883388+0000","last_peered":"2024-09-11T00:14:24.883388+0000","last_clean":"2024-09-11T00:14:24.883388+0000","last_became_active":"2024-09-11T00:14:18.629273+0000","last_became_peered":"2024-09-11T00:14:18.629273+0000","last_unstale":"2024-09-11T00:14:24.883388+0000","last_undegraded":"2024-09-11T00:14:24.883388+0000","last_fullsized":"2024-09-11T00:14:24.883388+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_clean_scrub_stamp":"2024-09-11T00:14:17.606538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:41:33.040042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:25.448538+0000","last_change":"2024-09-11T00:14:18.628576+0000","last_active":"2024-09-11T00:14:25.448538+0000","last_peered":"2024-09-11T00:14:25.448538+0000","last_clean":"2024-09-11T00:14:25.448538+0000","last_became_active":"2024-09-11T00:14:18.628238+0000","last_became_peered":"2024-09-11T00:14:18.628238+0000","last_unstale":"2024-09-11T00:14:25.448538+0000","last_undegraded":"2024-09-11T00:14:25.448538+0000","last_fullsized":"2024-09-11T00:14:25.448538+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_clean_scrub_stamp":"2024-09-11T00:14:17.606538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:49:06.208715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:25.443654+0000","last_change":"2024-09-11T00:14:18.644648+0000","last_active":"2024-09-11T00:14:25.443654+0000","last_peered":"2024-09-11T00:14:25.443654+0000","last_clean":"2024-09-11T00:14:25.443654+0000","last_became_active":"2024-09-11T00:14:18.644076+0000","last_became_peered":"2024-09-11T00:14:18.644076+0000","last_unstale":"2024-09-11T00:14:25.443654+0000","last_undegraded":"2024-09-11T00:14:25.443654+0000","last_fullsized":"2024-09-11T00:14:25.443654+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_clean_scrub_stamp":"2024-09-11T00:14:17.606538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:07:37.621540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509449,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27864,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343976,"statfs":{"total":96636764160,"available":96608231424,"internally_reserved":0,"allocated":856064,"data_stored":693611,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509449,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":262144,"data_stored":102751,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509448,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":270336,"data_stored":102787,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509448,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":270336,"data_stored":106503,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509450,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":266240,"data_stored":102821,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509449,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27872,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343968,"statfs":{"total":96636764160,"available":96608223232,"internally_reserved":0,"allocated":864256,"data_stored":693667,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542153,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":258048,"data_stored":102661,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574857,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":270336,"data_stored":106503,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T00:14:38.982 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-11T00:14:38.982 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config log 1 --format=json 2024-09-11T00:14:38.982 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-09-11T00:14:39.119 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:39.117+0000 7f2a83100640 1 -- 172.21.15.92:0/3424938316 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2a7c0ceb00 msgr2=0x7f2a7c0cef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:39.119 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:39.117+0000 7f2a83100640 1 --2- 172.21.15.92:0/3424938316 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2a7c0ceb00 0x7f2a7c0cef90 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f2a7c076350 tx=0x7f2a7402a980 comp rx=0 tx=0).stop 2024-09-11T00:14:39.119 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:39.117+0000 7f2a83100640 1 -- 172.21.15.92:0/3424938316 shutdown_connections 2024-09-11T00:14:39.119 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:39.117+0000 7f2a83100640 1 --2- 172.21.15.92:0/3424938316 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2a7c0ceb00 0x7f2a7c0cef90 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:39.119 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:39.117+0000 7f2a83100640 1 --2- 172.21.15.92:0/3424938316 >> v2:172.21.15.145:3300/0 conn(0x7f2a7c072680 0x7f2a7c072aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:39.119 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:39.117+0000 7f2a83100640 1 --2- 172.21.15.92:0/3424938316 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2a7c144780 0x7f2a7c0b3da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:39.119 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:39.117+0000 7f2a83100640 1 -- 172.21.15.92:0/3424938316 >> 172.21.15.92:0/3424938316 conn(0x7f2a7c0b1760 msgr2=0x7f2a7c0b1b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:14:39.119 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:39.117+0000 7f2a83100640 1 -- 172.21.15.92:0/3424938316 shutdown_connections 2024-09-11T00:14:39.120 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:39.117+0000 7f2a83100640 1 -- 172.21.15.92:0/3424938316 wait complete. 2024-09-11T00:14:39.122 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:39.118+0000 7f2a83100640 1 Processor -- start 2024-09-11T00:14:39.122 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:39.118+0000 7f2a83100640 1 -- start start 2024-09-11T00:14:39.122 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:39.119+0000 7f2a83100640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2a7c072680 0x7f2a7c141530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:39.122 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:39.119+0000 7f2a83100640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2a7c0ceb00 0x7f2a7c160b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:39.122 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:39.119+0000 7f2a83100640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2a7c144780 0x7f2a7c162b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:39.122 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:39.119+0000 7f2a83100640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f2a7c15c8e0 con 0x7f2a7c072680 2024-09-11T00:14:39.122 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:39.119+0000 7f2a83100640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f2a7c15c760 con 0x7f2a7c144780 2024-09-11T00:14:39.122 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:39.119+0000 7f2a83100640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f2a7c15ca60 con 0x7f2a7c0ceb00 2024-09-11T00:14:39.122 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:39.119+0000 7f2a80e9c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2a7c072680 0x7f2a7c141530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:39.122 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:39.119+0000 7f2a80e9c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2a7c072680 0x7f2a7c141530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:50282/0 (socket says 172.21.15.92:50282) 2024-09-11T00:14:39.122 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:39.119+0000 7f2a80e9c640 1 -- 172.21.15.92:0/2802887270 learned_addr learned my addr 172.21.15.92:0/2802887270 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-11T00:14:39.123 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:39.119+0000 7f2a8169d640 1 --2- 172.21.15.92:0/2802887270 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2a7c144780 0x7f2a7c162b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:39.123 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:39.119+0000 7f2a7bfff640 1 --2- 172.21.15.92:0/2802887270 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2a7c0ceb00 0x7f2a7c160b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:39.123 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:39.119+0000 7f2a80e9c640 1 -- 172.21.15.92:0/2802887270 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2a7c0ceb00 msgr2=0x7f2a7c160b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:39.123 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:39.119+0000 7f2a80e9c640 1 --2- 172.21.15.92:0/2802887270 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2a7c0ceb00 0x7f2a7c160b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:39.123 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:39.119+0000 7f2a80e9c640 1 -- 172.21.15.92:0/2802887270 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2a7c144780 msgr2=0x7f2a7c162b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:39.123 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:39.119+0000 7f2a80e9c640 1 --2- 172.21.15.92:0/2802887270 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2a7c144780 0x7f2a7c162b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:39.123 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:39.119+0000 7f2a80e9c640 1 -- 172.21.15.92:0/2802887270 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a7c161050 con 0x7f2a7c072680 2024-09-11T00:14:39.123 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:39.119+0000 7f2a8169d640 1 --2- 172.21.15.92:0/2802887270 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2a7c144780 0x7f2a7c162b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:14:39.123 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:39.119+0000 7f2a7bfff640 1 --2- 172.21.15.92:0/2802887270 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2a7c0ceb00 0x7f2a7c160b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:14:39.123 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:39.119+0000 7f2a80e9c640 1 --2- 172.21.15.92:0/2802887270 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2a7c072680 0x7f2a7c141530 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f2a6c00c9a0 tx=0x7f2a6c00ce60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:14:39.123 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:39.120+0000 7f2a797fa640 1 -- 172.21.15.92:0/2802887270 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a6c007bb0 con 0x7f2a7c072680 2024-09-11T00:14:39.123 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:39.120+0000 7f2a797fa640 1 -- 172.21.15.92:0/2802887270 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2a6c007e40 con 0x7f2a7c072680 2024-09-11T00:14:39.123 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:39.120+0000 7f2a83100640 1 -- 172.21.15.92:0/2802887270 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a7c1612f0 con 0x7f2a7c072680 2024-09-11T00:14:39.124 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:39.120+0000 7f2a797fa640 1 -- 172.21.15.92:0/2802887270 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a6c00f690 con 0x7f2a7c072680 2024-09-11T00:14:39.124 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:39.120+0000 7f2a83100640 1 -- 172.21.15.92:0/2802887270 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a7c1615d0 con 0x7f2a7c072680 2024-09-11T00:14:39.124 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:39.121+0000 7f2a83100640 1 -- 172.21.15.92:0/2802887270 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2a7c15cf10 con 0x7f2a7c072680 2024-09-11T00:14:39.125 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:39.121+0000 7f2a797fa640 1 -- 172.21.15.92:0/2802887270 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f2a6c020030 con 0x7f2a7c072680 2024-09-11T00:14:39.125 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:39.122+0000 7f2a797fa640 1 --2- 172.21.15.92:0/2802887270 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f2a68077f70 0x7f2a6807a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:39.125 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:39.122+0000 7f2a797fa640 1 -- 172.21.15.92:0/2802887270 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f2a6c09a560 con 0x7f2a7c072680 2024-09-11T00:14:39.125 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:39.122+0000 7f2a7bfff640 1 --2- 172.21.15.92:0/2802887270 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f2a68077f70 0x7f2a6807a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:39.125 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:39.122+0000 7f2a7bfff640 1 --2- 172.21.15.92:0/2802887270 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f2a68077f70 0x7f2a6807a430 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f2a70005fd0 tx=0x7f2a70005d40 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:14:39.127 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:39.126+0000 7f2a797fa640 1 -- 172.21.15.92:0/2802887270 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f2a6c014030 con 0x7f2a7c072680 2024-09-11T00:14:39.304 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:39.302+0000 7f2a83100640 1 -- 172.21.15.92:0/2802887270 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "config log", "num": 1, "format": "json"} v 0) -- 0x7f2a7c06f170 con 0x7f2a7c072680 2024-09-11T00:14:39.304 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:39.302+0000 7f2a797fa640 1 -- 172.21.15.92:0/2802887270 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "config log", "num": 1, "format": "json"}]=0 v27) ==== 86+0+160 (secure 0 0 0) 0x7f2a6c062db0 con 0x7f2a7c072680 2024-09-11T00:14:39.304 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:14:39.307 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:39.305+0000 7f2a83100640 1 -- 172.21.15.92:0/2802887270 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f2a68077f70 msgr2=0x7f2a6807a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:39.307 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:39.305+0000 7f2a83100640 1 --2- 172.21.15.92:0/2802887270 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f2a68077f70 0x7f2a6807a430 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f2a70005fd0 tx=0x7f2a70005d40 comp rx=0 tx=0).stop 2024-09-11T00:14:39.307 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:39.305+0000 7f2a83100640 1 -- 172.21.15.92:0/2802887270 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2a7c072680 msgr2=0x7f2a7c141530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:39.307 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:39.305+0000 7f2a83100640 1 --2- 172.21.15.92:0/2802887270 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2a7c072680 0x7f2a7c141530 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f2a6c00c9a0 tx=0x7f2a6c00ce60 comp rx=0 tx=0).stop 2024-09-11T00:14:39.307 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:39.305+0000 7f2a83100640 1 -- 172.21.15.92:0/2802887270 shutdown_connections 2024-09-11T00:14:39.307 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:39.305+0000 7f2a83100640 1 --2- 172.21.15.92:0/2802887270 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f2a68077f70 0x7f2a6807a430 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:39.307 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:39.305+0000 7f2a83100640 1 --2- 172.21.15.92:0/2802887270 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2a7c144780 0x7f2a7c162b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:39.307 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:39.305+0000 7f2a83100640 1 --2- 172.21.15.92:0/2802887270 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2a7c0ceb00 0x7f2a7c160b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:39.307 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:39.305+0000 7f2a83100640 1 --2- 172.21.15.92:0/2802887270 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2a7c072680 0x7f2a7c141530 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:39.307 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:39.305+0000 7f2a83100640 1 -- 172.21.15.92:0/2802887270 >> 172.21.15.92:0/2802887270 conn(0x7f2a7c0b1760 msgr2=0x7f2a7c0b1b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:14:39.308 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:39.305+0000 7f2a83100640 1 -- 172.21.15.92:0/2802887270 shutdown_connections 2024-09-11T00:14:39.308 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:39.305+0000 7f2a83100640 1 -- 172.21.15.92:0/2802887270 wait complete. 2024-09-11T00:14:39.317 INFO:teuthology.orchestra.run.smithi092.stdout:[{"version":27,"timestamp":"2024-09-11T00:14:06.141885+0000","name":"","changes":[{"name":"osd.4/osd_mclock_max_capacity_iops_ssd","new_value":"9313.333595"}]}] 2024-09-11T00:14:39.317 INFO:tasks.ceph_manager:config epoch is 27 2024-09-11T00:14:39.317 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-11T00:14:39.318 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-09-11T00:14:39.318 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-09-11T00:14:39.418 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:39.416+0000 7f7761317640 1 -- 172.21.15.92:0/1717288090 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f775c0d2a20 msgr2=0x7f775c0cea40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:39.418 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:39.416+0000 7f7761317640 1 --2- 172.21.15.92:0/1717288090 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f775c0d2a20 0x7f775c0cea40 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f7754009830 tx=0x7f775402a4d0 comp rx=0 tx=0).stop 2024-09-11T00:14:39.419 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:39.417+0000 7f7761317640 1 -- 172.21.15.92:0/1717288090 shutdown_connections 2024-09-11T00:14:39.419 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:39.417+0000 7f7761317640 1 --2- 172.21.15.92:0/1717288090 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f775c0d2a20 0x7f775c0cea40 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:39.419 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:39.417+0000 7f7761317640 1 --2- 172.21.15.92:0/1717288090 >> v2:172.21.15.145:3300/0 conn(0x7f775c0d4af0 0x7f775c0d24e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:39.419 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:39.417+0000 7f7761317640 1 -- 172.21.15.92:0/1717288090 >> 172.21.15.92:0/1717288090 conn(0x7f775c0d3f70 msgr2=0x7f775c0d4350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:14:39.419 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:39.417+0000 7f7761317640 1 -- 172.21.15.92:0/1717288090 shutdown_connections 2024-09-11T00:14:39.419 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:39.417+0000 7f7761317640 1 -- 172.21.15.92:0/1717288090 wait complete. 2024-09-11T00:14:39.419 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:39.418+0000 7f7761317640 1 Processor -- start 2024-09-11T00:14:39.419 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:39.418+0000 7f7761317640 1 -- start start 2024-09-11T00:14:39.421 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:39.419+0000 7f7761317640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f775c0d2a20 0x7f775c0cc1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:39.421 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:39.419+0000 7f7761317640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f775c0d4af0 0x7f775c0c7a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:39.422 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:39.419+0000 7f7761317640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f775c15e060 0x7f775c15b250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:39.422 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:39.419+0000 7f7761317640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f775c0cf100 con 0x7f775c15e060 2024-09-11T00:14:39.422 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:39.419+0000 7f7761317640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f775c0cef80 con 0x7f775c0d4af0 2024-09-11T00:14:39.422 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:39.419+0000 7f7761317640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f775c0cf280 con 0x7f775c0d2a20 2024-09-11T00:14:39.422 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:39.419+0000 7f775b7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f775c15e060 0x7f775c15b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:39.422 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:39.419+0000 7f775b7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f775c15e060 0x7f775c15b250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:50302/0 (socket says 172.21.15.92:50302) 2024-09-11T00:14:39.422 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:39.419+0000 7f775b7fe640 1 -- 172.21.15.92:0/4273685735 learned_addr learned my addr 172.21.15.92:0/4273685735 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-11T00:14:39.422 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:39.419+0000 7f775affd640 1 --2- 172.21.15.92:0/4273685735 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f775c0d2a20 0x7f775c0cc1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:39.422 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:39.419+0000 7f775a7fc640 1 --2- 172.21.15.92:0/4273685735 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f775c0d4af0 0x7f775c0c7a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:39.422 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:39.419+0000 7f775b7fe640 1 -- 172.21.15.92:0/4273685735 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f775c0d2a20 msgr2=0x7f775c0cc1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:39.422 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:39.419+0000 7f775b7fe640 1 --2- 172.21.15.92:0/4273685735 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f775c0d2a20 0x7f775c0cc1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:39.422 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:39.419+0000 7f775b7fe640 1 -- 172.21.15.92:0/4273685735 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f775c0d4af0 msgr2=0x7f775c0c7a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:39.422 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:39.419+0000 7f775b7fe640 1 --2- 172.21.15.92:0/4273685735 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f775c0d4af0 0x7f775c0c7a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:39.423 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:39.419+0000 7f775b7fe640 1 -- 172.21.15.92:0/4273685735 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f775c0ca400 con 0x7f775c15e060 2024-09-11T00:14:39.423 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:39.419+0000 7f775a7fc640 1 --2- 172.21.15.92:0/4273685735 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f775c0d4af0 0x7f775c0c7a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:14:39.423 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:39.419+0000 7f775b7fe640 1 --2- 172.21.15.92:0/4273685735 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f775c15e060 0x7f775c15b250 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f775402aac0 tx=0x7f7754032b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:14:39.423 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:39.419+0000 7f77437fe640 1 -- 172.21.15.92:0/4273685735 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7754040070 con 0x7f775c15e060 2024-09-11T00:14:39.423 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:39.420+0000 7f77437fe640 1 -- 172.21.15.92:0/4273685735 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7754005310 con 0x7f775c15e060 2024-09-11T00:14:39.423 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:39.420+0000 7f7761317640 1 -- 172.21.15.92:0/4273685735 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f775c1f8170 con 0x7f775c15e060 2024-09-11T00:14:39.423 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:39.420+0000 7f77437fe640 1 -- 172.21.15.92:0/4273685735 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77540047a0 con 0x7f775c15e060 2024-09-11T00:14:39.423 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:39.420+0000 7f7761317640 1 -- 172.21.15.92:0/4273685735 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f775c1f8730 con 0x7f775c15e060 2024-09-11T00:14:39.424 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:39.421+0000 7f7761317640 1 -- 172.21.15.92:0/4273685735 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f775c0cf730 con 0x7f775c15e060 2024-09-11T00:14:39.424 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:39.421+0000 7f77437fe640 1 -- 172.21.15.92:0/4273685735 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f775404c030 con 0x7f775c15e060 2024-09-11T00:14:39.424 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:39.421+0000 7f77437fe640 1 --2- 172.21.15.92:0/4273685735 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f7748077f70 0x7f774807a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:39.424 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:39.422+0000 7f77437fe640 1 -- 172.21.15.92:0/4273685735 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f77540bb160 con 0x7f775c15e060 2024-09-11T00:14:39.424 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:39.422+0000 7f775affd640 1 --2- 172.21.15.92:0/4273685735 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f7748077f70 0x7f774807a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:39.424 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:39.422+0000 7f775affd640 1 --2- 172.21.15.92:0/4273685735 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f7748077f70 0x7f774807a430 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f774c0012e0 tx=0x7f774c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:14:39.427 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:39.426+0000 7f77437fe640 1 -- 172.21.15.92:0/4273685735 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f7754083920 con 0x7f775c15e060 2024-09-11T00:14:39.645 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:39.644+0000 7f7761317640 1 -- 172.21.15.92:0/4273685735 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f775c06e8e0 con 0x7f775c15e060 2024-09-11T00:14:39.648 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:39.647+0000 7f77437fe640 1 -- 172.21.15.92:0/4273685735 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+193247 (secure 0 0 0) 0x7f7754083220 con 0x7f775c15e060 2024-09-11T00:14:39.650 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:14:39.652 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:39.649+0000 7f7761317640 1 -- 172.21.15.92:0/4273685735 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f7748077f70 msgr2=0x7f774807a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:39.652 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:39.649+0000 7f7761317640 1 --2- 172.21.15.92:0/4273685735 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f7748077f70 0x7f774807a430 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f774c0012e0 tx=0x7f774c009040 comp rx=0 tx=0).stop 2024-09-11T00:14:39.652 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:39.649+0000 7f7761317640 1 -- 172.21.15.92:0/4273685735 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f775c15e060 msgr2=0x7f775c15b250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:39.652 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:39.649+0000 7f7761317640 1 --2- 172.21.15.92:0/4273685735 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f775c15e060 0x7f775c15b250 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f775402aac0 tx=0x7f7754032b90 comp rx=0 tx=0).stop 2024-09-11T00:14:39.652 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:39.649+0000 7f7761317640 1 -- 172.21.15.92:0/4273685735 shutdown_connections 2024-09-11T00:14:39.652 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:39.649+0000 7f7761317640 1 --2- 172.21.15.92:0/4273685735 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f7748077f70 0x7f774807a430 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:39.652 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:39.650+0000 7f7761317640 1 --2- 172.21.15.92:0/4273685735 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f775c15e060 0x7f775c15b250 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:39.652 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:39.650+0000 7f7761317640 1 --2- 172.21.15.92:0/4273685735 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f775c0d4af0 0x7f775c0c7a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:39.653 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:39.650+0000 7f7761317640 1 --2- 172.21.15.92:0/4273685735 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f775c0d2a20 0x7f775c0cc1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:39.653 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:39.650+0000 7f7761317640 1 -- 172.21.15.92:0/4273685735 >> 172.21.15.92:0/4273685735 conn(0x7f775c0d3f70 msgr2=0x7f775c15d630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:14:39.653 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:39.650+0000 7f7761317640 1 -- 172.21.15.92:0/4273685735 shutdown_connections 2024-09-11T00:14:39.653 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:39.650+0000 7f7761317640 1 -- 172.21.15.92:0/4273685735 wait complete. 2024-09-11T00:14:39.662 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":5,"flags":0,"active_gid":4100,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6800","nonce":325490785},{"type":"v1","addr":"172.21.15.145:6801","nonce":325490785}]},"active_addr":"172.21.15.145:6801/325490785","active_change":"2024-09-11T00:13:58.264102+0000","active_mgr_features":4540719139924082687,"available":true,"standbys":[{"gid":4105,"name":"y","mgr_features":4540719139924082687,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:1.26.1","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:latest","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB metrics exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:1.26.1","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:latest","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB metrics exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"force_disabled_modules":{},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.145:0","nonce":1103465027}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.145:0","nonce":1668660427}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.145:0","nonce":2029914832}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.145:0","nonce":2866357657}]}]} 2024-09-11T00:14:39.667 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-09-11T00:14:39.667 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-11T00:14:39.667 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T00:14:39.768 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:39.766+0000 7f054c1da640 1 -- 172.21.15.92:0/3852928273 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0544070760 msgr2=0x7f05440d2830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:39.768 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:39.766+0000 7f054c1da640 1 --2- 172.21.15.92:0/3852928273 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0544070760 0x7f05440d2830 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f05440ccb30 tx=0x7f053c02a890 comp rx=0 tx=0).stop 2024-09-11T00:14:39.769 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:39.766+0000 7f054c1da640 1 -- 172.21.15.92:0/3852928273 shutdown_connections 2024-09-11T00:14:39.769 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:39.766+0000 7f054c1da640 1 --2- 172.21.15.92:0/3852928273 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0544070760 0x7f05440d2830 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:39.769 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:39.766+0000 7f054c1da640 1 -- 172.21.15.92:0/3852928273 >> 172.21.15.92:0/3852928273 conn(0x7f05440d1d10 msgr2=0x7f05440d2120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:14:39.769 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:39.766+0000 7f054c1da640 1 -- 172.21.15.92:0/3852928273 shutdown_connections 2024-09-11T00:14:39.769 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:39.766+0000 7f054c1da640 1 -- 172.21.15.92:0/3852928273 wait complete. 2024-09-11T00:14:39.771 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:39.767+0000 7f054c1da640 1 Processor -- start 2024-09-11T00:14:39.771 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:39.768+0000 7f054c1da640 1 -- start start 2024-09-11T00:14:39.771 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:39.768+0000 7f054c1da640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0544070760 0x7f05441585a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:39.772 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:39.768+0000 7f054c1da640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f05440d0a00 0x7f05440b6820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:39.772 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:39.768+0000 7f054c1da640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f054415be00 0x7f05440b6d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:39.772 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:39.768+0000 7f054c1da640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f05440cfc70 con 0x7f054415be00 2024-09-11T00:14:39.772 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:39.768+0000 7f054c1da640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f05440cfaf0 con 0x7f0544070760 2024-09-11T00:14:39.772 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:39.768+0000 7f054c1da640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f05440cfdf0 con 0x7f05440d0a00 2024-09-11T00:14:39.772 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:39.768+0000 7f054a777640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f054415be00 0x7f05440b6d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:39.772 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:39.768+0000 7f054a777640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f054415be00 0x7f05440b6d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:50326/0 (socket says 172.21.15.92:50326) 2024-09-11T00:14:39.772 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:39.768+0000 7f054a777640 1 -- 172.21.15.92:0/2910159107 learned_addr learned my addr 172.21.15.92:0/2910159107 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-11T00:14:39.772 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:39.769+0000 7f0549f76640 1 --2- 172.21.15.92:0/2910159107 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0544070760 0x7f05441585a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:39.772 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:39.769+0000 7f054a777640 1 -- 172.21.15.92:0/2910159107 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f05440d0a00 msgr2=0x7f05440b6820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:39.772 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:39.769+0000 7f054a777640 1 --2- 172.21.15.92:0/2910159107 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f05440d0a00 0x7f05440b6820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:39.773 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:39.769+0000 7f054a777640 1 -- 172.21.15.92:0/2910159107 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0544070760 msgr2=0x7f05441585a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:39.773 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:39.769+0000 7f054a777640 1 --2- 172.21.15.92:0/2910159107 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0544070760 0x7f05441585a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:39.773 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:39.769+0000 7f054a777640 1 -- 172.21.15.92:0/2910159107 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05441f8d40 con 0x7f054415be00 2024-09-11T00:14:39.773 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:39.769+0000 7f054a777640 1 --2- 172.21.15.92:0/2910159107 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f054415be00 0x7f05440b6d60 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f053c02ae80 tx=0x7f053c003f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:14:39.773 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:39.769+0000 7f053a7fc640 1 -- 172.21.15.92:0/2910159107 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f053c031d80 con 0x7f054415be00 2024-09-11T00:14:39.773 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:39.769+0000 7f054c1da640 1 -- 172.21.15.92:0/2910159107 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f054415a6a0 con 0x7f054415be00 2024-09-11T00:14:39.773 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:39.769+0000 7f053a7fc640 1 -- 172.21.15.92:0/2910159107 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f053c004130 con 0x7f054415be00 2024-09-11T00:14:39.773 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:39.769+0000 7f053a7fc640 1 -- 172.21.15.92:0/2910159107 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f053c004560 con 0x7f054415be00 2024-09-11T00:14:39.773 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:39.769+0000 7f054c1da640 1 -- 172.21.15.92:0/2910159107 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0544158ae0 con 0x7f054415be00 2024-09-11T00:14:39.773 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:39.770+0000 7f054c1da640 1 -- 172.21.15.92:0/2910159107 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0544071ea0 con 0x7f054415be00 2024-09-11T00:14:39.774 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:39.771+0000 7f053a7fc640 1 -- 172.21.15.92:0/2910159107 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f053c03c420 con 0x7f054415be00 2024-09-11T00:14:39.774 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:39.771+0000 7f053a7fc640 1 --2- 172.21.15.92:0/2910159107 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f0528077f70 0x7f052807a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:39.774 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:39.771+0000 7f053a7fc640 1 -- 172.21.15.92:0/2910159107 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f053c0bb740 con 0x7f054415be00 2024-09-11T00:14:39.774 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:39.771+0000 7f0549f76640 1 --2- 172.21.15.92:0/2910159107 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f0528077f70 0x7f052807a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:39.774 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:39.772+0000 7f0549f76640 1 --2- 172.21.15.92:0/2910159107 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f0528077f70 0x7f052807a430 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f0540000f60 tx=0x7f0540009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:14:39.777 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:39.775+0000 7f053a7fc640 1 -- 172.21.15.92:0/2910159107 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f0544071ea0 con 0x7f054415be00 2024-09-11T00:14:39.954 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:39.952+0000 7f054c1da640 1 -- 172.21.15.92:0/2910159107 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f05440c8ba0 con 0x7f054415be00 2024-09-11T00:14:39.955 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:39.953+0000 7f053a7fc640 1 -- 172.21.15.92:0/2910159107 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18622 (secure 0 0 0) 0x7f05440c8ba0 con 0x7f054415be00 2024-09-11T00:14:39.955 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:14:39.955 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":25,"fsid":"47039cb3-5d2a-46bf-9066-8055b5dfc583","created":"2024-09-11T00:13:53.889939+0000","modified":"2024-09-11T00:14:23.001261+0000","last_up_change":"2024-09-11T00:14:06.563107+0000","last_in_change":"2024-09-11T00:13:56.982537+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T00:14:06.287223+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-11T00:14:15.739528+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-11T00:14:16.925480+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-11T00:14:20.639419+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"538af0ea-96c9-4999-9ccc-bee55f80ff76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":2860560077},{"type":"v1","addr":"172.21.15.92:6801","nonce":2860560077}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":2860560077},{"type":"v1","addr":"172.21.15.92:6803","nonce":2860560077}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":2860560077},{"type":"v1","addr":"172.21.15.92:6807","nonce":2860560077}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":2860560077},{"type":"v1","addr":"172.21.15.92:6805","nonce":2860560077}]},"public_addr":"172.21.15.92:6801/2860560077","cluster_addr":"172.21.15.92:6803/2860560077","heartbeat_back_addr":"172.21.15.92:6807/2860560077","heartbeat_front_addr":"172.21.15.92:6805/2860560077","state":["exists","up"]},{"osd":1,"uuid":"f9214f2c-ffe6-4447-9a13-9549a36e0537","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":2600417443},{"type":"v1","addr":"172.21.15.92:6817","nonce":2600417443}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6818","nonce":2600417443},{"type":"v1","addr":"172.21.15.92:6819","nonce":2600417443}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6822","nonce":2600417443},{"type":"v1","addr":"172.21.15.92:6823","nonce":2600417443}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":2600417443},{"type":"v1","addr":"172.21.15.92:6821","nonce":2600417443}]},"public_addr":"172.21.15.92:6817/2600417443","cluster_addr":"172.21.15.92:6819/2600417443","heartbeat_back_addr":"172.21.15.92:6823/2600417443","heartbeat_front_addr":"172.21.15.92:6821/2600417443","state":["exists","up"]},{"osd":2,"uuid":"b44dd849-fb85-42b1-8a1a-b6681bb1f467","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":3143892898},{"type":"v1","addr":"172.21.15.92:6809","nonce":3143892898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":3143892898},{"type":"v1","addr":"172.21.15.92:6811","nonce":3143892898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":3143892898},{"type":"v1","addr":"172.21.15.92:6815","nonce":3143892898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":3143892898},{"type":"v1","addr":"172.21.15.92:6813","nonce":3143892898}]},"public_addr":"172.21.15.92:6809/3143892898","cluster_addr":"172.21.15.92:6811/3143892898","heartbeat_back_addr":"172.21.15.92:6815/3143892898","heartbeat_front_addr":"172.21.15.92:6813/3143892898","state":["exists","up"]},{"osd":3,"uuid":"05a49d87-23b9-48dd-962c-d5c2686e7a32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":3913961488},{"type":"v1","addr":"172.21.15.92:6825","nonce":3913961488}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6826","nonce":3913961488},{"type":"v1","addr":"172.21.15.92:6827","nonce":3913961488}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":3913961488},{"type":"v1","addr":"172.21.15.92:6831","nonce":3913961488}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":3913961488},{"type":"v1","addr":"172.21.15.92:6829","nonce":3913961488}]},"public_addr":"172.21.15.92:6825/3913961488","cluster_addr":"172.21.15.92:6827/3913961488","heartbeat_back_addr":"172.21.15.92:6831/3913961488","heartbeat_front_addr":"172.21.15.92:6829/3913961488","state":["exists","up"]},{"osd":4,"uuid":"cf52b087-afe0-4f43-a4e7-db2ebc158815","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6826","nonce":2206798907},{"type":"v1","addr":"172.21.15.145:6827","nonce":2206798907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6828","nonce":2206798907},{"type":"v1","addr":"172.21.15.145:6829","nonce":2206798907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6832","nonce":2206798907},{"type":"v1","addr":"172.21.15.145:6833","nonce":2206798907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6830","nonce":2206798907},{"type":"v1","addr":"172.21.15.145:6831","nonce":2206798907}]},"public_addr":"172.21.15.145:6827/2206798907","cluster_addr":"172.21.15.145:6829/2206798907","heartbeat_back_addr":"172.21.15.145:6833/2206798907","heartbeat_front_addr":"172.21.15.145:6831/2206798907","state":["exists","up"]},{"osd":5,"uuid":"0e54adcd-2d1d-49fb-bf97-3dd7e9addd30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6810","nonce":2599548493},{"type":"v1","addr":"172.21.15.145:6811","nonce":2599548493}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6812","nonce":2599548493},{"type":"v1","addr":"172.21.15.145:6813","nonce":2599548493}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6816","nonce":2599548493},{"type":"v1","addr":"172.21.15.145:6817","nonce":2599548493}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6814","nonce":2599548493},{"type":"v1","addr":"172.21.15.145:6815","nonce":2599548493}]},"public_addr":"172.21.15.145:6811/2599548493","cluster_addr":"172.21.15.145:6813/2599548493","heartbeat_back_addr":"172.21.15.145:6817/2599548493","heartbeat_front_addr":"172.21.15.145:6815/2599548493","state":["exists","up"]},{"osd":6,"uuid":"4d5ae7a8-b3df-4c7a-9124-290f239f5b57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6802","nonce":4192380792},{"type":"v1","addr":"172.21.15.145:6803","nonce":4192380792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6804","nonce":4192380792},{"type":"v1","addr":"172.21.15.145:6805","nonce":4192380792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6808","nonce":4192380792},{"type":"v1","addr":"172.21.15.145:6809","nonce":4192380792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6806","nonce":4192380792},{"type":"v1","addr":"172.21.15.145:6807","nonce":4192380792}]},"public_addr":"172.21.15.145:6803/4192380792","cluster_addr":"172.21.15.145:6805/4192380792","heartbeat_back_addr":"172.21.15.145:6809/4192380792","heartbeat_front_addr":"172.21.15.145:6807/4192380792","state":["exists","up"]},{"osd":7,"uuid":"d7e36444-6e3f-4372-81d3-88e7b4e993f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6818","nonce":3010598400},{"type":"v1","addr":"172.21.15.145:6819","nonce":3010598400}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6820","nonce":3010598400},{"type":"v1","addr":"172.21.15.145:6821","nonce":3010598400}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6824","nonce":3010598400},{"type":"v1","addr":"172.21.15.145:6825","nonce":3010598400}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6822","nonce":3010598400},{"type":"v1","addr":"172.21.15.145:6823","nonce":3010598400}]},"public_addr":"172.21.15.145:6819/3010598400","cluster_addr":"172.21.15.145:6821/3010598400","heartbeat_back_addr":"172.21.15.145:6825/3010598400","heartbeat_front_addr":"172.21.15.145:6823/3010598400","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:14:03.281892+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:14:04.039021+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:14:03.045775+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:14:03.708856+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:14:04.425520+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:14:03.839369+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:14:03.029834+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:14:03.707529+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T00:14:39.957 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:39.955+0000 7f054c1da640 1 -- 172.21.15.92:0/2910159107 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f0528077f70 msgr2=0x7f052807a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:39.957 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:39.955+0000 7f054c1da640 1 --2- 172.21.15.92:0/2910159107 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f0528077f70 0x7f052807a430 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f0540000f60 tx=0x7f0540009040 comp rx=0 tx=0).stop 2024-09-11T00:14:39.957 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:39.955+0000 7f054c1da640 1 -- 172.21.15.92:0/2910159107 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f054415be00 msgr2=0x7f05440b6d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:39.958 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:39.955+0000 7f054c1da640 1 --2- 172.21.15.92:0/2910159107 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f054415be00 0x7f05440b6d60 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f053c02ae80 tx=0x7f053c003f90 comp rx=0 tx=0).stop 2024-09-11T00:14:39.958 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:39.956+0000 7f054c1da640 1 -- 172.21.15.92:0/2910159107 shutdown_connections 2024-09-11T00:14:39.958 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:39.956+0000 7f054c1da640 1 --2- 172.21.15.92:0/2910159107 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f0528077f70 0x7f052807a430 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:39.958 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:39.956+0000 7f054c1da640 1 --2- 172.21.15.92:0/2910159107 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f054415be00 0x7f05440b6d60 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:39.958 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:39.956+0000 7f054c1da640 1 --2- 172.21.15.92:0/2910159107 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f05440d0a00 0x7f05440b6820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:39.958 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:39.956+0000 7f054c1da640 1 --2- 172.21.15.92:0/2910159107 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0544070760 0x7f05441585a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:39.958 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:39.956+0000 7f054c1da640 1 -- 172.21.15.92:0/2910159107 >> 172.21.15.92:0/2910159107 conn(0x7f05440d1d10 msgr2=0x7f05440b25d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:14:39.958 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:39.956+0000 7f054c1da640 1 -- 172.21.15.92:0/2910159107 shutdown_connections 2024-09-11T00:14:39.958 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:39.956+0000 7f054c1da640 1 -- 172.21.15.92:0/2910159107 wait complete. 2024-09-11T00:14:39.968 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-11T00:14:39.969 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T00:14:40.070 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.068+0000 7f205584f640 1 -- 172.21.15.92:0/333419176 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f20500d4af0 msgr2=0x7f20500cea40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:40.070 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.068+0000 7f205584f640 1 --2- 172.21.15.92:0/333419176 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f20500d4af0 0x7f20500cea40 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f2040005fd0 tx=0x7f204002a4a0 comp rx=0 tx=0).stop 2024-09-11T00:14:40.071 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.068+0000 7f205584f640 1 -- 172.21.15.92:0/333419176 shutdown_connections 2024-09-11T00:14:40.071 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.068+0000 7f205584f640 1 --2- 172.21.15.92:0/333419176 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f20500d4af0 0x7f20500cea40 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:40.071 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.068+0000 7f205584f640 1 --2- 172.21.15.92:0/333419176 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f205015e060 0x7f20500b6dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:40.071 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.068+0000 7f205584f640 1 -- 172.21.15.92:0/333419176 >> 172.21.15.92:0/333419176 conn(0x7f20500d3f70 msgr2=0x7f20500d4350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:14:40.071 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.068+0000 7f205584f640 1 -- 172.21.15.92:0/333419176 shutdown_connections 2024-09-11T00:14:40.071 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.068+0000 7f205584f640 1 -- 172.21.15.92:0/333419176 wait complete. 2024-09-11T00:14:40.073 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.070+0000 7f205584f640 1 Processor -- start 2024-09-11T00:14:40.073 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.070+0000 7f205584f640 1 -- start start 2024-09-11T00:14:40.073 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.070+0000 7f205584f640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f20500d4af0 0x7f205015ff60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:40.073 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.070+0000 7f205584f640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f205015e060 0x7f2050160950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:40.073 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.070+0000 7f205584f640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2050160e90 0x7f20501f7f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:40.073 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.070+0000 7f205584f640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f20500cef80 con 0x7f20500d4af0 2024-09-11T00:14:40.073 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.070+0000 7f205584f640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f20500d2eb0 con 0x7f2050160e90 2024-09-11T00:14:40.073 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.070+0000 7f205584f640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f20500cf100 con 0x7f205015e060 2024-09-11T00:14:40.073 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.071+0000 7f204effd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f20500d4af0 0x7f205015ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:40.074 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.071+0000 7f204effd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f20500d4af0 0x7f205015ff60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:50346/0 (socket says 172.21.15.92:50346) 2024-09-11T00:14:40.074 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.071+0000 7f204effd640 1 -- 172.21.15.92:0/2377338690 learned_addr learned my addr 172.21.15.92:0/2377338690 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-11T00:14:40.074 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.071+0000 7f204e7fc640 1 --2- 172.21.15.92:0/2377338690 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f205015e060 0x7f2050160950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:40.074 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.071+0000 7f204f7fe640 1 --2- 172.21.15.92:0/2377338690 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2050160e90 0x7f20501f7f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:40.074 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.071+0000 7f204effd640 1 -- 172.21.15.92:0/2377338690 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f205015e060 msgr2=0x7f2050160950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:40.074 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.071+0000 7f204effd640 1 --2- 172.21.15.92:0/2377338690 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f205015e060 0x7f2050160950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:40.074 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.071+0000 7f204effd640 1 -- 172.21.15.92:0/2377338690 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2050160e90 msgr2=0x7f20501f7f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:40.074 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.071+0000 7f204effd640 1 --2- 172.21.15.92:0/2377338690 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2050160e90 0x7f20501f7f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:40.074 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.071+0000 7f204effd640 1 -- 172.21.15.92:0/2377338690 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20501f4930 con 0x7f20500d4af0 2024-09-11T00:14:40.074 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.071+0000 7f204effd640 1 --2- 172.21.15.92:0/2377338690 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f20500d4af0 0x7f205015ff60 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f204800c970 tx=0x7f204800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:14:40.074 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.071+0000 7f2047fff640 1 -- 172.21.15.92:0/2377338690 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2048007bb0 con 0x7f20500d4af0 2024-09-11T00:14:40.074 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.071+0000 7f2047fff640 1 -- 172.21.15.92:0/2377338690 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2048007e40 con 0x7f20500d4af0 2024-09-11T00:14:40.074 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.071+0000 7f205584f640 1 -- 172.21.15.92:0/2377338690 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20501f4ba0 con 0x7f20500d4af0 2024-09-11T00:14:40.075 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.071+0000 7f2047fff640 1 -- 172.21.15.92:0/2377338690 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f204800f690 con 0x7f20500d4af0 2024-09-11T00:14:40.075 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.071+0000 7f205584f640 1 -- 172.21.15.92:0/2377338690 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20501f8c90 con 0x7f20500d4af0 2024-09-11T00:14:40.075 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.072+0000 7f205584f640 1 -- 172.21.15.92:0/2377338690 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f20500cea40 con 0x7f20500d4af0 2024-09-11T00:14:40.075 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.073+0000 7f2047fff640 1 -- 172.21.15.92:0/2377338690 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f2048020030 con 0x7f20500d4af0 2024-09-11T00:14:40.076 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.073+0000 7f2047fff640 1 --2- 172.21.15.92:0/2377338690 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f2030077fa0 0x7f203007a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:40.076 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.074+0000 7f2047fff640 1 -- 172.21.15.92:0/2377338690 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f204809a400 con 0x7f20500d4af0 2024-09-11T00:14:40.076 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.074+0000 7f204e7fc640 1 --2- 172.21.15.92:0/2377338690 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f2030077fa0 0x7f203007a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:40.076 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.074+0000 7f204e7fc640 1 --2- 172.21.15.92:0/2377338690 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f2030077fa0 0x7f203007a460 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f20500c8c90 tx=0x7f2038003d90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:14:40.079 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.078+0000 7f2047fff640 1 -- 172.21.15.92:0/2377338690 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f2048014030 con 0x7f20500d4af0 2024-09-11T00:14:40.255 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.253+0000 7f205584f640 1 -- 172.21.15.92:0/2377338690 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f20500b84f0 con 0x7f20500d4af0 2024-09-11T00:14:40.256 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.254+0000 7f2047fff640 1 -- 172.21.15.92:0/2377338690 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18622 (secure 0 0 0) 0x7f2048062570 con 0x7f20500d4af0 2024-09-11T00:14:40.256 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:14:40.256 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":25,"fsid":"47039cb3-5d2a-46bf-9066-8055b5dfc583","created":"2024-09-11T00:13:53.889939+0000","modified":"2024-09-11T00:14:23.001261+0000","last_up_change":"2024-09-11T00:14:06.563107+0000","last_in_change":"2024-09-11T00:13:56.982537+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T00:14:06.287223+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-11T00:14:15.739528+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-11T00:14:16.925480+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-11T00:14:20.639419+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"538af0ea-96c9-4999-9ccc-bee55f80ff76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":2860560077},{"type":"v1","addr":"172.21.15.92:6801","nonce":2860560077}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":2860560077},{"type":"v1","addr":"172.21.15.92:6803","nonce":2860560077}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":2860560077},{"type":"v1","addr":"172.21.15.92:6807","nonce":2860560077}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":2860560077},{"type":"v1","addr":"172.21.15.92:6805","nonce":2860560077}]},"public_addr":"172.21.15.92:6801/2860560077","cluster_addr":"172.21.15.92:6803/2860560077","heartbeat_back_addr":"172.21.15.92:6807/2860560077","heartbeat_front_addr":"172.21.15.92:6805/2860560077","state":["exists","up"]},{"osd":1,"uuid":"f9214f2c-ffe6-4447-9a13-9549a36e0537","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":2600417443},{"type":"v1","addr":"172.21.15.92:6817","nonce":2600417443}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6818","nonce":2600417443},{"type":"v1","addr":"172.21.15.92:6819","nonce":2600417443}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6822","nonce":2600417443},{"type":"v1","addr":"172.21.15.92:6823","nonce":2600417443}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":2600417443},{"type":"v1","addr":"172.21.15.92:6821","nonce":2600417443}]},"public_addr":"172.21.15.92:6817/2600417443","cluster_addr":"172.21.15.92:6819/2600417443","heartbeat_back_addr":"172.21.15.92:6823/2600417443","heartbeat_front_addr":"172.21.15.92:6821/2600417443","state":["exists","up"]},{"osd":2,"uuid":"b44dd849-fb85-42b1-8a1a-b6681bb1f467","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":3143892898},{"type":"v1","addr":"172.21.15.92:6809","nonce":3143892898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":3143892898},{"type":"v1","addr":"172.21.15.92:6811","nonce":3143892898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":3143892898},{"type":"v1","addr":"172.21.15.92:6815","nonce":3143892898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":3143892898},{"type":"v1","addr":"172.21.15.92:6813","nonce":3143892898}]},"public_addr":"172.21.15.92:6809/3143892898","cluster_addr":"172.21.15.92:6811/3143892898","heartbeat_back_addr":"172.21.15.92:6815/3143892898","heartbeat_front_addr":"172.21.15.92:6813/3143892898","state":["exists","up"]},{"osd":3,"uuid":"05a49d87-23b9-48dd-962c-d5c2686e7a32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":3913961488},{"type":"v1","addr":"172.21.15.92:6825","nonce":3913961488}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6826","nonce":3913961488},{"type":"v1","addr":"172.21.15.92:6827","nonce":3913961488}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":3913961488},{"type":"v1","addr":"172.21.15.92:6831","nonce":3913961488}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":3913961488},{"type":"v1","addr":"172.21.15.92:6829","nonce":3913961488}]},"public_addr":"172.21.15.92:6825/3913961488","cluster_addr":"172.21.15.92:6827/3913961488","heartbeat_back_addr":"172.21.15.92:6831/3913961488","heartbeat_front_addr":"172.21.15.92:6829/3913961488","state":["exists","up"]},{"osd":4,"uuid":"cf52b087-afe0-4f43-a4e7-db2ebc158815","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6826","nonce":2206798907},{"type":"v1","addr":"172.21.15.145:6827","nonce":2206798907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6828","nonce":2206798907},{"type":"v1","addr":"172.21.15.145:6829","nonce":2206798907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6832","nonce":2206798907},{"type":"v1","addr":"172.21.15.145:6833","nonce":2206798907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6830","nonce":2206798907},{"type":"v1","addr":"172.21.15.145:6831","nonce":2206798907}]},"public_addr":"172.21.15.145:6827/2206798907","cluster_addr":"172.21.15.145:6829/2206798907","heartbeat_back_addr":"172.21.15.145:6833/2206798907","heartbeat_front_addr":"172.21.15.145:6831/2206798907","state":["exists","up"]},{"osd":5,"uuid":"0e54adcd-2d1d-49fb-bf97-3dd7e9addd30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6810","nonce":2599548493},{"type":"v1","addr":"172.21.15.145:6811","nonce":2599548493}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6812","nonce":2599548493},{"type":"v1","addr":"172.21.15.145:6813","nonce":2599548493}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6816","nonce":2599548493},{"type":"v1","addr":"172.21.15.145:6817","nonce":2599548493}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6814","nonce":2599548493},{"type":"v1","addr":"172.21.15.145:6815","nonce":2599548493}]},"public_addr":"172.21.15.145:6811/2599548493","cluster_addr":"172.21.15.145:6813/2599548493","heartbeat_back_addr":"172.21.15.145:6817/2599548493","heartbeat_front_addr":"172.21.15.145:6815/2599548493","state":["exists","up"]},{"osd":6,"uuid":"4d5ae7a8-b3df-4c7a-9124-290f239f5b57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6802","nonce":4192380792},{"type":"v1","addr":"172.21.15.145:6803","nonce":4192380792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6804","nonce":4192380792},{"type":"v1","addr":"172.21.15.145:6805","nonce":4192380792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6808","nonce":4192380792},{"type":"v1","addr":"172.21.15.145:6809","nonce":4192380792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6806","nonce":4192380792},{"type":"v1","addr":"172.21.15.145:6807","nonce":4192380792}]},"public_addr":"172.21.15.145:6803/4192380792","cluster_addr":"172.21.15.145:6805/4192380792","heartbeat_back_addr":"172.21.15.145:6809/4192380792","heartbeat_front_addr":"172.21.15.145:6807/4192380792","state":["exists","up"]},{"osd":7,"uuid":"d7e36444-6e3f-4372-81d3-88e7b4e993f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6818","nonce":3010598400},{"type":"v1","addr":"172.21.15.145:6819","nonce":3010598400}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6820","nonce":3010598400},{"type":"v1","addr":"172.21.15.145:6821","nonce":3010598400}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6824","nonce":3010598400},{"type":"v1","addr":"172.21.15.145:6825","nonce":3010598400}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6822","nonce":3010598400},{"type":"v1","addr":"172.21.15.145:6823","nonce":3010598400}]},"public_addr":"172.21.15.145:6819/3010598400","cluster_addr":"172.21.15.145:6821/3010598400","heartbeat_back_addr":"172.21.15.145:6825/3010598400","heartbeat_front_addr":"172.21.15.145:6823/3010598400","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:14:03.281892+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:14:04.039021+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:14:03.045775+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:14:03.708856+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:14:04.425520+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:14:03.839369+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:14:03.029834+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:14:03.707529+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T00:14:40.258 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.256+0000 7f205584f640 1 -- 172.21.15.92:0/2377338690 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f2030077fa0 msgr2=0x7f203007a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:40.258 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.256+0000 7f205584f640 1 --2- 172.21.15.92:0/2377338690 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f2030077fa0 0x7f203007a460 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f20500c8c90 tx=0x7f2038003d90 comp rx=0 tx=0).stop 2024-09-11T00:14:40.258 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.256+0000 7f205584f640 1 -- 172.21.15.92:0/2377338690 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f20500d4af0 msgr2=0x7f205015ff60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:40.258 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.256+0000 7f205584f640 1 --2- 172.21.15.92:0/2377338690 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f20500d4af0 0x7f205015ff60 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f204800c970 tx=0x7f204800ce30 comp rx=0 tx=0).stop 2024-09-11T00:14:40.258 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.256+0000 7f205584f640 1 -- 172.21.15.92:0/2377338690 shutdown_connections 2024-09-11T00:14:40.259 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.256+0000 7f205584f640 1 --2- 172.21.15.92:0/2377338690 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f2030077fa0 0x7f203007a460 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:40.259 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.256+0000 7f205584f640 1 --2- 172.21.15.92:0/2377338690 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2050160e90 0x7f20501f7f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:40.259 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.256+0000 7f205584f640 1 --2- 172.21.15.92:0/2377338690 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f205015e060 0x7f2050160950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:40.259 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.256+0000 7f205584f640 1 --2- 172.21.15.92:0/2377338690 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f20500d4af0 0x7f205015ff60 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:40.259 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.256+0000 7f205584f640 1 -- 172.21.15.92:0/2377338690 >> 172.21.15.92:0/2377338690 conn(0x7f20500d3f70 msgr2=0x7f20500b77b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:14:40.259 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.256+0000 7f205584f640 1 -- 172.21.15.92:0/2377338690 shutdown_connections 2024-09-11T00:14:40.259 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.256+0000 7f205584f640 1 -- 172.21.15.92:0/2377338690 wait complete. 2024-09-11T00:14:40.270 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-11T00:14:40.271 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-11T00:14:40.271 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-11T00:14:40.271 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-09-11T00:14:40.272 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-09-11T00:14:40.273 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-09-11T00:14:40.273 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-09-11T00:14:40.274 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-09-11T00:14:40.446 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.444+0000 7f51bbcef640 1 -- 172.21.15.92:0/2803055816 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f51b40725d0 msgr2=0x7f51b40b3f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:40.446 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.444+0000 7f51bbcef640 1 --2- 172.21.15.92:0/2803055816 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f51b40725d0 0x7f51b40b3f30 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f51ac009be0 tx=0x7f51ac02a890 comp rx=0 tx=0).stop 2024-09-11T00:14:40.446 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.444+0000 7fb04effd640 1 -- 172.21.15.92:0/2056482299 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0500a8480 con 0x7fb048034340 2024-09-11T00:14:40.447 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.444+0000 7f51bbcef640 1 -- 172.21.15.92:0/2803055816 shutdown_connections 2024-09-11T00:14:40.447 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.444+0000 7f51bbcef640 1 --2- 172.21.15.92:0/2803055816 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f51b40725d0 0x7f51b40b3f30 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:40.447 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.444+0000 7f51bbcef640 1 -- 172.21.15.92:0/2803055816 >> 172.21.15.92:0/2803055816 conn(0x7f51b40b1760 msgr2=0x7f51b40b1b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:14:40.448 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.445+0000 7f51bbcef640 1 -- 172.21.15.92:0/2803055816 shutdown_connections 2024-09-11T00:14:40.448 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.445+0000 7f51bbcef640 1 -- 172.21.15.92:0/2803055816 wait complete. 2024-09-11T00:14:40.448 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.445+0000 7fb0554f1640 1 -- 172.21.15.92:0/2056482299 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb048034340 msgr2=0x7fb048036a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:40.448 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.445+0000 7fb0554f1640 1 --2- 172.21.15.92:0/2056482299 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb048034340 0x7fb048036a00 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fb050064710 tx=0x7fb0500a5b50 comp rx=0 tx=0).stop 2024-09-11T00:14:40.448 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.445+0000 7fb0554f1640 1 -- 172.21.15.92:0/2056482299 shutdown_connections 2024-09-11T00:14:40.449 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.445+0000 7fb0554f1640 1 --2- 172.21.15.92:0/2056482299 >> v2:172.21.15.92:3300/0 conn(0x7fb0480370c0 0x7fb048037550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:40.449 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.445+0000 7fb0554f1640 1 --2- 172.21.15.92:0/2056482299 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb0480e2c20 0x7fb048055f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:40.449 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.445+0000 7fb0554f1640 1 --2- 172.21.15.92:0/2056482299 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb048034340 0x7fb048036a00 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:40.449 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.445+0000 7fb0554f1640 1 -- 172.21.15.92:0/2056482299 >> 172.21.15.92:0/2056482299 conn(0x7fb04801e890 msgr2=0x7fb048055640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:14:40.449 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.445+0000 7fb0554f1640 1 -- 172.21.15.92:0/2056482299 shutdown_connections 2024-09-11T00:14:40.450 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.446+0000 7f2606dc2640 1 -- 172.21.15.92:0/915339264 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f260015b080 msgr2=0x7f26000738e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:40.450 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.446+0000 7f2606dc2640 1 --2- 172.21.15.92:0/915339264 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f260015b080 0x7f26000738e0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f25f4009830 tx=0x7f25f402c630 comp rx=0 tx=0).stop 2024-09-11T00:14:40.450 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.446+0000 7f2606dc2640 1 -- 172.21.15.92:0/915339264 shutdown_connections 2024-09-11T00:14:40.450 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.446+0000 7f2606dc2640 1 --2- 172.21.15.92:0/915339264 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f260015b080 0x7f26000738e0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:40.450 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.446+0000 7f2606dc2640 1 --2- 172.21.15.92:0/915339264 >> v2:172.21.15.92:3300/0 conn(0x7f26000b6a50 0x7f2600070320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:40.451 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.445+0000 7fb0554f1640 1 -- 172.21.15.92:0/2056482299 wait complete. 2024-09-11T00:14:40.451 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.446+0000 7f2606dc2640 1 -- 172.21.15.92:0/915339264 >> 172.21.15.92:0/915339264 conn(0x7f26000b2ad0 msgr2=0x7f26000b2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:14:40.451 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.446+0000 7f74fcf82640 1 -- 172.21.15.92:0/3679921149 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f74f815b1e0 msgr2=0x7f74f806fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:40.452 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.446+0000 7f74fcf82640 1 --2- 172.21.15.92:0/3679921149 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f74f815b1e0 0x7f74f806fc90 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f74f806c960 tx=0x7f74f002a820 comp rx=0 tx=0).stop 2024-09-11T00:14:40.452 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.446+0000 7fde630a3640 1 -- 172.21.15.92:0/3871769910 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fde5c0b36c0 msgr2=0x7fde5c06f2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:40.452 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.446+0000 7fde630a3640 1 --2- 172.21.15.92:0/3871769910 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fde5c0b36c0 0x7fde5c06f2e0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fde48009900 tx=0x7fde4802a600 comp rx=0 tx=0).stop 2024-09-11T00:14:40.452 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.446+0000 7fde630a3640 1 -- 172.21.15.92:0/3871769910 shutdown_connections 2024-09-11T00:14:40.452 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.446+0000 7fde630a3640 1 --2- 172.21.15.92:0/3871769910 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fde5c0b36c0 0x7fde5c06f2e0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:40.452 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.446+0000 7fde630a3640 1 --2- 172.21.15.92:0/3871769910 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fde5c0b47c0 0x7fde5c0723a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:40.453 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.446+0000 7fde630a3640 1 -- 172.21.15.92:0/3871769910 >> 172.21.15.92:0/3871769910 conn(0x7fde5c0b1530 msgr2=0x7fde5c0b1910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:14:40.453 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.446+0000 7fde630a3640 1 -- 172.21.15.92:0/3871769910 shutdown_connections 2024-09-11T00:14:40.453 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.446+0000 7fde630a3640 1 -- 172.21.15.92:0/3871769910 wait complete. 2024-09-11T00:14:40.453 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.446+0000 7f67a4310640 1 -- 172.21.15.92:0/435740597 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f679c0d0820 msgr2=0x7f679c15fb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:40.453 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.446+0000 7f67a4310640 1 --2- 172.21.15.92:0/435740597 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f679c0d0820 0x7f679c15fb80 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f6798005fd0 tx=0x7f679802a540 comp rx=0 tx=0).stop 2024-09-11T00:14:40.453 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.447+0000 7f51bbcef640 1 Processor -- start 2024-09-11T00:14:40.454 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.447+0000 7f74fcf82640 1 -- 172.21.15.92:0/3679921149 shutdown_connections 2024-09-11T00:14:40.454 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.447+0000 7f74fcf82640 1 --2- 172.21.15.92:0/3679921149 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f74f815b1e0 0x7f74f806fc90 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:40.455 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.447+0000 7f74fcf82640 1 --2- 172.21.15.92:0/3679921149 >> v2:172.21.15.145:3300/0 conn(0x7f74f813cf80 0x7f74f806f750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:40.455 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.447+0000 7f74fcf82640 1 -- 172.21.15.92:0/3679921149 >> 172.21.15.92:0/3679921149 conn(0x7f74f80b1760 msgr2=0x7f74f80b1b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:14:40.455 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.447+0000 7f67a4310640 1 -- 172.21.15.92:0/435740597 shutdown_connections 2024-09-11T00:14:40.455 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.447+0000 7f67a4310640 1 --2- 172.21.15.92:0/435740597 >> v2:172.21.15.92:3300/0 conn(0x7f679c0d2670 0x7f679c1600c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:40.455 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.447+0000 7f67a4310640 1 --2- 172.21.15.92:0/435740597 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f679c0d0820 0x7f679c15fb80 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:40.455 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.447+0000 7f67a4310640 1 -- 172.21.15.92:0/435740597 >> 172.21.15.92:0/435740597 conn(0x7f679c0d1b50 msgr2=0x7f679c0d1f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:14:40.456 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.447+0000 7f51bbcef640 1 -- start start 2024-09-11T00:14:40.456 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.447+0000 7f67a4310640 1 -- 172.21.15.92:0/435740597 shutdown_connections 2024-09-11T00:14:40.456 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.447+0000 7f2606dc2640 1 -- 172.21.15.92:0/915339264 shutdown_connections 2024-09-11T00:14:40.457 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.447+0000 7f67a4310640 1 -- 172.21.15.92:0/435740597 wait complete. 2024-09-11T00:14:40.457 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.447+0000 7f2606dc2640 1 -- 172.21.15.92:0/915339264 wait complete. 2024-09-11T00:14:40.457 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.447+0000 7f1c492f0640 1 -- 172.21.15.92:0/2295365775 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1c440d17c0 msgr2=0x7f1c440d1c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:40.458 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.447+0000 7f1c492f0640 1 --2- 172.21.15.92:0/2295365775 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1c440d17c0 0x7f1c440d1c10 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f1c440b5690 tx=0x7f1c3c02a6f0 comp rx=0 tx=0).stop 2024-09-11T00:14:40.458 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.447+0000 7fb0554f1640 1 Processor -- start 2024-09-11T00:14:40.459 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.447+0000 7f1c492f0640 1 -- 172.21.15.92:0/2295365775 shutdown_connections 2024-09-11T00:14:40.459 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.447+0000 7f1c492f0640 1 --2- 172.21.15.92:0/2295365775 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1c440d17c0 0x7f1c440d1c10 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:40.459 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.447+0000 7f1c492f0640 1 --2- 172.21.15.92:0/2295365775 >> v2:172.21.15.145:3300/0 conn(0x7f1c440b2890 0x7f1c440d4300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:40.459 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.447+0000 7f1c492f0640 1 --2- 172.21.15.92:0/2295365775 >> v2:172.21.15.92:3300/0 conn(0x7f1c440d04e0 0x7f1c440d08c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:40.459 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.447+0000 7f1c492f0640 1 -- 172.21.15.92:0/2295365775 >> 172.21.15.92:0/2295365775 conn(0x7f1c4409ce80 msgr2=0x7f1c440d3bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:14:40.459 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.447+0000 7f1c492f0640 1 -- 172.21.15.92:0/2295365775 shutdown_connections 2024-09-11T00:14:40.459 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.447+0000 7f1c492f0640 1 -- 172.21.15.92:0/2295365775 wait complete. 2024-09-11T00:14:40.460 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.447+0000 7f74fcf82640 1 -- 172.21.15.92:0/3679921149 shutdown_connections 2024-09-11T00:14:40.460 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.447+0000 7f74fcf82640 1 -- 172.21.15.92:0/3679921149 wait complete. 2024-09-11T00:14:40.460 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.447+0000 7fde630a3640 1 Processor -- start 2024-09-11T00:14:40.460 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.447+0000 7f3debf24640 1 -- 172.21.15.92:0/1689662941 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3de40d03b0 msgr2=0x7f3de40aecf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:40.461 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.447+0000 7f3debf24640 1 --2- 172.21.15.92:0/1689662941 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3de40d03b0 0x7f3de40aecf0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f3ddc005fd0 tx=0x7f3ddc02a810 comp rx=0 tx=0).stop 2024-09-11T00:14:40.462 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.448+0000 7f51bbcef640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f51b40725d0 0x7f51b413e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:40.462 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.448+0000 7f51bbcef640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f51b4151530 0x7f51b40cfc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:40.462 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.448+0000 7f51bbcef640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f51b415a940 0x7f51b41f51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:40.462 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.448+0000 7f51bbcef640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f51b40b45f0 con 0x7f51b40725d0 2024-09-11T00:14:40.462 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.448+0000 7f51bbcef640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f51b40b4470 con 0x7f51b415a940 2024-09-11T00:14:40.462 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.448+0000 7f51bbcef640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f51b40b4770 con 0x7f51b4151530 2024-09-11T00:14:40.462 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.448+0000 7f67a4310640 1 Processor -- start 2024-09-11T00:14:40.463 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.448+0000 7f51b9a8b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f51b40725d0 0x7f51b413e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:40.463 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.448+0000 7f51b9a8b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f51b40725d0 0x7f51b413e2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:50410/0 (socket says 172.21.15.92:50410) 2024-09-11T00:14:40.463 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.448+0000 7f51b9a8b640 1 -- 172.21.15.92:0/3677621173 learned_addr learned my addr 172.21.15.92:0/3677621173 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-11T00:14:40.463 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.448+0000 7f51b928a640 1 --2- 172.21.15.92:0/3677621173 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f51b4151530 0x7f51b40cfc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:40.464 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.449+0000 7f51ba28c640 1 --2- 172.21.15.92:0/3677621173 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f51b415a940 0x7f51b41f51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:40.464 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.449+0000 7f51b9a8b640 1 -- 172.21.15.92:0/3677621173 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f51b4151530 msgr2=0x7f51b40cfc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:40.464 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.449+0000 7f3debf24640 1 -- 172.21.15.92:0/1689662941 shutdown_connections 2024-09-11T00:14:40.464 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.449+0000 7f3debf24640 1 --2- 172.21.15.92:0/1689662941 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3de40d03b0 0x7f3de40aecf0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:40.464 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.449+0000 7f3debf24640 1 --2- 172.21.15.92:0/1689662941 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3de40cff50 0x7f3de40ae7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:40.464 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.449+0000 7f3debf24640 1 -- 172.21.15.92:0/1689662941 >> 172.21.15.92:0/1689662941 conn(0x7f3de40d1a60 msgr2=0x7f3de40d1e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:14:40.464 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.449+0000 7f2606dc2640 1 Processor -- start 2024-09-11T00:14:40.465 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.449+0000 7f2606dc2640 1 -- start start 2024-09-11T00:14:40.465 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.449+0000 7f51b9a8b640 1 --2- 172.21.15.92:0/3677621173 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f51b4151530 0x7f51b40cfc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:40.465 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.449+0000 7f51b9a8b640 1 -- 172.21.15.92:0/3677621173 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f51b415a940 msgr2=0x7f51b41f51c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:40.465 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.449+0000 7f51b9a8b640 1 --2- 172.21.15.92:0/3677621173 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f51b415a940 0x7f51b41f51c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:40.465 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.449+0000 7f51b9a8b640 1 -- 172.21.15.92:0/3677621173 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51b413eb50 con 0x7f51b40725d0 2024-09-11T00:14:40.465 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.448+0000 7fde630a3640 1 -- start start 2024-09-11T00:14:40.465 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.449+0000 7fde630a3640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fde5c06f820 0x7fde5c0cd160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:40.466 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.449+0000 7fde630a3640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fde5c0b36c0 0x7fde5c1f96d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:40.466 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.447+0000 7fb0554f1640 1 -- start start 2024-09-11T00:14:40.466 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.449+0000 7fb0554f1640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb048034340 0x7fb0480d4790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:40.466 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.449+0000 7fb0554f1640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb0480370c0 0x7fb048033240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:40.466 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.449+0000 7fb0554f1640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb0480e2c20 0x7fb048033780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:40.466 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.449+0000 7fb0554f1640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fb0480082c0 con 0x7fb048034340 2024-09-11T00:14:40.466 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.449+0000 7fb0554f1640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fb048008140 con 0x7fb0480e2c20 2024-09-11T00:14:40.466 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.449+0000 7fb0554f1640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7fb048008440 con 0x7fb0480370c0 2024-09-11T00:14:40.467 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.449+0000 7fb054cf0640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb0480e2c20 0x7fb048033780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:40.467 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.449+0000 7fde60e3f640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fde5c06f820 0x7fde5c0cd160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:40.467 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.449+0000 7fb054cf0640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb0480e2c20 0x7fb048033780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.92:46906/0 (socket says 172.21.15.92:46906) 2024-09-11T00:14:40.467 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.449+0000 7fde60e3f640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fde5c06f820 0x7fde5c0cd160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.92:46922/0 (socket says 172.21.15.92:46922) 2024-09-11T00:14:40.468 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.449+0000 7fb054cf0640 1 -- 172.21.15.92:0/3892569920 learned_addr learned my addr 172.21.15.92:0/3892569920 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-11T00:14:40.468 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.449+0000 7f51b9a8b640 1 --2- 172.21.15.92:0/3677621173 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f51b40725d0 0x7f51b413e2f0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f51b000c450 tx=0x7f51b000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:14:40.468 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.449+0000 7fde630a3640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fde5c0b47c0 0x7fde5c1f85d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:40.468 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.449+0000 7fde630a3640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fde5c15e560 con 0x7fde5c0b36c0 2024-09-11T00:14:40.468 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.449+0000 7fde630a3640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fde5c15e3e0 con 0x7fde5c06f820 2024-09-11T00:14:40.468 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.449+0000 7fde630a3640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7fde5c15b950 con 0x7fde5c0b47c0 2024-09-11T00:14:40.469 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.449+0000 7fde60e3f640 1 -- 172.21.15.92:0/3864126590 learned_addr learned my addr 172.21.15.92:0/3864126590 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-11T00:14:40.469 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.449+0000 7f1c492f0640 1 Processor -- start 2024-09-11T00:14:40.469 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.449+0000 7fde5bfff640 1 --2- 172.21.15.92:0/3864126590 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fde5c0b36c0 0x7fde5c1f96d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:40.469 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.450+0000 7fb04ffff640 1 --2- 172.21.15.92:0/3892569920 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb048034340 0x7fb0480d4790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:40.470 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.450+0000 7fde61640640 1 --2- 172.21.15.92:0/3864126590 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fde5c0b47c0 0x7fde5c1f85d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:40.470 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.450+0000 7fde60e3f640 1 -- 172.21.15.92:0/3864126590 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fde5c0b47c0 msgr2=0x7fde5c1f85d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:40.470 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.450+0000 7f1c492f0640 1 -- start start 2024-09-11T00:14:40.470 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.450+0000 7f74fcf82640 1 Processor -- start 2024-09-11T00:14:40.471 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.449+0000 7f67a4310640 1 -- start start 2024-09-11T00:14:40.471 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.450+0000 7f67a4310640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f679c0cfd30 0x7f679c0b5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:40.471 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.450+0000 7f67a4310640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f679c0d0820 0x7f679c0c6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:40.471 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.450+0000 7f51aa7fc640 1 -- 172.21.15.92:0/3677621173 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51b0016020 con 0x7f51b40725d0 2024-09-11T00:14:40.471 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.450+0000 7fde60e3f640 1 --2- 172.21.15.92:0/3864126590 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fde5c0b47c0 0x7fde5c1f85d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:40.472 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.450+0000 7fb04f7fe640 1 --2- 172.21.15.92:0/3892569920 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb0480370c0 0x7fb048033240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:40.472 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.450+0000 7fb054cf0640 1 -- 172.21.15.92:0/3892569920 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb0480370c0 msgr2=0x7fb048033240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:40.472 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.450+0000 7fb054cf0640 1 --2- 172.21.15.92:0/3892569920 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb0480370c0 0x7fb048033240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:40.472 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.450+0000 7fb054cf0640 1 -- 172.21.15.92:0/3892569920 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb048034340 msgr2=0x7fb0480d4790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:40.472 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.450+0000 7fde60e3f640 1 -- 172.21.15.92:0/3864126590 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fde5c0b36c0 msgr2=0x7fde5c1f96d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:40.472 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.450+0000 7fde60e3f640 1 --2- 172.21.15.92:0/3864126590 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fde5c0b36c0 0x7fde5c1f96d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:40.472 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.450+0000 7fde60e3f640 1 -- 172.21.15.92:0/3864126590 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde5c1556c0 con 0x7fde5c06f820 2024-09-11T00:14:40.473 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.450+0000 7f67a4310640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f679c0d2670 0x7f679c0b6200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:40.473 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.450+0000 7f51aa7fc640 1 -- 172.21.15.92:0/3677621173 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f51b0012920 con 0x7f51b40725d0 2024-09-11T00:14:40.473 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.450+0000 7f51bbcef640 1 -- 172.21.15.92:0/3677621173 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f51b413f0e0 con 0x7f51b40725d0 2024-09-11T00:14:40.474 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.450+0000 7fde61640640 1 --2- 172.21.15.92:0/3864126590 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fde5c0b47c0 0x7fde5c1f85d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:14:40.474 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.450+0000 7fb054cf0640 1 --2- 172.21.15.92:0/3892569920 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb048034340 0x7fb0480d4790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:40.474 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.450+0000 7fb054cf0640 1 -- 172.21.15.92:0/3892569920 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0480e14b0 con 0x7fb0480e2c20 2024-09-11T00:14:40.474 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.450+0000 7fb04ffff640 1 --2- 172.21.15.92:0/3892569920 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb048034340 0x7fb0480d4790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:14:40.474 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.450+0000 7f51bbcef640 1 -- 172.21.15.92:0/3677621173 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51b41f4ca0 con 0x7f51b40725d0 2024-09-11T00:14:40.475 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.450+0000 7f3debf24640 1 -- 172.21.15.92:0/1689662941 shutdown_connections 2024-09-11T00:14:40.475 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.450+0000 7f3debf24640 1 -- 172.21.15.92:0/1689662941 wait complete. 2024-09-11T00:14:40.475 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.450+0000 7f67a18ab640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f679c0d0820 0x7f679c0c6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:40.475 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.450+0000 7f67a18ab640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f679c0d0820 0x7f679c0c6070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3301/0 says I am v2:172.21.15.92:56168/0 (socket says 172.21.15.92:56168) 2024-09-11T00:14:40.475 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.450+0000 7f67a28ad640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f679c0d2670 0x7f679c0b6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:40.475 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.451+0000 7f67a28ad640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f679c0d2670 0x7f679c0b6200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:50432/0 (socket says 172.21.15.92:50432) 2024-09-11T00:14:40.476 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.451+0000 7f67a18ab640 1 -- 172.21.15.92:0/3079568452 learned_addr learned my addr 172.21.15.92:0/3079568452 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-11T00:14:40.476 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.451+0000 7f2606dc2640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2600073e20 0x7f2600201e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:40.476 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.451+0000 7fb054cf0640 1 --2- 172.21.15.92:0/3892569920 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb0480e2c20 0x7fb048033780 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fb03c00c970 tx=0x7fb03c00ce30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:14:40.477 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.451+0000 7f67a4310640 1 -- 172.21.15.92:0/3079568452 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f679c0afbc0 con 0x7f679c0d2670 2024-09-11T00:14:40.477 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.451+0000 7f67a4310640 1 -- 172.21.15.92:0/3079568452 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f679c0afa40 con 0x7f679c0cfd30 2024-09-11T00:14:40.477 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.451+0000 7f67a4310640 1 -- 172.21.15.92:0/3079568452 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f679c0afd40 con 0x7f679c0d0820 2024-09-11T00:14:40.477 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.451+0000 7f2606dc2640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f26000b6a50 0x7f26001e7920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:40.477 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.451+0000 7fde60e3f640 1 --2- 172.21.15.92:0/3864126590 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fde5c06f820 0x7fde5c0cd160 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fde5000e790 tx=0x7fde5000ec50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:14:40.478 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.451+0000 7f2606dc2640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f260015b080 0x7f260014ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:40.478 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.451+0000 7f1c492f0640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1c440b2890 0x7f1c441f2bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:40.478 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.451+0000 7f1c492f0640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1c440d04e0 0x7f1c440b5f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:40.478 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.451+0000 7f1c43fff640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1c440b2890 0x7f1c441f2bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:40.478 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.451+0000 7fb04cff9640 1 -- 172.21.15.92:0/3892569920 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb03c007bb0 con 0x7fb0480e2c20 2024-09-11T00:14:40.478 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.451+0000 7fb04cff9640 1 -- 172.21.15.92:0/3892569920 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb03c00f450 con 0x7fb0480e2c20 2024-09-11T00:14:40.478 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.451+0000 7fb0554f1640 1 -- 172.21.15.92:0/3892569920 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb0480e1790 con 0x7fb0480e2c20 2024-09-11T00:14:40.478 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.451+0000 7fb0554f1640 1 -- 172.21.15.92:0/3892569920 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0480e1d50 con 0x7fb0480e2c20 2024-09-11T00:14:40.479 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.451+0000 7fde597fa640 1 -- 172.21.15.92:0/3864126590 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde5000eea0 con 0x7fde5c06f820 2024-09-11T00:14:40.479 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.451+0000 7f1c437fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1c440d04e0 0x7f1c440b5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:40.479 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.451+0000 7f1c437fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1c440d04e0 0x7f1c440b5f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:50434/0 (socket says 172.21.15.92:50434) 2024-09-11T00:14:40.479 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.451+0000 7f1c43fff640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1c440b2890 0x7f1c441f2bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.92:46958/0 (socket says 172.21.15.92:46958) 2024-09-11T00:14:40.480 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.451+0000 7f67a20ac640 1 --2- 172.21.15.92:0/3079568452 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f679c0cfd30 0x7f679c0b5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:40.480 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.451+0000 7f51aa7fc640 1 -- 172.21.15.92:0/3677621173 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51b0012d70 con 0x7f51b40725d0 2024-09-11T00:14:40.481 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.451+0000 7f1c437fe640 1 -- 172.21.15.92:0/3618702989 learned_addr learned my addr 172.21.15.92:0/3618702989 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-11T00:14:40.481 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.452+0000 7f1c492f0640 1 --2- 172.21.15.92:0/3618702989 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1c440d17c0 0x7f1c440b3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:40.481 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.452+0000 7f1c492f0640 1 -- 172.21.15.92:0/3618702989 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f1c440d2150 con 0x7f1c440d04e0 2024-09-11T00:14:40.481 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.452+0000 7f1c48aef640 1 --2- 172.21.15.92:0/3618702989 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1c440d17c0 0x7f1c440b3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:40.481 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.452+0000 7f1c492f0640 1 -- 172.21.15.92:0/3618702989 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f1c4415e210 con 0x7f1c440b2890 2024-09-11T00:14:40.481 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.452+0000 7f1c492f0640 1 -- 172.21.15.92:0/3618702989 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f1c440d22d0 con 0x7f1c440d17c0 2024-09-11T00:14:40.482 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.451+0000 7f74fcf82640 1 -- start start 2024-09-11T00:14:40.482 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.452+0000 7f74fcf82640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f74f813cf80 0x7f74f80a9e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:40.482 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.452+0000 7f74fcf82640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f74f815b1e0 0x7f74f81384a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:40.482 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.452+0000 7f74fcf82640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f74f815da30 0x7f74f8167320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:40.482 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.452+0000 7f74fcf82640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f74f80b3d10 con 0x7f74f815b1e0 2024-09-11T00:14:40.482 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.452+0000 7f74fcf82640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f74f80b3e90 con 0x7f74f815da30 2024-09-11T00:14:40.482 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.452+0000 7f74fcf82640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f74f80b4010 con 0x7f74f813cf80 2024-09-11T00:14:40.482 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.451+0000 7fde630a3640 1 -- 172.21.15.92:0/3864126590 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde5c157120 con 0x7fde5c06f820 2024-09-11T00:14:40.482 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.451+0000 7fde630a3640 1 -- 172.21.15.92:0/3864126590 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fde5c1f8b10 con 0x7fde5c06f820 2024-09-11T00:14:40.483 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.452+0000 7f3debf24640 1 Processor -- start 2024-09-11T00:14:40.483 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.452+0000 7f3debf24640 1 -- start start 2024-09-11T00:14:40.483 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.451+0000 7f2606dc2640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f260015ec30 con 0x7f260015b080 2024-09-11T00:14:40.483 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.451+0000 7f2606dc2640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f26000d0230 con 0x7f26000b6a50 2024-09-11T00:14:40.483 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.451+0000 7f2606dc2640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f260015edb0 con 0x7f2600073e20 2024-09-11T00:14:40.483 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.452+0000 7f2604b5e640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2600073e20 0x7f2600201e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:40.484 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.452+0000 7fb04cff9640 1 -- 172.21.15.92:0/3892569920 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb03c007e60 con 0x7fb0480e2c20 2024-09-11T00:14:40.484 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.452+0000 7f2604b5e640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2600073e20 0x7f2600201e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3301/0 says I am v2:172.21.15.92:56180/0 (socket says 172.21.15.92:56180) 2024-09-11T00:14:40.484 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.452+0000 7f2604b5e640 1 -- 172.21.15.92:0/1582436163 learned_addr learned my addr 172.21.15.92:0/1582436163 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-11T00:14:40.484 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.452+0000 7f260535f640 1 --2- 172.21.15.92:0/1582436163 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f260015b080 0x7f260014ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:40.484 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.453+0000 7f25fffff640 1 --2- 172.21.15.92:0/1582436163 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f26000b6a50 0x7f26001e7920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:40.485 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.453+0000 7fb0554f1640 1 -- 172.21.15.92:0/3892569920 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fb030001030 con 0x7fb0480e2c20 2024-09-11T00:14:40.485 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.453+0000 7fde597fa640 1 -- 172.21.15.92:0/3864126590 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fde5000cdb0 con 0x7fde5c06f820 2024-09-11T00:14:40.485 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.453+0000 7fde597fa640 1 -- 172.21.15.92:0/3864126590 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde50010690 con 0x7fde5c06f820 2024-09-11T00:14:40.485 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.453+0000 7fde630a3640 1 -- 172.21.15.92:0/3864126590 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fde5c0723a0 con 0x7fde5c06f820 2024-09-11T00:14:40.486 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.453+0000 7f1c437fe640 1 -- 172.21.15.92:0/3618702989 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1c440d17c0 msgr2=0x7f1c440b3550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:40.486 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.453+0000 7f1c437fe640 1 --2- 172.21.15.92:0/3618702989 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1c440d17c0 0x7f1c440b3550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:40.486 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.453+0000 7f1c437fe640 1 -- 172.21.15.92:0/3618702989 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1c440b2890 msgr2=0x7f1c441f2bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:40.486 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.453+0000 7f74f6d9d640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f74f815da30 0x7f74f8167320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:40.487 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.453+0000 7f1c437fe640 1 --2- 172.21.15.92:0/3618702989 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1c440b2890 0x7f1c441f2bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:40.487 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.453+0000 7f1c437fe640 1 -- 172.21.15.92:0/3618702989 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c440b6480 con 0x7f1c440d04e0 2024-09-11T00:14:40.487 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.451+0000 7f67a28ad640 1 -- 172.21.15.92:0/3079568452 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f679c0d0820 msgr2=0x7f679c0c6070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:40.487 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.451+0000 7f67a28ad640 1 --2- 172.21.15.92:0/3079568452 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f679c0d0820 0x7f679c0c6070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:40.487 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.451+0000 7f67a28ad640 1 -- 172.21.15.92:0/3079568452 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f679c0cfd30 msgr2=0x7f679c0b5870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:40.487 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.451+0000 7f67a28ad640 1 --2- 172.21.15.92:0/3079568452 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f679c0cfd30 0x7f679c0b5870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:40.487 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.451+0000 7f67a28ad640 1 -- 172.21.15.92:0/3079568452 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f679c0c65b0 con 0x7f679c0d2670 2024-09-11T00:14:40.487 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.453+0000 7f2604b5e640 1 -- 172.21.15.92:0/1582436163 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f26000b6a50 msgr2=0x7f26001e7920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:40.488 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.453+0000 7f74f659c640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f74f813cf80 0x7f74f80a9e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:40.488 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.453+0000 7f74f659c640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f74f813cf80 0x7f74f80a9e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3301/0 says I am v2:172.21.15.92:56196/0 (socket says 172.21.15.92:56196) 2024-09-11T00:14:40.488 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.453+0000 7f74f659c640 1 -- 172.21.15.92:0/902030292 learned_addr learned my addr 172.21.15.92:0/902030292 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-11T00:14:40.489 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.453+0000 7f2604b5e640 1 --2- 172.21.15.92:0/1582436163 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f26000b6a50 0x7f26001e7920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:40.489 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.453+0000 7f2604b5e640 1 -- 172.21.15.92:0/1582436163 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f260015b080 msgr2=0x7f260014ef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:40.489 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.453+0000 7f67a28ad640 1 --2- 172.21.15.92:0/3079568452 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f679c0d2670 0x7f679c0b6200 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f679400ecb0 tx=0x7f679400c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:14:40.489 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.453+0000 7f2604b5e640 1 --2- 172.21.15.92:0/1582436163 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f260015b080 0x7f260014ef70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:40.489 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.453+0000 7f1c437fe640 1 --2- 172.21.15.92:0/3618702989 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1c440d04e0 0x7f1c440b5f40 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f1c3800e9f0 tx=0x7f1c3800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:14:40.490 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.453+0000 7f2604b5e640 1 -- 172.21.15.92:0/1582436163 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26002023d0 con 0x7f2600073e20 2024-09-11T00:14:40.490 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.453+0000 7f74f5d9b640 1 --2- 172.21.15.92:0/902030292 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f74f815b1e0 0x7f74f81384a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:40.490 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.453+0000 7f6792ffd640 1 -- 172.21.15.92:0/3079568452 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6794004b20 con 0x7f679c0d2670 2024-09-11T00:14:40.491 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.453+0000 7f3debf24640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3de40cff50 0x7f3de4156ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:40.491 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.453+0000 7f3debf24640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3de40d03b0 0x7f3de415ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:40.491 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.454+0000 7f3debf24640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3de415f1f0 0x7f3de4071960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:40.491 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.454+0000 7f3debf24640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f3de40d2700 con 0x7f3de415f1f0 2024-09-11T00:14:40.491 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.454+0000 7f3debf24640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f3de40d2580 con 0x7f3de40d03b0 2024-09-11T00:14:40.491 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.454+0000 7f3debf24640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f3de40af230 con 0x7f3de40cff50 2024-09-11T00:14:40.491 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.454+0000 7f3de9cc0640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3de40cff50 0x7f3de4156ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:40.492 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.454+0000 7f51aa7fc640 1 -- 172.21.15.92:0/3677621173 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f51b001b400 con 0x7f51b40725d0 2024-09-11T00:14:40.492 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.454+0000 7f1c40ff9640 1 -- 172.21.15.92:0/3618702989 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c3800cd20 con 0x7f1c440d04e0 2024-09-11T00:14:40.492 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.454+0000 7f6792ffd640 1 -- 172.21.15.92:0/3079568452 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6794004db0 con 0x7f679c0d2670 2024-09-11T00:14:40.493 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.454+0000 7f3de9cc0640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3de40cff50 0x7f3de4156ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3301/0 says I am v2:172.21.15.92:56204/0 (socket says 172.21.15.92:56204) 2024-09-11T00:14:40.493 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.454+0000 7f3de9cc0640 1 -- 172.21.15.92:0/802839909 learned_addr learned my addr 172.21.15.92:0/802839909 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-11T00:14:40.493 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.454+0000 7f51bbcef640 1 -- 172.21.15.92:0/3677621173 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f51b413e890 con 0x7f51b40725d0 2024-09-11T00:14:40.493 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.454+0000 7f1c40ff9640 1 -- 172.21.15.92:0/3618702989 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1c38010430 con 0x7f1c440d04e0 2024-09-11T00:14:40.494 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.454+0000 7f74f6d9d640 1 -- 172.21.15.92:0/902030292 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f74f813cf80 msgr2=0x7f74f80a9e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:40.494 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.454+0000 7f74f6d9d640 1 --2- 172.21.15.92:0/902030292 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f74f813cf80 0x7f74f80a9e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:40.494 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.454+0000 7f74f6d9d640 1 -- 172.21.15.92:0/902030292 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f74f815b1e0 msgr2=0x7f74f81384a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:40.494 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.454+0000 7f74f6d9d640 1 --2- 172.21.15.92:0/902030292 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f74f815b1e0 0x7f74f81384a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:40.494 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.454+0000 7f74f6d9d640 1 -- 172.21.15.92:0/902030292 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74f80ad460 con 0x7f74f815da30 2024-09-11T00:14:40.494 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.454+0000 7f3de9cc0640 1 -- 172.21.15.92:0/802839909 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3de40d03b0 msgr2=0x7f3de415ab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:40.495 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.454+0000 7f2604b5e640 1 --2- 172.21.15.92:0/1582436163 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2600073e20 0x7f2600201e90 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f25f000e9c0 tx=0x7f25f000ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:14:40.495 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.454+0000 7f74f6d9d640 1 --2- 172.21.15.92:0/902030292 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f74f815da30 0x7f74f8167320 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f74e800c390 tx=0x7f74e800c850 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:14:40.495 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.454+0000 7f74e6ffd640 1 -- 172.21.15.92:0/902030292 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74e8017070 con 0x7f74f815da30 2024-09-11T00:14:40.495 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.455+0000 7f74e6ffd640 1 -- 172.21.15.92:0/902030292 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f74e80053e0 con 0x7f74f815da30 2024-09-11T00:14:40.496 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.454+0000 7f6792ffd640 1 -- 172.21.15.92:0/3079568452 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6794005280 con 0x7f679c0d2670 2024-09-11T00:14:40.496 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.454+0000 7f67a4310640 1 -- 172.21.15.92:0/3079568452 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f679c0b7610 con 0x7f679c0d2670 2024-09-11T00:14:40.496 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.454+0000 7f67a4310640 1 -- 172.21.15.92:0/3079568452 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f679c0b6c30 con 0x7f679c0d2670 2024-09-11T00:14:40.496 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.454+0000 7f3de9cc0640 1 --2- 172.21.15.92:0/802839909 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3de40d03b0 0x7f3de415ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:40.496 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.454+0000 7f3de9cc0640 1 -- 172.21.15.92:0/802839909 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3de415f1f0 msgr2=0x7f3de4071960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:40.496 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.454+0000 7f3de9cc0640 1 --2- 172.21.15.92:0/802839909 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3de415f1f0 0x7f3de4071960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:40.497 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.454+0000 7f3de9cc0640 1 -- 172.21.15.92:0/802839909 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3de415a4f0 con 0x7f3de40cff50 2024-09-11T00:14:40.497 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.455+0000 7f74fcf82640 1 -- 172.21.15.92:0/902030292 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f74f81fc5f0 con 0x7f74f815da30 2024-09-11T00:14:40.497 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.455+0000 7f74e6ffd640 1 -- 172.21.15.92:0/902030292 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74e8003850 con 0x7f74f815da30 2024-09-11T00:14:40.498 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.455+0000 7f51aa7fc640 1 --2- 172.21.15.92:0/3677621173 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f5198078040 0x7f519807a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:40.498 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.455+0000 7f1c40ff9640 1 -- 172.21.15.92:0/3618702989 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c38010840 con 0x7f1c440d04e0 2024-09-11T00:14:40.498 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.455+0000 7f3de9cc0640 1 --2- 172.21.15.92:0/802839909 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3de40cff50 0x7f3de4156ec0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f3de000c430 tx=0x7f3de000c8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:14:40.499 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.455+0000 7f74fcf82640 1 -- 172.21.15.92:0/902030292 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74f81fcbb0 con 0x7f74f815da30 2024-09-11T00:14:40.499 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.455+0000 7f3dda7fc640 1 -- 172.21.15.92:0/802839909 <== mon.2 v2:172.21.15.145:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3de0017070 con 0x7f3de40cff50 2024-09-11T00:14:40.499 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.455+0000 7f3dda7fc640 1 -- 172.21.15.92:0/802839909 <== mon.2 v2:172.21.15.145:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3de00035f0 con 0x7f3de40cff50 2024-09-11T00:14:40.499 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.455+0000 7f3dda7fc640 1 -- 172.21.15.92:0/802839909 <== mon.2 v2:172.21.15.145:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3de0017070 con 0x7f3de40cff50 2024-09-11T00:14:40.500 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.455+0000 7f67a4310640 1 -- 172.21.15.92:0/3079568452 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f679c0d0110 con 0x7f679c0d2670 2024-09-11T00:14:40.500 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.455+0000 7f3debf24640 1 -- 172.21.15.92:0/802839909 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3de40c55e0 con 0x7f3de40cff50 2024-09-11T00:14:40.500 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.455+0000 7f3debf24640 1 -- 172.21.15.92:0/802839909 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f3de40c5ba0 con 0x7f3de40cff50 2024-09-11T00:14:40.500 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.455+0000 7f51b928a640 1 --2- 172.21.15.92:0/3677621173 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f5198078040 0x7f519807a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:40.501 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.456+0000 7f51aa7fc640 1 -- 172.21.15.92:0/3677621173 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f51b0099f10 con 0x7f51b40725d0 2024-09-11T00:14:40.501 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.456+0000 7f74fcf82640 1 -- 172.21.15.92:0/902030292 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f74f815de70 con 0x7f74f815da30 2024-09-11T00:14:40.501 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.456+0000 7f1c492f0640 1 -- 172.21.15.92:0/3618702989 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1c440b78a0 con 0x7f1c440d04e0 2024-09-11T00:14:40.501 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.456+0000 7f1c492f0640 1 -- 172.21.15.92:0/3618702989 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c440b7d70 con 0x7f1c440d04e0 2024-09-11T00:14:40.502 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.456+0000 7f51b928a640 1 --2- 172.21.15.92:0/3677621173 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f5198078040 0x7f519807a500 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f51b41584a0 tx=0x7f51a400b270 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:14:40.502 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.456+0000 7f51aa7fc640 1 --2- 172.21.15.92:0/3677621173 >> [v2:172.21.15.92:6816/2600417443,v1:172.21.15.92:6817/2600417443] conn(0x7f51980817c0 0x7f5198083c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:40.502 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.457+0000 7f51aa7fc640 1 -- 172.21.15.92:0/3677621173 --> [v2:172.21.15.92:6816/2600417443,v1:172.21.15.92:6817/2600417443] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f51b0005560 con 0x7f51980817c0 2024-09-11T00:14:40.502 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.457+0000 7f51ba28c640 1 --2- 172.21.15.92:0/3677621173 >> [v2:172.21.15.92:6816/2600417443,v1:172.21.15.92:6817/2600417443] conn(0x7f51980817c0 0x7f5198083c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:40.502 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.457+0000 7f51aa7fc640 1 -- 172.21.15.92:0/3677621173 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f51b009f500 con 0x7f51b40725d0 2024-09-11T00:14:40.502 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.457+0000 7f1c492f0640 1 -- 172.21.15.92:0/3618702989 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f1c440d08c0 con 0x7f1c440d04e0 2024-09-11T00:14:40.503 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.457+0000 7f51ba28c640 1 --2- 172.21.15.92:0/3677621173 >> [v2:172.21.15.92:6816/2600417443,v1:172.21.15.92:6817/2600417443] conn(0x7f51980817c0 0x7f5198083c00 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:14:40.503 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.456+0000 7f25fd7fa640 1 -- 172.21.15.92:0/1582436163 <== mon.2 v2:172.21.15.145:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25f000ccc0 con 0x7f2600073e20 2024-09-11T00:14:40.503 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.456+0000 7f25fd7fa640 1 -- 172.21.15.92:0/1582436163 <== mon.2 v2:172.21.15.145:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f25f0005020 con 0x7f2600073e20 2024-09-11T00:14:40.503 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.457+0000 7f2606dc2640 1 -- 172.21.15.92:0/1582436163 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26001e7e60 con 0x7f2600073e20 2024-09-11T00:14:40.503 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.457+0000 7f2606dc2640 1 -- 172.21.15.92:0/1582436163 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f26001e6b60 con 0x7f2600073e20 2024-09-11T00:14:40.503 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.457+0000 7f25fd7fa640 1 -- 172.21.15.92:0/1582436163 <== mon.2 v2:172.21.15.145:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25f000ce60 con 0x7f2600073e20 2024-09-11T00:14:40.504 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.456+0000 7fde597fa640 1 -- 172.21.15.92:0/3864126590 <== mon.1 v2:172.21.15.145:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fde50010830 con 0x7fde5c06f820 2024-09-11T00:14:40.504 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.456+0000 7fde597fa640 1 --2- 172.21.15.92:0/3864126590 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7fde40078040 0x7fde4007a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:40.504 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.456+0000 7fde5bfff640 1 --2- 172.21.15.92:0/3864126590 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7fde40078040 0x7fde4007a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:40.504 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.458+0000 7fde597fa640 1 -- 172.21.15.92:0/3864126590 <== mon.1 v2:172.21.15.145:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fde5009b560 con 0x7fde5c06f820 2024-09-11T00:14:40.504 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.458+0000 7f74e6ffd640 1 -- 172.21.15.92:0/902030292 <== mon.1 v2:172.21.15.145:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f74e80039f0 con 0x7f74f815da30 2024-09-11T00:14:40.505 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.458+0000 7fde597fa640 1 --2- 172.21.15.92:0/3864126590 >> [v2:172.21.15.145:6810/2599548493,v1:172.21.15.145:6811/2599548493] conn(0x7fde400817c0 0x7fde40083c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:40.505 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.458+0000 7fb04cff9640 1 -- 172.21.15.92:0/3892569920 <== mon.1 v2:172.21.15.145:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fb03c0213f0 con 0x7fb0480e2c20 2024-09-11T00:14:40.505 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.458+0000 7fde597fa640 1 -- 172.21.15.92:0/3864126590 --> [v2:172.21.15.145:6810/2599548493,v1:172.21.15.145:6811/2599548493] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fde400842d0 con 0x7fde400817c0 2024-09-11T00:14:40.505 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.458+0000 7fde597fa640 1 -- 172.21.15.92:0/3864126590 <== mon.1 v2:172.21.15.145:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fde5009b950 con 0x7fde5c06f820 2024-09-11T00:14:40.506 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.458+0000 7f74e6ffd640 1 --2- 172.21.15.92:0/902030292 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f74d8077fa0 0x7f74d807a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:40.506 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.458+0000 7f51aa7fc640 1 -- 172.21.15.92:0/3677621173 <== osd.1 v2:172.21.15.92:6816/2600417443 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f51b0005560 con 0x7f51980817c0 2024-09-11T00:14:40.506 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.458+0000 7fde61640640 1 --2- 172.21.15.92:0/3864126590 >> [v2:172.21.15.145:6810/2599548493,v1:172.21.15.145:6811/2599548493] conn(0x7fde400817c0 0x7fde40083c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:40.507 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.459+0000 7f74e6ffd640 1 -- 172.21.15.92:0/902030292 <== mon.1 v2:172.21.15.145:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f74e80994f0 con 0x7f74f815da30 2024-09-11T00:14:40.507 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.459+0000 7f6792ffd640 1 -- 172.21.15.92:0/3079568452 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f6794005420 con 0x7f679c0d2670 2024-09-11T00:14:40.507 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.459+0000 7f74e6ffd640 1 --2- 172.21.15.92:0/902030292 >> [v2:172.21.15.92:6824/3913961488,v1:172.21.15.92:6825/3913961488] conn(0x7f74d8081720 0x7f74d8083b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:40.507 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.458+0000 7f3debf24640 1 -- 172.21.15.92:0/802839909 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f3de40af750 con 0x7f3de40cff50 2024-09-11T00:14:40.508 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.459+0000 7f3dda7fc640 1 -- 172.21.15.92:0/802839909 <== mon.2 v2:172.21.15.145:3301/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f3de0003820 con 0x7f3de40cff50 2024-09-11T00:14:40.508 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.459+0000 7f74e6ffd640 1 -- 172.21.15.92:0/902030292 --> [v2:172.21.15.92:6824/3913961488,v1:172.21.15.92:6825/3913961488] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f74d8084230 con 0x7f74d8081720 2024-09-11T00:14:40.508 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.459+0000 7f74e6ffd640 1 -- 172.21.15.92:0/902030292 <== mon.1 v2:172.21.15.145:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f74e80a0050 con 0x7f74f815da30 2024-09-11T00:14:40.508 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.459+0000 7f1c40ff9640 1 -- 172.21.15.92:0/3618702989 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f1c380109e0 con 0x7f1c440d04e0 2024-09-11T00:14:40.509 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.459+0000 7fb04cff9640 1 --2- 172.21.15.92:0/3892569920 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7fb034078040 0x7fb03407a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:40.509 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.458+0000 7f25e6ffd640 1 -- 172.21.15.92:0/1582436163 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f260015f2d0 con 0x7f2600073e20 2024-09-11T00:14:40.509 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.459+0000 7fde5bfff640 1 --2- 172.21.15.92:0/3864126590 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7fde40078040 0x7fde4007a500 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fde48033000 tx=0x7fde48004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:14:40.509 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.459+0000 7fb04cff9640 1 -- 172.21.15.92:0/3892569920 <== mon.1 v2:172.21.15.145:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fb03c09ab10 con 0x7fb0480e2c20 2024-09-11T00:14:40.510 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.459+0000 7f74f5d9b640 1 --2- 172.21.15.92:0/902030292 >> [v2:172.21.15.92:6824/3913961488,v1:172.21.15.92:6825/3913961488] conn(0x7f74d8081720 0x7f74d8083b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:40.510 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.459+0000 7fb04cff9640 1 --2- 172.21.15.92:0/3892569920 >> [v2:172.21.15.145:6826/2206798907,v1:172.21.15.145:6827/2206798907] conn(0x7fb0340817c0 0x7fb034083c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:40.510 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.459+0000 7fde61640640 1 --2- 172.21.15.92:0/3864126590 >> [v2:172.21.15.145:6810/2599548493,v1:172.21.15.145:6811/2599548493] conn(0x7fde400817c0 0x7fde40083c00 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:14:40.510 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.459+0000 7fb04cff9640 1 -- 172.21.15.92:0/3892569920 --> [v2:172.21.15.145:6826/2206798907,v1:172.21.15.145:6827/2206798907] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb03c00f450 con 0x7fb0340817c0 2024-09-11T00:14:40.510 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.460+0000 7fb04ffff640 1 --2- 172.21.15.92:0/3892569920 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7fb034078040 0x7fb03407a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:40.511 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.460+0000 7f1c40ff9640 1 --2- 172.21.15.92:0/3618702989 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f1c30078040 0x7f1c3007a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:40.511 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.460+0000 7f6792ffd640 1 --2- 172.21.15.92:0/3079568452 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f6780078040 0x7f678007a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:40.511 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.460+0000 7f74f5d9b640 1 --2- 172.21.15.92:0/902030292 >> [v2:172.21.15.92:6824/3913961488,v1:172.21.15.92:6825/3913961488] conn(0x7f74d8081720 0x7f74d8083b60 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:14:40.511 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.460+0000 7fb04cff9640 1 -- 172.21.15.92:0/3892569920 <== mon.1 v2:172.21.15.145:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fb03c09af00 con 0x7fb0480e2c20 2024-09-11T00:14:40.512 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.460+0000 7f3dda7fc640 1 --2- 172.21.15.92:0/802839909 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f3dc8078370 0x7f3dc807a830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:40.512 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.460+0000 7f1c40ff9640 1 -- 172.21.15.92:0/3618702989 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f1c3809b740 con 0x7f1c440d04e0 2024-09-11T00:14:40.512 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.460+0000 7f74f659c640 1 --2- 172.21.15.92:0/902030292 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f74d8077fa0 0x7f74d807a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:40.513 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.460+0000 7f6792ffd640 1 -- 172.21.15.92:0/3079568452 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f679409a440 con 0x7f679c0d2670 2024-09-11T00:14:40.513 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.460+0000 7f1c43fff640 1 --2- 172.21.15.92:0/3618702989 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f1c30078040 0x7f1c3007a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:40.513 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.460+0000 7f67a20ac640 1 --2- 172.21.15.92:0/3079568452 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f6780078040 0x7f678007a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:40.514 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.460+0000 7f1c40ff9640 1 --2- 172.21.15.92:0/3618702989 >> [v2:172.21.15.92:6808/3143892898,v1:172.21.15.92:6809/3143892898] conn(0x7f1c300817b0 0x7f1c30083bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:40.514 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.460+0000 7f1c40ff9640 1 -- 172.21.15.92:0/3618702989 --> [v2:172.21.15.92:6808/3143892898,v1:172.21.15.92:6809/3143892898] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f1c38010430 con 0x7f1c300817b0 2024-09-11T00:14:40.514 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.460+0000 7f1c40ff9640 1 -- 172.21.15.92:0/3618702989 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f1c3809bb30 con 0x7f1c440d04e0 2024-09-11T00:14:40.514 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.460+0000 7f6792ffd640 1 --2- 172.21.15.92:0/3079568452 >> [v2:172.21.15.145:6802/4192380792,v1:172.21.15.145:6803/4192380792] conn(0x7f67800817c0 0x7f6780083c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:40.514 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.460+0000 7f6792ffd640 1 -- 172.21.15.92:0/3079568452 --> [v2:172.21.15.145:6802/4192380792,v1:172.21.15.145:6803/4192380792] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f67800842d0 con 0x7f67800817c0 2024-09-11T00:14:40.514 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.460+0000 7f6792ffd640 1 -- 172.21.15.92:0/3079568452 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f679409f060 con 0x7f679c0d2670 2024-09-11T00:14:40.515 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.460+0000 7f1c48aef640 1 --2- 172.21.15.92:0/3618702989 >> [v2:172.21.15.92:6808/3143892898,v1:172.21.15.92:6809/3143892898] conn(0x7f1c300817b0 0x7f1c30083bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:40.515 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.460+0000 7f3de94bf640 1 --2- 172.21.15.92:0/802839909 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f3dc8078370 0x7f3dc807a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:40.515 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.460+0000 7f74f659c640 1 --2- 172.21.15.92:0/902030292 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f74d8077fa0 0x7f74d807a460 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f74ec005c80 tx=0x7f74ec009260 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:14:40.515 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.460+0000 7f67a18ab640 1 --2- 172.21.15.92:0/3079568452 >> [v2:172.21.15.145:6802/4192380792,v1:172.21.15.145:6803/4192380792] conn(0x7f67800817c0 0x7f6780083c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:40.516 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.461+0000 7f3dda7fc640 1 -- 172.21.15.92:0/802839909 <== mon.2 v2:172.21.15.145:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f3de00052e0 con 0x7f3de40cff50 2024-09-11T00:14:40.516 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.461+0000 7f1c43fff640 1 --2- 172.21.15.92:0/3618702989 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f1c30078040 0x7f1c3007a500 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f1c340096c0 tx=0x7f1c34009260 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:14:40.516 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.461+0000 7f74e6ffd640 1 -- 172.21.15.92:0/902030292 <== osd.3 v2:172.21.15.92:6824/3913961488 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f74d8084230 con 0x7f74d8081720 2024-09-11T00:14:40.517 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.461+0000 7f67a20ac640 1 --2- 172.21.15.92:0/3079568452 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f6780078040 0x7f678007a500 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f678c000f60 tx=0x7f678c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:14:40.517 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.460+0000 7fde597fa640 1 -- 172.21.15.92:0/3864126590 <== osd.5 v2:172.21.15.145:6810/2599548493 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fde400842d0 con 0x7fde400817c0 2024-09-11T00:14:40.517 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.461+0000 7fb04f7fe640 1 --2- 172.21.15.92:0/3892569920 >> [v2:172.21.15.145:6826/2206798907,v1:172.21.15.145:6827/2206798907] conn(0x7fb0340817c0 0x7fb034083c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:40.517 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.461+0000 7f3de94bf640 1 --2- 172.21.15.92:0/802839909 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f3dc8078370 0x7f3dc807a830 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f3dd40058c0 tx=0x7f3dd4005850 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:14:40.518 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.461+0000 7f25fd7fa640 1 -- 172.21.15.92:0/1582436163 <== mon.2 v2:172.21.15.145:3301/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f25f0005450 con 0x7f2600073e20 2024-09-11T00:14:40.518 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.461+0000 7f3dda7fc640 1 --2- 172.21.15.92:0/802839909 >> [v2:172.21.15.145:6818/3010598400,v1:172.21.15.145:6819/3010598400] conn(0x7f3dc8081970 0x7f3dc8083db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:40.518 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.461+0000 7f3dda7fc640 1 -- 172.21.15.92:0/802839909 --> [v2:172.21.15.145:6818/3010598400,v1:172.21.15.145:6819/3010598400] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3dc8084480 con 0x7f3dc8081970 2024-09-11T00:14:40.518 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.461+0000 7f3dda7fc640 1 -- 172.21.15.92:0/802839909 <== mon.2 v2:172.21.15.145:3301/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f3de005d040 con 0x7f3de40cff50 2024-09-11T00:14:40.518 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.461+0000 7fb04ffff640 1 --2- 172.21.15.92:0/3892569920 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7fb034078040 0x7fb03407a500 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fb048037e10 tx=0x7fb05006a670 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:14:40.519 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.461+0000 7f1c48aef640 1 --2- 172.21.15.92:0/3618702989 >> [v2:172.21.15.92:6808/3143892898,v1:172.21.15.92:6809/3143892898] conn(0x7f1c300817b0 0x7f1c30083bf0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:14:40.519 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.461+0000 7f67a18ab640 1 --2- 172.21.15.92:0/3079568452 >> [v2:172.21.15.145:6802/4192380792,v1:172.21.15.145:6803/4192380792] conn(0x7f67800817c0 0x7f6780083c00 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:14:40.519 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.461+0000 7f25fd7fa640 1 --2- 172.21.15.92:0/1582436163 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f25ec078040 0x7f25ec07a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:40.519 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.461+0000 7f3dea4c1640 1 --2- 172.21.15.92:0/802839909 >> [v2:172.21.15.145:6818/3010598400,v1:172.21.15.145:6819/3010598400] conn(0x7f3dc8081970 0x7f3dc8083db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:40.520 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.461+0000 7f25fd7fa640 1 -- 172.21.15.92:0/1582436163 <== mon.2 v2:172.21.15.145:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f25f009a8a0 con 0x7f2600073e20 2024-09-11T00:14:40.520 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.462+0000 7f25fd7fa640 1 --2- 172.21.15.92:0/1582436163 >> [v2:172.21.15.92:6800/2860560077,v1:172.21.15.92:6801/2860560077] conn(0x7f25ec0817b0 0x7f25ec083bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:40.520 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.462+0000 7f25fffff640 1 --2- 172.21.15.92:0/1582436163 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f25ec078040 0x7f25ec07a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:40.520 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.462+0000 7f25fd7fa640 1 -- 172.21.15.92:0/1582436163 --> [v2:172.21.15.92:6800/2860560077,v1:172.21.15.92:6801/2860560077] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f25ec0842c0 con 0x7f25ec0817b0 2024-09-11T00:14:40.520 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.462+0000 7f25fd7fa640 1 -- 172.21.15.92:0/1582436163 <== mon.2 v2:172.21.15.145:3301/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f25f009f2a0 con 0x7f2600073e20 2024-09-11T00:14:40.521 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.462+0000 7fb04f7fe640 1 --2- 172.21.15.92:0/3892569920 >> [v2:172.21.15.145:6826/2206798907,v1:172.21.15.145:6827/2206798907] conn(0x7fb0340817c0 0x7fb034083c00 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:14:40.521 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.462+0000 7f260535f640 1 --2- 172.21.15.92:0/1582436163 >> [v2:172.21.15.92:6800/2860560077,v1:172.21.15.92:6801/2860560077] conn(0x7f25ec0817b0 0x7f25ec083bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:40.521 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.462+0000 7f6792ffd640 1 -- 172.21.15.92:0/3079568452 <== osd.6 v2:172.21.15.145:6802/4192380792 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f67800842d0 con 0x7f67800817c0 2024-09-11T00:14:40.521 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.462+0000 7f1c40ff9640 1 -- 172.21.15.92:0/3618702989 <== osd.2 v2:172.21.15.92:6808/3143892898 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f1c38010430 con 0x7f1c300817b0 2024-09-11T00:14:40.522 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.462+0000 7f260535f640 1 --2- 172.21.15.92:0/1582436163 >> [v2:172.21.15.92:6800/2860560077,v1:172.21.15.92:6801/2860560077] conn(0x7f25ec0817b0 0x7f25ec083bf0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:14:40.522 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.462+0000 7fb04cff9640 1 -- 172.21.15.92:0/3892569920 <== osd.4 v2:172.21.15.145:6826/2206798907 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fb03c00f450 con 0x7fb0340817c0 2024-09-11T00:14:40.522 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.462+0000 7f3dea4c1640 1 --2- 172.21.15.92:0/802839909 >> [v2:172.21.15.145:6818/3010598400,v1:172.21.15.145:6819/3010598400] conn(0x7f3dc8081970 0x7f3dc8083db0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:14:40.523 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.463+0000 7f25fffff640 1 --2- 172.21.15.92:0/1582436163 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f25ec078040 0x7f25ec07a500 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f25f4036000 tx=0x7f25f4004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:14:40.523 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.463+0000 7f25fd7fa640 1 -- 172.21.15.92:0/1582436163 <== osd.0 v2:172.21.15.92:6800/2860560077 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f25ec0842c0 con 0x7f25ec0817b0 2024-09-11T00:14:40.523 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.465+0000 7f3dda7fc640 1 -- 172.21.15.92:0/802839909 <== osd.7 v2:172.21.15.145:6818/3010598400 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f3dc8084480 con 0x7f3dc8081970 2024-09-11T00:14:40.523 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.489+0000 7f74fcf82640 1 -- 172.21.15.92:0/902030292 --> [v2:172.21.15.92:6824/3913961488,v1:172.21.15.92:6825/3913961488] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f74f80cd660 con 0x7f74d8081720 2024-09-11T00:14:40.523 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.490+0000 7f74e6ffd640 1 -- 172.21.15.92:0/902030292 <== osd.3 v2:172.21.15.92:6824/3913961488 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f74f80cd660 con 0x7f74d8081720 2024-09-11T00:14:40.524 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.491+0000 7f74e4ff9640 1 -- 172.21.15.92:0/902030292 >> [v2:172.21.15.92:6824/3913961488,v1:172.21.15.92:6825/3913961488] conn(0x7f74d8081720 msgr2=0x7f74d8083b60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:40.524 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.491+0000 7f74e4ff9640 1 --2- 172.21.15.92:0/902030292 >> [v2:172.21.15.92:6824/3913961488,v1:172.21.15.92:6825/3913961488] conn(0x7f74d8081720 0x7f74d8083b60 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:40.524 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.491+0000 7f51bbcef640 1 -- 172.21.15.92:0/3677621173 --> [v2:172.21.15.92:6816/2600417443,v1:172.21.15.92:6817/2600417443] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f51b40b3f30 con 0x7f51980817c0 2024-09-11T00:14:40.525 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.491+0000 7fde630a3640 1 -- 172.21.15.92:0/3864126590 --> [v2:172.21.15.145:6810/2599548493,v1:172.21.15.145:6811/2599548493] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fde5c155ae0 con 0x7fde400817c0 2024-09-11T00:14:40.525 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.491+0000 7f74e4ff9640 1 -- 172.21.15.92:0/902030292 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f74d8077fa0 msgr2=0x7f74d807a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:40.525 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.491+0000 7f74e4ff9640 1 --2- 172.21.15.92:0/902030292 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f74d8077fa0 0x7f74d807a460 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f74ec005c80 tx=0x7f74ec009260 comp rx=0 tx=0).stop 2024-09-11T00:14:40.525 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.491+0000 7f74e4ff9640 1 -- 172.21.15.92:0/902030292 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f74f815da30 msgr2=0x7f74f8167320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:40.526 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.491+0000 7f74e4ff9640 1 --2- 172.21.15.92:0/902030292 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f74f815da30 0x7f74f8167320 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f74e800c390 tx=0x7f74e800c850 comp rx=0 tx=0).stop 2024-09-11T00:14:40.526 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.491+0000 7f74f6d9d640 1 -- 172.21.15.92:0/902030292 reap_dead start 2024-09-11T00:14:40.527 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.491+0000 7f51aa7fc640 1 -- 172.21.15.92:0/3677621173 <== osd.1 v2:172.21.15.92:6816/2600417443 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f51b40b3f30 con 0x7f51980817c0 2024-09-11T00:14:40.528 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.491+0000 7f74e4ff9640 1 -- 172.21.15.92:0/902030292 shutdown_connections 2024-09-11T00:14:40.528 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.491+0000 7f74e4ff9640 1 -- 172.21.15.92:0/902030292 >> 172.21.15.92:0/902030292 conn(0x7f74f80b1760 msgr2=0x7f74f8073e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:14:40.528 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.492+0000 7f74e4ff9640 1 -- 172.21.15.92:0/902030292 shutdown_connections 2024-09-11T00:14:40.528 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.492+0000 7f74e4ff9640 1 -- 172.21.15.92:0/902030292 wait complete. 2024-09-11T00:14:40.529 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.492+0000 7f51bbcef640 1 -- 172.21.15.92:0/3677621173 >> [v2:172.21.15.92:6816/2600417443,v1:172.21.15.92:6817/2600417443] conn(0x7f51980817c0 msgr2=0x7f5198083c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:40.529 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.492+0000 7f51bbcef640 1 --2- 172.21.15.92:0/3677621173 >> [v2:172.21.15.92:6816/2600417443,v1:172.21.15.92:6817/2600417443] conn(0x7f51980817c0 0x7f5198083c00 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:40.529 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.492+0000 7f51bbcef640 1 -- 172.21.15.92:0/3677621173 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f5198078040 msgr2=0x7f519807a500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:40.529 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.492+0000 7f51bbcef640 1 --2- 172.21.15.92:0/3677621173 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f5198078040 0x7f519807a500 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f51b41584a0 tx=0x7f51a400b270 comp rx=0 tx=0).stop 2024-09-11T00:14:40.529 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.492+0000 7f51bbcef640 1 -- 172.21.15.92:0/3677621173 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f51b40725d0 msgr2=0x7f51b413e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:40.529 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.492+0000 7f51bbcef640 1 --2- 172.21.15.92:0/3677621173 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f51b40725d0 0x7f51b413e2f0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f51b000c450 tx=0x7f51b000c910 comp rx=0 tx=0).stop 2024-09-11T00:14:40.529 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.492+0000 7f1c492f0640 1 -- 172.21.15.92:0/3618702989 --> [v2:172.21.15.92:6808/3143892898,v1:172.21.15.92:6809/3143892898] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f1c441f9760 con 0x7f1c300817b0 2024-09-11T00:14:40.530 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.492+0000 7f51ba28c640 1 -- 172.21.15.92:0/3677621173 reap_dead start 2024-09-11T00:14:40.530 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.492+0000 7f51bbcef640 1 -- 172.21.15.92:0/3677621173 shutdown_connections 2024-09-11T00:14:40.530 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.492+0000 7f51bbcef640 1 -- 172.21.15.92:0/3677621173 >> 172.21.15.92:0/3677621173 conn(0x7f51b40b1760 msgr2=0x7f51b40b1b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:14:40.530 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.492+0000 7fde597fa640 1 -- 172.21.15.92:0/3864126590 <== osd.5 v2:172.21.15.145:6810/2599548493 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fde5c155ae0 con 0x7fde400817c0 2024-09-11T00:14:40.531 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.493+0000 7f51bbcef640 1 -- 172.21.15.92:0/3677621173 shutdown_connections 2024-09-11T00:14:40.531 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.493+0000 7f51bbcef640 1 -- 172.21.15.92:0/3677621173 wait complete. 2024-09-11T00:14:40.531 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.493+0000 7f1c40ff9640 1 -- 172.21.15.92:0/3618702989 <== osd.2 v2:172.21.15.92:6808/3143892898 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f1c441f9760 con 0x7f1c300817b0 2024-09-11T00:14:40.532 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.493+0000 7fde630a3640 1 -- 172.21.15.92:0/3864126590 >> [v2:172.21.15.145:6810/2599548493,v1:172.21.15.145:6811/2599548493] conn(0x7fde400817c0 msgr2=0x7fde40083c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:40.532 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.493+0000 7fde630a3640 1 --2- 172.21.15.92:0/3864126590 >> [v2:172.21.15.145:6810/2599548493,v1:172.21.15.145:6811/2599548493] conn(0x7fde400817c0 0x7fde40083c00 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:40.532 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.493+0000 7f67a4310640 1 -- 172.21.15.92:0/3079568452 --> [v2:172.21.15.145:6802/4192380792,v1:172.21.15.145:6803/4192380792] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f679c070cc0 con 0x7f67800817c0 2024-09-11T00:14:40.532 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.493+0000 7fde630a3640 1 -- 172.21.15.92:0/3864126590 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7fde40078040 msgr2=0x7fde4007a500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:40.532 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.493+0000 7fde630a3640 1 --2- 172.21.15.92:0/3864126590 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7fde40078040 0x7fde4007a500 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fde48033000 tx=0x7fde48004730 comp rx=0 tx=0).stop 2024-09-11T00:14:40.533 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.493+0000 7fde630a3640 1 -- 172.21.15.92:0/3864126590 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fde5c06f820 msgr2=0x7fde5c0cd160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:40.533 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.493+0000 7fde630a3640 1 --2- 172.21.15.92:0/3864126590 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fde5c06f820 0x7fde5c0cd160 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fde5000e790 tx=0x7fde5000ec50 comp rx=0 tx=0).stop 2024-09-11T00:14:40.533 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.493+0000 7fde61640640 1 -- 172.21.15.92:0/3864126590 reap_dead start 2024-09-11T00:14:40.533 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.493+0000 7f1c492f0640 1 -- 172.21.15.92:0/3618702989 >> [v2:172.21.15.92:6808/3143892898,v1:172.21.15.92:6809/3143892898] conn(0x7f1c300817b0 msgr2=0x7f1c30083bf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:40.534 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.493+0000 7fde630a3640 1 -- 172.21.15.92:0/3864126590 shutdown_connections 2024-09-11T00:14:40.534 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.493+0000 7fde630a3640 1 -- 172.21.15.92:0/3864126590 >> 172.21.15.92:0/3864126590 conn(0x7fde5c0b1530 msgr2=0x7fde5c0cfbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:14:40.534 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.493+0000 7f1c492f0640 1 --2- 172.21.15.92:0/3618702989 >> [v2:172.21.15.92:6808/3143892898,v1:172.21.15.92:6809/3143892898] conn(0x7f1c300817b0 0x7f1c30083bf0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:40.534 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.493+0000 7f1c492f0640 1 -- 172.21.15.92:0/3618702989 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f1c30078040 msgr2=0x7f1c3007a500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:40.534 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.493+0000 7f1c492f0640 1 --2- 172.21.15.92:0/3618702989 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f1c30078040 0x7f1c3007a500 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f1c340096c0 tx=0x7f1c34009260 comp rx=0 tx=0).stop 2024-09-11T00:14:40.534 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.493+0000 7f1c492f0640 1 -- 172.21.15.92:0/3618702989 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1c440d04e0 msgr2=0x7f1c440b5f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:40.534 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.493+0000 7f1c492f0640 1 --2- 172.21.15.92:0/3618702989 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1c440d04e0 0x7f1c440b5f40 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f1c3800e9f0 tx=0x7f1c3800eeb0 comp rx=0 tx=0).stop 2024-09-11T00:14:40.535 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.493+0000 7f1c48aef640 1 -- 172.21.15.92:0/3618702989 reap_dead start 2024-09-11T00:14:40.535 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.494+0000 7fde630a3640 1 -- 172.21.15.92:0/3864126590 shutdown_connections 2024-09-11T00:14:40.535 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.494+0000 7fde630a3640 1 -- 172.21.15.92:0/3864126590 wait complete. 2024-09-11T00:14:40.535 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.494+0000 7f3debf24640 1 -- 172.21.15.92:0/802839909 --> [v2:172.21.15.145:6818/3010598400,v1:172.21.15.145:6819/3010598400] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f3de40c5fd0 con 0x7f3dc8081970 2024-09-11T00:14:40.535 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.494+0000 7f1c492f0640 1 -- 172.21.15.92:0/3618702989 shutdown_connections 2024-09-11T00:14:40.536 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.494+0000 7f1c492f0640 1 -- 172.21.15.92:0/3618702989 >> 172.21.15.92:0/3618702989 conn(0x7f1c4409ce80 msgr2=0x7f1c4415fdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:14:40.536 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.494+0000 7f1c492f0640 1 -- 172.21.15.92:0/3618702989 shutdown_connections 2024-09-11T00:14:40.536 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.494+0000 7f1c492f0640 1 -- 172.21.15.92:0/3618702989 wait complete. 2024-09-11T00:14:40.536 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.494+0000 7f6792ffd640 1 -- 172.21.15.92:0/3079568452 <== osd.6 v2:172.21.15.145:6802/4192380792 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f679c070cc0 con 0x7f67800817c0 2024-09-11T00:14:40.536 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.494+0000 7fb0554f1640 1 -- 172.21.15.92:0/3892569920 --> [v2:172.21.15.145:6826/2206798907,v1:172.21.15.145:6827/2206798907] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fb030002dd0 con 0x7fb0340817c0 2024-09-11T00:14:40.537 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.495+0000 7f3dda7fc640 1 -- 172.21.15.92:0/802839909 <== osd.7 v2:172.21.15.145:6818/3010598400 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f3de40c5fd0 con 0x7f3dc8081970 2024-09-11T00:14:40.537 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.495+0000 7fb04cff9640 1 -- 172.21.15.92:0/3892569920 <== osd.4 v2:172.21.15.145:6826/2206798907 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fb030002dd0 con 0x7fb0340817c0 2024-09-11T00:14:40.538 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.495+0000 7f67a4310640 1 -- 172.21.15.92:0/3079568452 >> [v2:172.21.15.145:6802/4192380792,v1:172.21.15.145:6803/4192380792] conn(0x7f67800817c0 msgr2=0x7f6780083c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:40.538 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.495+0000 7f67a4310640 1 --2- 172.21.15.92:0/3079568452 >> [v2:172.21.15.145:6802/4192380792,v1:172.21.15.145:6803/4192380792] conn(0x7f67800817c0 0x7f6780083c00 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:40.540 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.495+0000 7f25e6ffd640 1 -- 172.21.15.92:0/1582436163 --> [v2:172.21.15.92:6800/2860560077,v1:172.21.15.92:6801/2860560077] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f26001e7550 con 0x7f25ec0817b0 2024-09-11T00:14:40.541 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.495+0000 7f3debf24640 1 -- 172.21.15.92:0/802839909 >> [v2:172.21.15.145:6818/3010598400,v1:172.21.15.145:6819/3010598400] conn(0x7f3dc8081970 msgr2=0x7f3dc8083db0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:40.541 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.495+0000 7f3debf24640 1 --2- 172.21.15.92:0/802839909 >> [v2:172.21.15.145:6818/3010598400,v1:172.21.15.145:6819/3010598400] conn(0x7f3dc8081970 0x7f3dc8083db0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:40.542 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.496+0000 7f25fd7fa640 1 -- 172.21.15.92:0/1582436163 <== osd.0 v2:172.21.15.92:6800/2860560077 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f26001e7550 con 0x7f25ec0817b0 2024-09-11T00:14:40.542 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.496+0000 7fb0554f1640 1 -- 172.21.15.92:0/3892569920 >> [v2:172.21.15.145:6826/2206798907,v1:172.21.15.145:6827/2206798907] conn(0x7fb0340817c0 msgr2=0x7fb034083c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:40.542 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.496+0000 7fb0554f1640 1 --2- 172.21.15.92:0/3892569920 >> [v2:172.21.15.145:6826/2206798907,v1:172.21.15.145:6827/2206798907] conn(0x7fb0340817c0 0x7fb034083c00 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:40.543 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.496+0000 7f3debf24640 1 -- 172.21.15.92:0/802839909 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f3dc8078370 msgr2=0x7f3dc807a830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:40.543 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.496+0000 7f3debf24640 1 --2- 172.21.15.92:0/802839909 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f3dc8078370 0x7f3dc807a830 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f3dd40058c0 tx=0x7f3dd4005850 comp rx=0 tx=0).stop 2024-09-11T00:14:40.543 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.496+0000 7f3debf24640 1 -- 172.21.15.92:0/802839909 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3de40cff50 msgr2=0x7f3de4156ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:40.543 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.496+0000 7f3debf24640 1 --2- 172.21.15.92:0/802839909 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3de40cff50 0x7f3de4156ec0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f3de000c430 tx=0x7f3de000c8f0 comp rx=0 tx=0).stop 2024-09-11T00:14:40.543 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.496+0000 7f3dea4c1640 1 -- 172.21.15.92:0/802839909 reap_dead start 2024-09-11T00:14:40.544 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.496+0000 7f67a4310640 1 -- 172.21.15.92:0/3079568452 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f6780078040 msgr2=0x7f678007a500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:40.544 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.496+0000 7f67a4310640 1 --2- 172.21.15.92:0/3079568452 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f6780078040 0x7f678007a500 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f678c000f60 tx=0x7f678c009040 comp rx=0 tx=0).stop 2024-09-11T00:14:40.544 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.496+0000 7f67a4310640 1 -- 172.21.15.92:0/3079568452 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f679c0d2670 msgr2=0x7f679c0b6200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:40.544 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.496+0000 7f67a4310640 1 --2- 172.21.15.92:0/3079568452 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f679c0d2670 0x7f679c0b6200 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f679400ecb0 tx=0x7f679400c6a0 comp rx=0 tx=0).stop 2024-09-11T00:14:40.544 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.496+0000 7f67a28ad640 1 -- 172.21.15.92:0/3079568452 reap_dead start 2024-09-11T00:14:40.545 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.496+0000 7f3debf24640 1 -- 172.21.15.92:0/802839909 shutdown_connections 2024-09-11T00:14:40.545 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.496+0000 7f3debf24640 1 -- 172.21.15.92:0/802839909 >> 172.21.15.92:0/802839909 conn(0x7f3de40d1a60 msgr2=0x7f3de40ae7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:14:40.545 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.496+0000 7f3debf24640 1 -- 172.21.15.92:0/802839909 shutdown_connections 2024-09-11T00:14:40.545 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.496+0000 7fb0554f1640 1 -- 172.21.15.92:0/3892569920 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7fb034078040 msgr2=0x7fb03407a500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:40.545 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.496+0000 7fb0554f1640 1 --2- 172.21.15.92:0/3892569920 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7fb034078040 0x7fb03407a500 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fb048037e10 tx=0x7fb05006a670 comp rx=0 tx=0).stop 2024-09-11T00:14:40.546 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.496+0000 7f3debf24640 1 -- 172.21.15.92:0/802839909 wait complete. 2024-09-11T00:14:40.546 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.496+0000 7fb0554f1640 1 -- 172.21.15.92:0/3892569920 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb0480e2c20 msgr2=0x7fb048033780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:40.546 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.496+0000 7fb0554f1640 1 --2- 172.21.15.92:0/3892569920 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb0480e2c20 0x7fb048033780 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fb03c00c970 tx=0x7fb03c00ce30 comp rx=0 tx=0).stop 2024-09-11T00:14:40.546 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.496+0000 7fb054cf0640 1 -- 172.21.15.92:0/3892569920 reap_dead start 2024-09-11T00:14:40.546 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.496+0000 7f67a4310640 1 -- 172.21.15.92:0/3079568452 shutdown_connections 2024-09-11T00:14:40.546 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.496+0000 7f67a4310640 1 -- 172.21.15.92:0/3079568452 >> 172.21.15.92:0/3079568452 conn(0x7f679c0d1b50 msgr2=0x7f679c0b2250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:14:40.547 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.496+0000 7f67a4310640 1 -- 172.21.15.92:0/3079568452 shutdown_connections 2024-09-11T00:14:40.547 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.496+0000 7f67a4310640 1 -- 172.21.15.92:0/3079568452 wait complete. 2024-09-11T00:14:40.547 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.496+0000 7f25e6ffd640 1 -- 172.21.15.92:0/1582436163 >> [v2:172.21.15.92:6800/2860560077,v1:172.21.15.92:6801/2860560077] conn(0x7f25ec0817b0 msgr2=0x7f25ec083bf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:40.547 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.496+0000 7f25e6ffd640 1 --2- 172.21.15.92:0/1582436163 >> [v2:172.21.15.92:6800/2860560077,v1:172.21.15.92:6801/2860560077] conn(0x7f25ec0817b0 0x7f25ec083bf0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:40.547 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.497+0000 7f25e6ffd640 1 -- 172.21.15.92:0/1582436163 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f25ec078040 msgr2=0x7f25ec07a500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:40.547 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.497+0000 7f25e6ffd640 1 --2- 172.21.15.92:0/1582436163 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f25ec078040 0x7f25ec07a500 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f25f4036000 tx=0x7f25f4004730 comp rx=0 tx=0).stop 2024-09-11T00:14:40.547 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.497+0000 7f25e6ffd640 1 -- 172.21.15.92:0/1582436163 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2600073e20 msgr2=0x7f2600201e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:40.548 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.497+0000 7f25e6ffd640 1 --2- 172.21.15.92:0/1582436163 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2600073e20 0x7f2600201e90 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f25f000e9c0 tx=0x7f25f000ee80 comp rx=0 tx=0).stop 2024-09-11T00:14:40.548 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.497+0000 7f260535f640 1 -- 172.21.15.92:0/1582436163 reap_dead start 2024-09-11T00:14:40.548 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.497+0000 7fb0554f1640 1 -- 172.21.15.92:0/3892569920 shutdown_connections 2024-09-11T00:14:40.548 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.497+0000 7f25e6ffd640 1 -- 172.21.15.92:0/1582436163 shutdown_connections 2024-09-11T00:14:40.548 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.497+0000 7f25e6ffd640 1 -- 172.21.15.92:0/1582436163 >> 172.21.15.92:0/1582436163 conn(0x7f26000b2ad0 msgr2=0x7f260015cbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:14:40.549 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.497+0000 7fb0554f1640 1 -- 172.21.15.92:0/3892569920 >> 172.21.15.92:0/3892569920 conn(0x7fb04801e890 msgr2=0x7fb0480534a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:14:40.549 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.497+0000 7f25e6ffd640 1 -- 172.21.15.92:0/1582436163 shutdown_connections 2024-09-11T00:14:40.549 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.497+0000 7f25e6ffd640 1 -- 172.21.15.92:0/1582436163 wait complete. 2024-09-11T00:14:40.550 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.497+0000 7fb0554f1640 1 -- 172.21.15.92:0/3892569920 shutdown_connections 2024-09-11T00:14:40.550 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.498+0000 7fb0554f1640 1 -- 172.21.15.92:0/3892569920 wait complete. 2024-09-11T00:14:40.550 INFO:teuthology.orchestra.run.smithi092.stdout:64424509451 2024-09-11T00:14:40.551 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-11T00:14:40.551 INFO:teuthology.orchestra.run.smithi092.stdout:64424509449 2024-09-11T00:14:40.552 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-11T00:14:40.552 INFO:teuthology.orchestra.run.smithi092.stdout:60129542154 2024-09-11T00:14:40.553 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-11T00:14:40.553 INFO:teuthology.orchestra.run.smithi092.stdout:64424509450 2024-09-11T00:14:40.554 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-11T00:14:40.554 INFO:teuthology.orchestra.run.smithi092.stdout:64424509450 2024-09-11T00:14:40.555 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-11T00:14:40.556 INFO:teuthology.orchestra.run.smithi092.stdout:55834574859 2024-09-11T00:14:40.556 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-11T00:14:40.557 INFO:teuthology.orchestra.run.smithi092.stdout:64424509450 2024-09-11T00:14:40.557 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-11T00:14:40.558 INFO:teuthology.orchestra.run.smithi092.stdout:64424509449 2024-09-11T00:14:40.558 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-11T00:14:40.763 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.761+0000 7f1aa325b640 1 -- 172.21.15.92:0/4247355600 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1a9c06d160 msgr2=0x7f1a9c1615d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:40.763 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.761+0000 7f1aa325b640 1 --2- 172.21.15.92:0/4247355600 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1a9c06d160 0x7f1a9c1615d0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f1a94005fd0 tx=0x7f1a9402a970 comp rx=0 tx=0).stop 2024-09-11T00:14:40.763 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.761+0000 7f1aa325b640 1 -- 172.21.15.92:0/4247355600 shutdown_connections 2024-09-11T00:14:40.763 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.761+0000 7f1aa325b640 1 --2- 172.21.15.92:0/4247355600 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1a9c06d160 0x7f1a9c1615d0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:40.763 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.761+0000 7f1aa325b640 1 -- 172.21.15.92:0/4247355600 >> 172.21.15.92:0/4247355600 conn(0x7f1a9c0d0970 msgr2=0x7f1a9c0d0d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:14:40.764 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.761+0000 7f1027f52640 1 -- 172.21.15.92:0/4144471221 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1020070f90 msgr2=0x7f1020070760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:40.764 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.761+0000 7f1027f52640 1 --2- 172.21.15.92:0/4144471221 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1020070f90 0x7f1020070760 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f1010009830 tx=0x7f101002a520 comp rx=0 tx=0).stop 2024-09-11T00:14:40.764 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.761+0000 7f1027f52640 1 -- 172.21.15.92:0/4144471221 shutdown_connections 2024-09-11T00:14:40.764 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.761+0000 7f1027f52640 1 --2- 172.21.15.92:0/4144471221 >> v2:172.21.15.92:3300/0 conn(0x7f1020071370 0x7f1020162320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:40.764 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.761+0000 7f1027f52640 1 --2- 172.21.15.92:0/4144471221 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1020070f90 0x7f1020070760 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:40.764 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.761+0000 7f1027f52640 1 -- 172.21.15.92:0/4144471221 >> 172.21.15.92:0/4144471221 conn(0x7f10200d1d10 msgr2=0x7f10200d2120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:14:40.764 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.761+0000 7f1aa325b640 1 -- 172.21.15.92:0/4247355600 shutdown_connections 2024-09-11T00:14:40.765 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.762+0000 7f1027f52640 1 -- 172.21.15.92:0/4144471221 shutdown_connections 2024-09-11T00:14:40.765 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.762+0000 7f1027f52640 1 -- 172.21.15.92:0/4144471221 wait complete. 2024-09-11T00:14:40.765 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.763+0000 7f9528e1a640 1 -- 172.21.15.92:0/2739680167 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f951c0e3d80 msgr2=0x7f951c052fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:40.765 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.763+0000 7f9528e1a640 1 --2- 172.21.15.92:0/2739680167 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f951c0e3d80 0x7f951c052fe0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f952406ba30 tx=0x7f95240a5b80 comp rx=0 tx=0).stop 2024-09-11T00:14:40.765 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.761+0000 7f1aa325b640 1 -- 172.21.15.92:0/4247355600 wait complete. 2024-09-11T00:14:40.766 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.763+0000 7f9528e1a640 1 -- 172.21.15.92:0/2739680167 shutdown_connections 2024-09-11T00:14:40.766 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.763+0000 7f9528e1a640 1 --2- 172.21.15.92:0/2739680167 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f951c0e3d80 0x7f951c052fe0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:40.766 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.763+0000 7f9528e1a640 1 -- 172.21.15.92:0/2739680167 >> 172.21.15.92:0/2739680167 conn(0x7f951c056710 msgr2=0x7f951c056b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:14:40.766 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.763+0000 7f9528e1a640 1 -- 172.21.15.92:0/2739680167 shutdown_connections 2024-09-11T00:14:40.766 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.763+0000 7f9528e1a640 1 -- 172.21.15.92:0/2739680167 wait complete. 2024-09-11T00:14:40.766 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.764+0000 7f49ad1bc640 1 -- 172.21.15.92:0/2742609781 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f49a806fe60 msgr2=0x7f49a815df70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:40.767 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.764+0000 7f49ad1bc640 1 --2- 172.21.15.92:0/2742609781 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f49a806fe60 0x7f49a815df70 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f49a000afd0 tx=0x7f49a002b490 comp rx=0 tx=0).stop 2024-09-11T00:14:40.767 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.763+0000 7f1aa325b640 1 Processor -- start 2024-09-11T00:14:40.767 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.764+0000 7f1aa325b640 1 -- start start 2024-09-11T00:14:40.767 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.764+0000 7f1027f52640 1 Processor -- start 2024-09-11T00:14:40.768 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.764+0000 7f49ad1bc640 1 -- 172.21.15.92:0/2742609781 shutdown_connections 2024-09-11T00:14:40.768 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.764+0000 7f49ad1bc640 1 --2- 172.21.15.92:0/2742609781 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f49a806fe60 0x7f49a815df70 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:40.768 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.764+0000 7f49ad1bc640 1 --2- 172.21.15.92:0/2742609781 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f49a815b1e0 0x7f49a815da30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:40.768 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.764+0000 7f49ad1bc640 1 -- 172.21.15.92:0/2742609781 >> 172.21.15.92:0/2742609781 conn(0x7f49a80b1760 msgr2=0x7f49a80b1b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:14:40.768 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.765+0000 7f1aa325b640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1a9c06d160 0x7f1a9c151760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:40.768 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.765+0000 7f1aa325b640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1a9c071990 0x7f1a9c150ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:40.769 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.765+0000 7f1aa325b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1a9c0aff20 0x7f1a9c152f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:40.769 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.765+0000 7f1aa325b640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f1a9c0b4cc0 con 0x7f1a9c0aff20 2024-09-11T00:14:40.769 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.765+0000 7f1aa325b640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f1a9c0b4b40 con 0x7f1a9c071990 2024-09-11T00:14:40.769 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.765+0000 7f1aa325b640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f1a9c0b4e40 con 0x7f1a9c06d160 2024-09-11T00:14:40.769 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.765+0000 7f8e2f356640 1 -- 172.21.15.92:0/3766424290 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8e280b2410 msgr2=0x7f8e280b28a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:40.769 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.765+0000 7f1aa2a5a640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1a9c0aff20 0x7f1a9c152f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:40.770 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.765+0000 7f49ad1bc640 1 -- 172.21.15.92:0/2742609781 shutdown_connections 2024-09-11T00:14:40.770 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.765+0000 7f9528e1a640 1 Processor -- start 2024-09-11T00:14:40.771 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.765+0000 7f1aa2a5a640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1a9c0aff20 0x7f1a9c152f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:50536/0 (socket says 172.21.15.92:50536) 2024-09-11T00:14:40.771 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.765+0000 7f1aa2a5a640 1 -- 172.21.15.92:0/1127844495 learned_addr learned my addr 172.21.15.92:0/1127844495 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-11T00:14:40.771 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.765+0000 7f1aa2259640 1 --2- 172.21.15.92:0/1127844495 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1a9c06d160 0x7f1a9c151760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:40.771 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.766+0000 7f1aa1a58640 1 --2- 172.21.15.92:0/1127844495 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1a9c071990 0x7f1a9c150ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:40.771 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.766+0000 7f9528e1a640 1 -- start start 2024-09-11T00:14:40.772 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.766+0000 7f1aa2a5a640 1 -- 172.21.15.92:0/1127844495 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1a9c06d160 msgr2=0x7f1a9c151760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:40.772 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.766+0000 7f1aa2a5a640 1 --2- 172.21.15.92:0/1127844495 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1a9c06d160 0x7f1a9c151760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:40.772 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.766+0000 7f1aa2a5a640 1 -- 172.21.15.92:0/1127844495 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1a9c071990 msgr2=0x7f1a9c150ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:40.772 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.766+0000 7f1aa2a5a640 1 --2- 172.21.15.92:0/1127844495 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1a9c071990 0x7f1a9c150ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:40.772 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.766+0000 7f1aa2a5a640 1 -- 172.21.15.92:0/1127844495 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a9c151020 con 0x7f1a9c0aff20 2024-09-11T00:14:40.772 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.766+0000 7f1aa2a5a640 1 --2- 172.21.15.92:0/1127844495 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1a9c0aff20 0x7f1a9c152f30 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f1a94006010 tx=0x7f1a94003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:14:40.773 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.764+0000 7f1027f52640 1 -- start start 2024-09-11T00:14:40.773 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.766+0000 7f1027f52640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1020070f90 0x7f102015dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:40.773 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.766+0000 7f1027f52640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1020071370 0x7f10200af040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:40.773 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.766+0000 7f8e2f356640 1 --2- 172.21.15.92:0/3766424290 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8e280b2410 0x7f8e280b28a0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f8e20005fd0 tx=0x7f8e2002a8d0 comp rx=0 tx=0).stop 2024-09-11T00:14:40.773 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.766+0000 7f8e2f356640 1 -- 172.21.15.92:0/3766424290 shutdown_connections 2024-09-11T00:14:40.774 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.766+0000 7f8e2f356640 1 --2- 172.21.15.92:0/3766424290 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8e280b2410 0x7f8e280b28a0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:40.774 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.766+0000 7f8e2f356640 1 --2- 172.21.15.92:0/3766424290 >> v2:172.21.15.145:3300/0 conn(0x7f8e280d2300 0x7f8e280d2730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:40.774 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.766+0000 7f8e2f356640 1 -- 172.21.15.92:0/3766424290 >> 172.21.15.92:0/3766424290 conn(0x7f8e280d3db0 msgr2=0x7f8e280d4190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:14:40.774 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.766+0000 7f10254ed640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1020071370 0x7f10200af040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:40.774 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.766+0000 7f10254ed640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1020071370 0x7f10200af040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:50554/0 (socket says 172.21.15.92:50554) 2024-09-11T00:14:40.774 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.766+0000 7f1025cee640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1020070f90 0x7f102015dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:40.774 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.766+0000 7f1025cee640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1020070f90 0x7f102015dbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.92:47016/0 (socket says 172.21.15.92:47016) 2024-09-11T00:14:40.774 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.766+0000 7f10254ed640 1 -- 172.21.15.92:0/2109925255 learned_addr learned my addr 172.21.15.92:0/2109925255 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-11T00:14:40.774 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.766+0000 7f1027f52640 1 --2- 172.21.15.92:0/2109925255 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f10200b0bc0 0x7f10200af580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:40.774 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.766+0000 7f1027f52640 1 -- 172.21.15.92:0/2109925255 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f1020071b70 con 0x7f1020071370 2024-09-11T00:14:40.775 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.766+0000 7f1027f52640 1 -- 172.21.15.92:0/2109925255 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f1020162a70 con 0x7f1020070f90 2024-09-11T00:14:40.775 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.766+0000 7f1027f52640 1 -- 172.21.15.92:0/2109925255 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f10200aeba0 con 0x7f10200b0bc0 2024-09-11T00:14:40.775 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.767+0000 7f1a92ffd640 1 -- 172.21.15.92:0/1127844495 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a94047070 con 0x7f1a9c0aff20 2024-09-11T00:14:40.775 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.767+0000 7f9528e1a640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f951c037520 0x7f951c0ce6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:40.775 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.767+0000 7f9528e1a640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f951c0e3d80 0x7f951c0d6f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:40.776 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.767+0000 7fe6c551b640 1 -- 172.21.15.92:0/52824339 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe6c015a850 msgr2=0x7fe6c015ac30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:40.776 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.767+0000 7f10264ef640 1 --2- 172.21.15.92:0/2109925255 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f10200b0bc0 0x7f10200af580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:40.776 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.767+0000 7f9528e1a640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f951c0e4160 0x7f951c17df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:40.777 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.767+0000 7f8e2f356640 1 -- 172.21.15.92:0/3766424290 shutdown_connections 2024-09-11T00:14:40.777 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.767+0000 7f9522ffd640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f951c0e3d80 0x7f951c0d6f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:40.777 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.767+0000 7f9522ffd640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f951c0e3d80 0x7f951c0d6f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.92:47044/0 (socket says 172.21.15.92:47044) 2024-09-11T00:14:40.777 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.767+0000 7f8e2f356640 1 -- 172.21.15.92:0/3766424290 wait complete. 2024-09-11T00:14:40.777 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.767+0000 7fe6c551b640 1 --2- 172.21.15.92:0/52824339 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe6c015a850 0x7fe6c015ac30 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fe6b0005fd0 tx=0x7fe6b002b6c0 comp rx=0 tx=0).stop 2024-09-11T00:14:40.778 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.767+0000 7f9522ffd640 1 -- 172.21.15.92:0/446015784 learned_addr learned my addr 172.21.15.92:0/446015784 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-11T00:14:40.778 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.767+0000 7f9528e1a640 1 -- 172.21.15.92:0/446015784 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f951c036e20 con 0x7f951c037520 2024-09-11T00:14:40.778 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.767+0000 7f9528e1a640 1 -- 172.21.15.92:0/446015784 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f951c036ca0 con 0x7f951c0e3d80 2024-09-11T00:14:40.778 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.767+0000 7f9528e1a640 1 -- 172.21.15.92:0/446015784 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f951c036fa0 con 0x7f951c0e4160 2024-09-11T00:14:40.779 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.765+0000 7f49ad1bc640 1 -- 172.21.15.92:0/2742609781 wait complete. 2024-09-11T00:14:40.779 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.767+0000 7f49ad1bc640 1 Processor -- start 2024-09-11T00:14:40.779 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.767+0000 7f10254ed640 1 -- 172.21.15.92:0/2109925255 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f10200b0bc0 msgr2=0x7f10200af580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:40.779 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.767+0000 7f10254ed640 1 --2- 172.21.15.92:0/2109925255 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f10200b0bc0 0x7f10200af580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:40.779 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.767+0000 7f10254ed640 1 -- 172.21.15.92:0/2109925255 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1020070f90 msgr2=0x7f102015dbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:40.779 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.767+0000 7f10254ed640 1 --2- 172.21.15.92:0/2109925255 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1020070f90 0x7f102015dbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:40.779 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.767+0000 7f10254ed640 1 -- 172.21.15.92:0/2109925255 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10200c7660 con 0x7f1020071370 2024-09-11T00:14:40.780 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.767+0000 7f9523fff640 1 --2- 172.21.15.92:0/446015784 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f951c0e4160 0x7f951c17df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:40.781 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.768+0000 7f49ad1bc640 1 -- start start 2024-09-11T00:14:40.782 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.768+0000 7fe6c551b640 1 -- 172.21.15.92:0/52824339 shutdown_connections 2024-09-11T00:14:40.782 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.768+0000 7fe6c551b640 1 --2- 172.21.15.92:0/52824339 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe6c0074090 0x7fe6c006eea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:40.782 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.768+0000 7fe6c551b640 1 --2- 172.21.15.92:0/52824339 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe6c015a850 0x7fe6c015ac30 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:40.782 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.768+0000 7fe6c551b640 1 -- 172.21.15.92:0/52824339 >> 172.21.15.92:0/52824339 conn(0x7fe6c006ce40 msgr2=0x7fe6c006d250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:14:40.783 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.768+0000 7f95237fe640 1 --2- 172.21.15.92:0/446015784 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f951c037520 0x7f951c0ce6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:40.783 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.768+0000 7f10254ed640 1 --2- 172.21.15.92:0/2109925255 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1020071370 0x7f10200af040 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f101800cbb0 tx=0x7f101800a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:14:40.784 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.768+0000 7fe6c551b640 1 -- 172.21.15.92:0/52824339 shutdown_connections 2024-09-11T00:14:40.784 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.768+0000 7fe6c551b640 1 -- 172.21.15.92:0/52824339 wait complete. 2024-09-11T00:14:40.784 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.768+0000 7f9523fff640 1 -- 172.21.15.92:0/446015784 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f951c0e3d80 msgr2=0x7f951c0d6f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:40.784 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.768+0000 7f9523fff640 1 --2- 172.21.15.92:0/446015784 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f951c0e3d80 0x7f951c0d6f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:40.784 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.768+0000 7f9523fff640 1 -- 172.21.15.92:0/446015784 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f951c037520 msgr2=0x7f951c0ce6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:40.784 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.768+0000 7f9523fff640 1 --2- 172.21.15.92:0/446015784 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f951c037520 0x7f951c0ce6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:40.784 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.768+0000 7f9523fff640 1 -- 172.21.15.92:0/446015784 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f951c17ea70 con 0x7f951c0e4160 2024-09-11T00:14:40.785 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.767+0000 7f1a92ffd640 1 -- 172.21.15.92:0/1127844495 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1a940045c0 con 0x7f1a9c0aff20 2024-09-11T00:14:40.785 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.767+0000 7f1a92ffd640 1 -- 172.21.15.92:0/1127844495 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a94034070 con 0x7f1a9c0aff20 2024-09-11T00:14:40.785 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.767+0000 7f1aa325b640 1 -- 172.21.15.92:0/1127844495 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a9c1560d0 con 0x7f1a9c0aff20 2024-09-11T00:14:40.785 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.767+0000 7f1aa325b640 1 -- 172.21.15.92:0/1127844495 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a9c155830 con 0x7f1a9c0aff20 2024-09-11T00:14:40.785 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.769+0000 7f1aa325b640 1 -- 172.21.15.92:0/1127844495 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1a9c1615d0 con 0x7f1a9c0aff20 2024-09-11T00:14:40.786 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.769+0000 7f49ad1bc640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f49a806fe60 0x7f49a8159a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:40.786 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.769+0000 7f49a6d9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f49a806fe60 0x7f49a8159a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:40.786 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.769+0000 7f6dc77fe640 1 -- 172.21.15.92:0/841217773 <== mon.2 v2:172.21.15.145:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dc00047a0 con 0x7f6dc80c6ad0 2024-09-11T00:14:40.787 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.769+0000 7f49a6d9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f49a806fe60 0x7f49a8159a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:50566/0 (socket says 172.21.15.92:50566) 2024-09-11T00:14:40.787 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.769+0000 7f49a6d9d640 1 -- 172.21.15.92:0/1394318209 learned_addr learned my addr 172.21.15.92:0/1394318209 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-11T00:14:40.787 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.769+0000 7f49ad1bc640 1 --2- 172.21.15.92:0/1394318209 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f49a813cf80 0x7f49a8151c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:40.788 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.769+0000 7f8e2f356640 1 Processor -- start 2024-09-11T00:14:40.788 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.769+0000 7f49ad1bc640 1 --2- 172.21.15.92:0/1394318209 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f49a815b1e0 0x7f49a81534a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:40.789 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.770+0000 7f49ad1bc640 1 -- 172.21.15.92:0/1394318209 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f49a80b3e90 con 0x7f49a806fe60 2024-09-11T00:14:40.789 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.770+0000 7f8e2f356640 1 -- start start 2024-09-11T00:14:40.789 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.770+0000 7f5feffd3640 1 -- 172.21.15.92:0/1835687100 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5fd4004800 msgr2=0x7f5fd4004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:40.790 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.770+0000 7f5feffd3640 1 --2- 172.21.15.92:0/1835687100 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5fd4004800 0x7f5fd4004c80 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f5fd8006e00 tx=0x7f5fd4005830 comp rx=0 tx=0).stop 2024-09-11T00:14:40.790 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.770+0000 7f9523fff640 1 --2- 172.21.15.92:0/446015784 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f951c0e4160 0x7f951c17df00 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f951000c340 tx=0x7f951000c800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:14:40.790 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.770+0000 7f49ad1bc640 1 -- 172.21.15.92:0/1394318209 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f49a80b3d10 con 0x7f49a815b1e0 2024-09-11T00:14:40.790 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.770+0000 7f49ad1bc640 1 -- 172.21.15.92:0/1394318209 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f49a80b4010 con 0x7f49a813cf80 2024-09-11T00:14:40.791 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.770+0000 7f49a759e640 1 --2- 172.21.15.92:0/1394318209 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f49a815b1e0 0x7f49a81534a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:40.791 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.770+0000 7f6dcefd3640 1 -- 172.21.15.92:0/841217773 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6dc80c6ad0 msgr2=0x7f6dc80b18a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:40.791 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.770+0000 7f6dcefd3640 1 --2- 172.21.15.92:0/841217773 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6dc80c6ad0 0x7f6dc80b18a0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f6dc0005fd0 tx=0x7f6dc002b750 comp rx=0 tx=0).stop 2024-09-11T00:14:40.791 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.770+0000 7f6dcefd3640 1 -- 172.21.15.92:0/841217773 shutdown_connections 2024-09-11T00:14:40.791 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.770+0000 7f6dcefd3640 1 --2- 172.21.15.92:0/841217773 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6dc80c6ad0 0x7f6dc80b18a0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:40.792 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.770+0000 7f6dcefd3640 1 --2- 172.21.15.92:0/841217773 >> v2:172.21.15.145:3300/0 conn(0x7f6dc80b0870 0x7f6dc80b0c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:40.792 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.770+0000 7fe6c551b640 1 Processor -- start 2024-09-11T00:14:40.792 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.770+0000 7f6dcefd3640 1 -- 172.21.15.92:0/841217773 >> 172.21.15.92:0/841217773 conn(0x7f6dc8074190 msgr2=0x7f6dc80745a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:14:40.792 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.770+0000 7f6dcefd3640 1 -- 172.21.15.92:0/841217773 shutdown_connections 2024-09-11T00:14:40.793 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.770+0000 7f49a659c640 1 --2- 172.21.15.92:0/1394318209 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f49a813cf80 0x7f49a8151c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:40.793 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.770+0000 7f49a759e640 1 -- 172.21.15.92:0/1394318209 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f49a813cf80 msgr2=0x7f49a8151c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:40.793 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.770+0000 7f49a759e640 1 --2- 172.21.15.92:0/1394318209 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f49a813cf80 0x7f49a8151c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:40.793 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.770+0000 7f49a759e640 1 -- 172.21.15.92:0/1394318209 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f49a806fe60 msgr2=0x7f49a8159a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:40.793 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.770+0000 7f950ffff640 1 -- 172.21.15.92:0/446015784 <== mon.2 v2:172.21.15.145:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9510011790 con 0x7f951c0e4160 2024-09-11T00:14:40.794 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.770+0000 7f10167fc640 1 -- 172.21.15.92:0/2109925255 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1018016020 con 0x7f1020071370 2024-09-11T00:14:40.794 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.770+0000 7f10167fc640 1 -- 172.21.15.92:0/2109925255 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f101800ae30 con 0x7f1020071370 2024-09-11T00:14:40.794 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.770+0000 7f10167fc640 1 -- 172.21.15.92:0/2109925255 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1018012680 con 0x7f1020071370 2024-09-11T00:14:40.794 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.770+0000 7f1027f52640 1 -- 172.21.15.92:0/2109925255 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10200c7940 con 0x7f1020071370 2024-09-11T00:14:40.794 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.770+0000 7f1027f52640 1 -- 172.21.15.92:0/2109925255 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10200c7f00 con 0x7f1020071370 2024-09-11T00:14:40.794 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.770+0000 7f9528e1a640 1 -- 172.21.15.92:0/446015784 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f951c0d6460 con 0x7f951c0e4160 2024-09-11T00:14:40.795 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.771+0000 7fe6c551b640 1 -- start start 2024-09-11T00:14:40.795 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.771+0000 7f950ffff640 1 -- 172.21.15.92:0/446015784 <== mon.2 v2:172.21.15.145:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9510017070 con 0x7f951c0e4160 2024-09-11T00:14:40.795 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.771+0000 7f9528e1a640 1 -- 172.21.15.92:0/446015784 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f951c0d6a20 con 0x7f951c0e4160 2024-09-11T00:14:40.796 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.771+0000 7f49a759e640 1 --2- 172.21.15.92:0/1394318209 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f49a806fe60 0x7f49a8159a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:40.796 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.771+0000 7f49a759e640 1 -- 172.21.15.92:0/1394318209 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49a8152400 con 0x7f49a815b1e0 2024-09-11T00:14:40.796 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.771+0000 7f49a6d9d640 1 --2- 172.21.15.92:0/1394318209 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f49a806fe60 0x7f49a8159a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:14:40.796 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.771+0000 7f49a759e640 1 --2- 172.21.15.92:0/1394318209 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f49a815b1e0 0x7f49a81534a0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f49a0031000 tx=0x7f49a00045e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:14:40.796 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.771+0000 7f49a659c640 1 --2- 172.21.15.92:0/1394318209 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f49a813cf80 0x7f49a8151c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:14:40.797 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.771+0000 7f950ffff640 1 -- 172.21.15.92:0/446015784 <== mon.2 v2:172.21.15.145:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9510011ce0 con 0x7f951c0e4160 2024-09-11T00:14:40.797 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.771+0000 7f8e2f356640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8e280b2410 0x7f8e280cd5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:40.798 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.771+0000 7f8e2f356640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8e280d2300 0x7f8e281f4280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:40.798 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.771+0000 7f8e2d0f2640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8e280b2410 0x7f8e280cd5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:40.798 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.771+0000 7f498f7fe640 1 -- 172.21.15.92:0/1394318209 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49a0007e60 con 0x7f49a815b1e0 2024-09-11T00:14:40.798 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.771+0000 7f498f7fe640 1 -- 172.21.15.92:0/1394318209 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f49a0042070 con 0x7f49a815b1e0 2024-09-11T00:14:40.799 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.771+0000 7f498f7fe640 1 -- 172.21.15.92:0/1394318209 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49a003ebc0 con 0x7f49a815b1e0 2024-09-11T00:14:40.800 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.772+0000 7f8e2d0f2640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8e280b2410 0x7f8e280cd5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3301/0 says I am v2:172.21.15.92:56302/0 (socket says 172.21.15.92:56302) 2024-09-11T00:14:40.800 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.772+0000 7f8e2d0f2640 1 -- 172.21.15.92:0/314022199 learned_addr learned my addr 172.21.15.92:0/314022199 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-11T00:14:40.800 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.772+0000 7f8e2f356640 1 --2- 172.21.15.92:0/314022199 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8e2815dea0 0x7f8e280b5f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:40.801 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.772+0000 7fe6c551b640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe6c0074090 0x7fe6c0142be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:40.801 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.772+0000 7fe6c551b640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe6c015a850 0x7fe6c01f7940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:40.801 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.772+0000 7fe6c551b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe6c015b170 0x7fe6c01f7e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:40.801 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.772+0000 7fe6c551b640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fe6c006e9b0 con 0x7fe6c015b170 2024-09-11T00:14:40.801 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.772+0000 7fe6c551b640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fe6c006e830 con 0x7fe6c0074090 2024-09-11T00:14:40.801 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.772+0000 7fe6c551b640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7fe6c006eb30 con 0x7fe6c015a850 2024-09-11T00:14:40.801 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.770+0000 7f6dcefd3640 1 -- 172.21.15.92:0/841217773 wait complete. 2024-09-11T00:14:40.802 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.772+0000 7f8e2f356640 1 -- 172.21.15.92:0/314022199 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f8e280b6c00 con 0x7f8e280d2300 2024-09-11T00:14:40.802 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.772+0000 7f5feffd3640 1 -- 172.21.15.92:0/1835687100 shutdown_connections 2024-09-11T00:14:40.802 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.772+0000 7f5feffd3640 1 --2- 172.21.15.92:0/1835687100 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5fd4004800 0x7f5fd4004c80 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:40.802 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.772+0000 7f5feffd3640 1 -- 172.21.15.92:0/1835687100 >> 172.21.15.92:0/1835687100 conn(0x7f5fe80af660 msgr2=0x7f5fe80afa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:14:40.803 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.772+0000 7f8e2d8f3640 1 --2- 172.21.15.92:0/314022199 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8e2815dea0 0x7f8e280b5f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:40.803 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.772+0000 7f8e2f356640 1 -- 172.21.15.92:0/314022199 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f8e280b6d80 con 0x7f8e2815dea0 2024-09-11T00:14:40.803 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.772+0000 7f9528e1a640 1 -- 172.21.15.92:0/446015784 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f951c0f28f0 con 0x7f951c0e4160 2024-09-11T00:14:40.803 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.772+0000 7f8e2f356640 1 -- 172.21.15.92:0/314022199 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f8e280b2de0 con 0x7f8e280b2410 2024-09-11T00:14:40.804 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.772+0000 7f6dcefd3640 1 Processor -- start 2024-09-11T00:14:40.804 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.772+0000 7f8e2c8f1640 1 --2- 172.21.15.92:0/314022199 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8e280d2300 0x7f8e281f4280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:40.804 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.772+0000 7f49ad1bc640 1 -- 172.21.15.92:0/1394318209 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f49a81526e0 con 0x7f49a815b1e0 2024-09-11T00:14:40.805 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.772+0000 7f49ad1bc640 1 -- 172.21.15.92:0/1394318209 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49a8152ca0 con 0x7f49a815b1e0 2024-09-11T00:14:40.805 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.770+0000 7f1a92ffd640 1 -- 172.21.15.92:0/1127844495 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f1a94041030 con 0x7f1a9c0aff20 2024-09-11T00:14:40.805 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.772+0000 7f1a92ffd640 1 --2- 172.21.15.92:0/1127844495 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f1a80078040 0x7f1a8007a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:40.805 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.772+0000 7f1a92ffd640 1 -- 172.21.15.92:0/1127844495 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f1a940baeb0 con 0x7f1a9c0aff20 2024-09-11T00:14:40.805 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.773+0000 7fe6c4d1a640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe6c015b170 0x7fe6c01f7e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:40.806 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.773+0000 7fe6c4d1a640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe6c015b170 0x7fe6c01f7e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:50582/0 (socket says 172.21.15.92:50582) 2024-09-11T00:14:40.806 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.773+0000 7fe6c4d1a640 1 -- 172.21.15.92:0/1909943525 learned_addr learned my addr 172.21.15.92:0/1909943525 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-11T00:14:40.806 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.773+0000 7f8e2d0f2640 1 -- 172.21.15.92:0/314022199 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8e2815dea0 msgr2=0x7f8e280b5f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:40.806 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.773+0000 7f8e2d0f2640 1 --2- 172.21.15.92:0/314022199 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8e2815dea0 0x7f8e280b5f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:40.806 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.773+0000 7f8e2d0f2640 1 -- 172.21.15.92:0/314022199 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8e280d2300 msgr2=0x7f8e281f4280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:40.806 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.773+0000 7f8e2d0f2640 1 --2- 172.21.15.92:0/314022199 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8e280d2300 0x7f8e281f4280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:40.807 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.773+0000 7f8e2d0f2640 1 -- 172.21.15.92:0/314022199 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e280cb610 con 0x7f8e280b2410 2024-09-11T00:14:40.807 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.773+0000 7fe6c4d1a640 1 -- 172.21.15.92:0/1909943525 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe6c015a850 msgr2=0x7fe6c01f7940 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-11T00:14:40.807 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.773+0000 7fe6c4d1a640 1 --2- 172.21.15.92:0/1909943525 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe6c015a850 0x7fe6c01f7940 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:40.807 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.773+0000 7fe6c4d1a640 1 -- 172.21.15.92:0/1909943525 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe6c0074090 msgr2=0x7fe6c0142be0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-11T00:14:40.807 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.773+0000 7fe6c4d1a640 1 --2- 172.21.15.92:0/1909943525 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe6c0074090 0x7fe6c0142be0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:40.807 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.773+0000 7fe6c4d1a640 1 -- 172.21.15.92:0/1909943525 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6c01f5300 con 0x7fe6c015b170 2024-09-11T00:14:40.808 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.773+0000 7f8e2c8f1640 1 --2- 172.21.15.92:0/314022199 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8e280d2300 0x7f8e281f4280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:14:40.808 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.773+0000 7f8e2d0f2640 1 --2- 172.21.15.92:0/314022199 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8e280b2410 0x7f8e280cd5b0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f8e2400c410 tx=0x7f8e2400c8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:14:40.809 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.773+0000 7fe6c4d1a640 1 --2- 172.21.15.92:0/1909943525 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe6c015b170 0x7fe6c01f7e80 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fe6b800cd10 tx=0x7fe6b800a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:14:40.809 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.772+0000 7f6dcefd3640 1 -- start start 2024-09-11T00:14:40.809 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.773+0000 7f8e1dffb640 1 -- 172.21.15.92:0/314022199 <== mon.2 v2:172.21.15.145:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e24011850 con 0x7f8e280b2410 2024-09-11T00:14:40.809 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.774+0000 7f8e1dffb640 1 -- 172.21.15.92:0/314022199 <== mon.2 v2:172.21.15.145:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8e24017070 con 0x7f8e280b2410 2024-09-11T00:14:40.810 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.774+0000 7f8e2f356640 1 -- 172.21.15.92:0/314022199 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e280cb8f0 con 0x7f8e280b2410 2024-09-11T00:14:40.810 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.774+0000 7f6dcefd3640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6dc80b0870 0x7f6dc81fb6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:40.810 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.774+0000 7f6dcefd3640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6dc80b5e40 0x7f6dc8156e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:40.810 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.774+0000 7f6dcefd3640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6dc80c6ad0 0x7f6dc81e8e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:40.811 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.774+0000 7f6dcefd3640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f6dc8069600 con 0x7f6dc80b0870 2024-09-11T00:14:40.811 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.774+0000 7f6dcefd3640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f6dc8069480 con 0x7f6dc80b5e40 2024-09-11T00:14:40.811 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.774+0000 7f6dcefd3640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f6dc8069780 con 0x7f6dc80c6ad0 2024-09-11T00:14:40.811 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.774+0000 7f49ad1bc640 1 -- 172.21.15.92:0/1394318209 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f49a806f750 con 0x7f49a815b1e0 2024-09-11T00:14:40.812 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.774+0000 7f6dcd570640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6dc80c6ad0 0x7f6dc81e8e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:40.812 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.774+0000 7f6dcd570640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6dc80c6ad0 0x7f6dc81e8e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3301/0 says I am v2:172.21.15.92:56318/0 (socket says 172.21.15.92:56318) 2024-09-11T00:14:40.812 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.774+0000 7f6dcd570640 1 -- 172.21.15.92:0/1868786211 learned_addr learned my addr 172.21.15.92:0/1868786211 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-11T00:14:40.812 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.774+0000 7f6dccd6f640 1 --2- 172.21.15.92:0/1868786211 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6dc80b0870 0x7f6dc81fb6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:40.812 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.774+0000 7f6dc7fff640 1 --2- 172.21.15.92:0/1868786211 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6dc80b5e40 0x7f6dc8156e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:40.812 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.775+0000 7f6dcd570640 1 -- 172.21.15.92:0/1868786211 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6dc80b5e40 msgr2=0x7f6dc8156e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:40.812 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.775+0000 7f6dcd570640 1 --2- 172.21.15.92:0/1868786211 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6dc80b5e40 0x7f6dc8156e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:40.813 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.775+0000 7f6dcd570640 1 -- 172.21.15.92:0/1868786211 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6dc80b0870 msgr2=0x7f6dc81fb6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:40.813 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.775+0000 7f498f7fe640 1 -- 172.21.15.92:0/1394318209 <== mon.1 v2:172.21.15.145:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f49a0008030 con 0x7f49a815b1e0 2024-09-11T00:14:40.813 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.775+0000 7f6dcd570640 1 --2- 172.21.15.92:0/1868786211 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6dc80b0870 0x7f6dc81fb6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:40.814 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.774+0000 7f8e1dffb640 1 -- 172.21.15.92:0/314022199 <== mon.2 v2:172.21.15.145:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e24011850 con 0x7f8e280b2410 2024-09-11T00:14:40.814 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.775+0000 7f8e2f356640 1 -- 172.21.15.92:0/314022199 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e280cbeb0 con 0x7f8e280b2410 2024-09-11T00:14:40.814 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.775+0000 7f6dcd570640 1 -- 172.21.15.92:0/1868786211 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6dc8158310 con 0x7f6dc80c6ad0 2024-09-11T00:14:40.814 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.775+0000 7f950ffff640 1 -- 172.21.15.92:0/446015784 <== mon.2 v2:172.21.15.145:3301/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f951001c460 con 0x7f951c0e4160 2024-09-11T00:14:40.815 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.775+0000 7f6dccd6f640 1 --2- 172.21.15.92:0/1868786211 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6dc80b0870 0x7f6dc81fb6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:14:40.815 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.775+0000 7f6dcd570640 1 --2- 172.21.15.92:0/1868786211 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6dc80c6ad0 0x7f6dc81e8e70 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f6dc0006010 tx=0x7f6dc0003820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:14:40.815 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.775+0000 7f1aa2259640 1 --2- 172.21.15.92:0/1127844495 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f1a80078040 0x7f1a8007a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:40.815 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.775+0000 7f1027f52640 1 -- 172.21.15.92:0/2109925255 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1008005290 con 0x7f1020071370 2024-09-11T00:14:40.816 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.775+0000 7f8e1dffb640 1 -- 172.21.15.92:0/314022199 <== mon.2 v2:172.21.15.145:3301/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f8e24011b40 con 0x7f8e280b2410 2024-09-11T00:14:40.816 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.776+0000 7f498f7fe640 1 --2- 172.21.15.92:0/1394318209 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f4994078040 0x7f499407a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:40.816 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.776+0000 7f498f7fe640 1 -- 172.21.15.92:0/1394318209 <== mon.1 v2:172.21.15.145:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f49a00c2c60 con 0x7f49a815b1e0 2024-09-11T00:14:40.816 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.776+0000 7f49a6d9d640 1 --2- 172.21.15.92:0/1394318209 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f4994078040 0x7f499407a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:40.817 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.776+0000 7f950ffff640 1 --2- 172.21.15.92:0/446015784 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f9508078040 0x7f950807a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:40.817 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.776+0000 7f5feffd3640 1 -- 172.21.15.92:0/1835687100 shutdown_connections 2024-09-11T00:14:40.817 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.776+0000 7f5feffd3640 1 -- 172.21.15.92:0/1835687100 wait complete. 2024-09-11T00:14:40.817 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.776+0000 7f8e2f356640 1 -- 172.21.15.92:0/314022199 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8e280d02e0 con 0x7f8e280b2410 2024-09-11T00:14:40.817 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.776+0000 7f8e1dffb640 1 --2- 172.21.15.92:0/314022199 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f8e0c078170 0x7f8e0c07a630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:40.818 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.776+0000 7f95237fe640 1 --2- 172.21.15.92:0/446015784 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f9508078040 0x7f950807a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:40.818 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.776+0000 7f8e2c8f1640 1 --2- 172.21.15.92:0/314022199 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f8e0c078170 0x7f8e0c07a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:40.818 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.776+0000 7f49a6d9d640 1 --2- 172.21.15.92:0/1394318209 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f4994078040 0x7f499407a500 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f49980046b0 tx=0x7f4998007f50 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:14:40.819 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.776+0000 7f8e1dffb640 1 -- 172.21.15.92:0/314022199 <== mon.2 v2:172.21.15.145:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f8e24011e60 con 0x7f8e280b2410 2024-09-11T00:14:40.819 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.776+0000 7f950ffff640 1 -- 172.21.15.92:0/446015784 <== mon.2 v2:172.21.15.145:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f9510099c80 con 0x7f951c0e4160 2024-09-11T00:14:40.819 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.777+0000 7f95237fe640 1 --2- 172.21.15.92:0/446015784 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f9508078040 0x7f950807a500 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f951c00e5c0 tx=0x7f9524066930 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:14:40.819 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.777+0000 7f1aa2259640 1 --2- 172.21.15.92:0/1127844495 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f1a80078040 0x7f1a8007a500 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f1a98004f60 tx=0x7f1a98007e30 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:14:40.820 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.777+0000 7f8e2c8f1640 1 --2- 172.21.15.92:0/314022199 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f8e0c078170 0x7f8e0c07a630 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f8e2815cf80 tx=0x7f8e18005f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:14:40.821 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.777+0000 7f5feffd3640 1 Processor -- start 2024-09-11T00:14:40.821 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.777+0000 7f5feffd3640 1 -- start start 2024-09-11T00:14:40.821 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.778+0000 7f1a92ffd640 1 -- 172.21.15.92:0/1127844495 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f1a9403f070 con 0x7f1a9c0aff20 2024-09-11T00:14:40.822 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.778+0000 7f5feffd3640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f5fd4004800 0x7f5fe813e930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:40.823 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.778+0000 7f5feffd3640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5fe813ee70 0x7f5fe80aeaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:40.823 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.778+0000 7f5feffd3640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5fe80cd420 0x7f5fe8073990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:40.823 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.778+0000 7f5feffd3640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f5fe8162360 con 0x7f5fe813ee70 2024-09-11T00:14:40.823 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.778+0000 7f5feffd3640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f5fe81621e0 con 0x7f5fe80cd420 2024-09-11T00:14:40.823 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.778+0000 7f5feffd3640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f5fe81624e0 con 0x7f5fd4004800 2024-09-11T00:14:40.823 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.778+0000 7f5fed56e640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5fe813ee70 0x7f5fe80aeaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:40.823 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.778+0000 7f5fed56e640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5fe813ee70 0x7f5fe80aeaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:50610/0 (socket says 172.21.15.92:50610) 2024-09-11T00:14:40.823 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.778+0000 7f5fed56e640 1 -- 172.21.15.92:0/2814677507 learned_addr learned my addr 172.21.15.92:0/2814677507 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-11T00:14:40.824 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.778+0000 7f5fedd6f640 1 --2- 172.21.15.92:0/2814677507 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f5fd4004800 0x7f5fe813e930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:40.824 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.778+0000 7f5fee570640 1 --2- 172.21.15.92:0/2814677507 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5fe80cd420 0x7f5fe8073990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:40.824 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.779+0000 7f5fed56e640 1 -- 172.21.15.92:0/2814677507 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f5fd4004800 msgr2=0x7f5fe813e930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:40.824 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.779+0000 7f5fed56e640 1 --2- 172.21.15.92:0/2814677507 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f5fd4004800 0x7f5fe813e930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:40.824 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.779+0000 7f5fed56e640 1 -- 172.21.15.92:0/2814677507 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5fe80cd420 msgr2=0x7f5fe8073990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:40.824 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.779+0000 7f5fed56e640 1 --2- 172.21.15.92:0/2814677507 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5fe80cd420 0x7f5fe8073990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:40.824 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.779+0000 7f5fed56e640 1 -- 172.21.15.92:0/2814677507 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5fe81f9270 con 0x7f5fe813ee70 2024-09-11T00:14:40.824 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.779+0000 7f5fed56e640 1 --2- 172.21.15.92:0/2814677507 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5fe813ee70 0x7f5fe80aeaf0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f5fd8006f20 tx=0x7f5fd8006570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:14:40.825 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.779+0000 7fe6bcff9640 1 -- 172.21.15.92:0/1909943525 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6b800f450 con 0x7fe6c015b170 2024-09-11T00:14:40.825 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.779+0000 7fe6c551b640 1 -- 172.21.15.92:0/1909943525 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe6c01e7400 con 0x7fe6c015b170 2024-09-11T00:14:40.825 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.779+0000 7fe6c551b640 1 -- 172.21.15.92:0/1909943525 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6c01e76a0 con 0x7fe6c015b170 2024-09-11T00:14:40.825 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.779+0000 7fe6bcff9640 1 -- 172.21.15.92:0/1909943525 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe6b800f6e0 con 0x7fe6c015b170 2024-09-11T00:14:40.825 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.779+0000 7fe6bcff9640 1 -- 172.21.15.92:0/1909943525 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6b800faf0 con 0x7fe6c015b170 2024-09-11T00:14:40.825 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.780+0000 7f10167fc640 1 -- 172.21.15.92:0/2109925255 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f1018025480 con 0x7f1020071370 2024-09-11T00:14:40.826 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.780+0000 7f6dc57fa640 1 -- 172.21.15.92:0/1868786211 <== mon.2 v2:172.21.15.145:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dc003f070 con 0x7f6dc80c6ad0 2024-09-11T00:14:40.826 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.780+0000 7f10167fc640 1 --2- 172.21.15.92:0/2109925255 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f1004078040 0x7f100407a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:40.826 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.780+0000 7f10167fc640 1 -- 172.21.15.92:0/2109925255 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f101809ac60 con 0x7f1020071370 2024-09-11T00:14:40.827 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.781+0000 7f6dcefd3640 1 -- 172.21.15.92:0/1868786211 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6dc81585f0 con 0x7f6dc80c6ad0 2024-09-11T00:14:40.827 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.781+0000 7fe6c551b640 1 -- 172.21.15.92:0/1909943525 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe6a0005290 con 0x7fe6c015b170 2024-09-11T00:14:40.827 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.781+0000 7f6dcefd3640 1 -- 172.21.15.92:0/1868786211 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f6dc8158bb0 con 0x7f6dc80c6ad0 2024-09-11T00:14:40.827 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.781+0000 7f1025cee640 1 --2- 172.21.15.92:0/2109925255 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f1004078040 0x7f100407a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:40.828 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.781+0000 7f950ffff640 1 -- 172.21.15.92:0/446015784 <== mon.2 v2:172.21.15.145:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f95100a0080 con 0x7f951c0e4160 2024-09-11T00:14:40.828 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.781+0000 7f498f7fe640 1 -- 172.21.15.92:0/1394318209 <== mon.1 v2:172.21.15.145:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f49a008ae40 con 0x7f49a815b1e0 2024-09-11T00:14:40.828 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.782+0000 7f6dcefd3640 1 -- 172.21.15.92:0/1868786211 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6dc806e3a0 con 0x7f6dc80c6ad0 2024-09-11T00:14:40.829 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.782+0000 7f1025cee640 1 --2- 172.21.15.92:0/2109925255 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f1004078040 0x7f100407a500 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f1010034000 tx=0x7f10100046c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:14:40.829 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.785+0000 7f6dc57fa640 1 -- 172.21.15.92:0/1868786211 <== mon.2 v2:172.21.15.145:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6dc0003e20 con 0x7f6dc80c6ad0 2024-09-11T00:14:40.829 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.785+0000 7f6dc57fa640 1 -- 172.21.15.92:0/1868786211 <== mon.2 v2:172.21.15.145:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dc0049060 con 0x7f6dc80c6ad0 2024-09-11T00:14:40.829 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.785+0000 7f8e1dffb640 1 -- 172.21.15.92:0/314022199 <== mon.2 v2:172.21.15.145:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f8e240613c0 con 0x7f8e280b2410 2024-09-11T00:14:40.830 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.786+0000 7f10167fc640 1 -- 172.21.15.92:0/2109925255 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f1018020020 con 0x7f1020071370 2024-09-11T00:14:40.830 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.787+0000 7f6dc57fa640 1 -- 172.21.15.92:0/1868786211 <== mon.2 v2:172.21.15.145:3301/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f6dc000b040 con 0x7f6dc80c6ad0 2024-09-11T00:14:40.830 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.787+0000 7f6dc57fa640 1 --2- 172.21.15.92:0/1868786211 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f6db4077f70 0x7f6db407a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:40.830 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.788+0000 7f6dc57fa640 1 -- 172.21.15.92:0/1868786211 <== mon.2 v2:172.21.15.145:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f6dc00bb290 con 0x7f6dc80c6ad0 2024-09-11T00:14:40.831 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.786+0000 7f5fde7fc640 1 -- 172.21.15.92:0/2814677507 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fd8004bd0 con 0x7f5fe813ee70 2024-09-11T00:14:40.831 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.789+0000 7fe6bcff9640 1 -- 172.21.15.92:0/1909943525 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fe6b800fc90 con 0x7fe6c015b170 2024-09-11T00:14:40.831 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.789+0000 7fe6bcff9640 1 --2- 172.21.15.92:0/1909943525 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7fe6ac078040 0x7fe6ac07a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:40.831 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.790+0000 7fe6bffff640 1 --2- 172.21.15.92:0/1909943525 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7fe6ac078040 0x7fe6ac07a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:40.832 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.790+0000 7f6dccd6f640 1 --2- 172.21.15.92:0/1868786211 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f6db4077f70 0x7f6db407a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:40.832 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.786+0000 7f5feffd3640 1 -- 172.21.15.92:0/2814677507 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5fe81f9550 con 0x7f5fe813ee70 2024-09-11T00:14:40.832 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.786+0000 7f5feffd3640 1 -- 172.21.15.92:0/2814677507 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5fe81f9df0 con 0x7f5fe813ee70 2024-09-11T00:14:40.832 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.788+0000 7f5fde7fc640 1 -- 172.21.15.92:0/2814677507 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5fd8030410 con 0x7f5fe813ee70 2024-09-11T00:14:40.832 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.788+0000 7f5fde7fc640 1 -- 172.21.15.92:0/2814677507 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fd8006080 con 0x7f5fe813ee70 2024-09-11T00:14:40.832 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.789+0000 7f5fde7fc640 1 -- 172.21.15.92:0/2814677507 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f5fd8030800 con 0x7f5fe813ee70 2024-09-11T00:14:40.832 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.790+0000 7f5fde7fc640 1 --2- 172.21.15.92:0/2814677507 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f5fcc077f70 0x7f5fcc07a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:40.833 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.790+0000 7fe6bcff9640 1 -- 172.21.15.92:0/1909943525 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fe6b809ad70 con 0x7fe6c015b170 2024-09-11T00:14:40.833 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.790+0000 7f5fedd6f640 1 --2- 172.21.15.92:0/2814677507 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f5fcc077f70 0x7f5fcc07a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:40.833 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.790+0000 7fe6bffff640 1 --2- 172.21.15.92:0/1909943525 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7fe6ac078040 0x7fe6ac07a500 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fe6b0034000 tx=0x7fe6b00046c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:14:40.834 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.791+0000 7f6dc57fa640 1 -- 172.21.15.92:0/1868786211 <== mon.2 v2:172.21.15.145:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f6dc806e3a0 con 0x7f6dc80c6ad0 2024-09-11T00:14:40.834 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.791+0000 7f6dccd6f640 1 --2- 172.21.15.92:0/1868786211 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f6db4077f70 0x7f6db407a430 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f6dc80cd850 tx=0x7f6dbc005f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:14:40.834 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.791+0000 7f5feffd3640 1 -- 172.21.15.92:0/2814677507 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5fd0005290 con 0x7f5fe813ee70 2024-09-11T00:14:40.834 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.791+0000 7f5fedd6f640 1 --2- 172.21.15.92:0/2814677507 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f5fcc077f70 0x7f5fcc07a430 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f5fe80cf200 tx=0x7f5fe0011040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:14:40.834 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.796+0000 7f5fde7fc640 1 -- 172.21.15.92:0/2814677507 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f5fd80b8b80 con 0x7f5fe813ee70 2024-09-11T00:14:40.835 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.796+0000 7fe6bcff9640 1 -- 172.21.15.92:0/1909943525 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fe6b8014030 con 0x7fe6c015b170 2024-09-11T00:14:40.835 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:40.805+0000 7f5fde7fc640 1 -- 172.21.15.92:0/2814677507 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f5fd803e030 con 0x7f5fe813ee70 2024-09-11T00:14:41.191 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:41.189+0000 7f9528e1a640 1 -- 172.21.15.92:0/446015784 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f951c0387a0 con 0x7f951c0e4160 2024-09-11T00:14:41.192 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:41.190+0000 7f950ffff640 1 -- 172.21.15.92:0/446015784 <== mon.2 v2:172.21.15.145:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f95100624b0 con 0x7f951c0e4160 2024-09-11T00:14:41.192 INFO:teuthology.orchestra.run.smithi092.stdout:64424509449 2024-09-11T00:14:41.196 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:41.194+0000 7f950dffb640 1 -- 172.21.15.92:0/446015784 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f9508078040 msgr2=0x7f950807a500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:41.196 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:41.194+0000 7f950dffb640 1 --2- 172.21.15.92:0/446015784 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f9508078040 0x7f950807a500 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f951c00e5c0 tx=0x7f9524066930 comp rx=0 tx=0).stop 2024-09-11T00:14:41.196 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:41.194+0000 7f950dffb640 1 -- 172.21.15.92:0/446015784 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f951c0e4160 msgr2=0x7f951c17df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:41.197 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:41.194+0000 7f1aa325b640 1 -- 172.21.15.92:0/1127844495 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f1a9c0b5dc0 con 0x7f1a9c0aff20 2024-09-11T00:14:41.197 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:41.194+0000 7f950dffb640 1 --2- 172.21.15.92:0/446015784 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f951c0e4160 0x7f951c17df00 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f951000c340 tx=0x7f951000c800 comp rx=0 tx=0).stop 2024-09-11T00:14:41.198 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:41.195+0000 7f950dffb640 1 -- 172.21.15.92:0/446015784 shutdown_connections 2024-09-11T00:14:41.198 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:41.195+0000 7f950dffb640 1 --2- 172.21.15.92:0/446015784 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f9508078040 0x7f950807a500 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:41.198 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:41.195+0000 7f950dffb640 1 --2- 172.21.15.92:0/446015784 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f951c0e4160 0x7f951c17df00 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:41.198 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:41.195+0000 7f950dffb640 1 --2- 172.21.15.92:0/446015784 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f951c0e3d80 0x7f951c0d6f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:41.198 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:41.195+0000 7f950dffb640 1 --2- 172.21.15.92:0/446015784 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f951c037520 0x7f951c0ce6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:41.198 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:41.195+0000 7f1a92ffd640 1 -- 172.21.15.92:0/1127844495 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f1a94083000 con 0x7f1a9c0aff20 2024-09-11T00:14:41.198 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:41.195+0000 7f950dffb640 1 -- 172.21.15.92:0/446015784 >> 172.21.15.92:0/446015784 conn(0x7f951c056710 msgr2=0x7f951c035d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:14:41.199 INFO:teuthology.orchestra.run.smithi092.stdout:64424509449 2024-09-11T00:14:41.199 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:41.195+0000 7f950dffb640 1 -- 172.21.15.92:0/446015784 shutdown_connections 2024-09-11T00:14:41.199 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:41.195+0000 7f950dffb640 1 -- 172.21.15.92:0/446015784 wait complete. 2024-09-11T00:14:41.200 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:41.198+0000 7f1a90ff9640 1 -- 172.21.15.92:0/1127844495 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f1a80078040 msgr2=0x7f1a8007a500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:41.200 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:41.198+0000 7f1a90ff9640 1 --2- 172.21.15.92:0/1127844495 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f1a80078040 0x7f1a8007a500 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f1a98004f60 tx=0x7f1a98007e30 comp rx=0 tx=0).stop 2024-09-11T00:14:41.200 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:41.199+0000 7f1a90ff9640 1 -- 172.21.15.92:0/1127844495 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1a9c0aff20 msgr2=0x7f1a9c152f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:41.200 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:41.199+0000 7f1a90ff9640 1 --2- 172.21.15.92:0/1127844495 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1a9c0aff20 0x7f1a9c152f30 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f1a94006010 tx=0x7f1a94003f10 comp rx=0 tx=0).stop 2024-09-11T00:14:41.201 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:41.199+0000 7f1a90ff9640 1 -- 172.21.15.92:0/1127844495 shutdown_connections 2024-09-11T00:14:41.201 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:41.199+0000 7f1a90ff9640 1 --2- 172.21.15.92:0/1127844495 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f1a80078040 0x7f1a8007a500 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:41.201 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:41.199+0000 7f1a90ff9640 1 --2- 172.21.15.92:0/1127844495 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1a9c0aff20 0x7f1a9c152f30 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:41.201 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:41.199+0000 7f1a90ff9640 1 --2- 172.21.15.92:0/1127844495 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1a9c071990 0x7f1a9c150ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:41.202 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:41.199+0000 7f1a90ff9640 1 --2- 172.21.15.92:0/1127844495 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1a9c06d160 0x7f1a9c151760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:41.202 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:41.199+0000 7f1a90ff9640 1 -- 172.21.15.92:0/1127844495 >> 172.21.15.92:0/1127844495 conn(0x7f1a9c0d0970 msgr2=0x7f1a9c0cfd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:14:41.202 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:41.200+0000 7f1a90ff9640 1 -- 172.21.15.92:0/1127844495 shutdown_connections 2024-09-11T00:14:41.202 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:41.200+0000 7f1a90ff9640 1 -- 172.21.15.92:0/1127844495 wait complete. 2024-09-11T00:14:41.205 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:41.204+0000 7f49ad1bc640 1 -- 172.21.15.92:0/1394318209 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f49a80cd660 con 0x7f49a815b1e0 2024-09-11T00:14:41.206 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:41.204+0000 7f498f7fe640 1 -- 172.21.15.92:0/1394318209 <== mon.1 v2:172.21.15.145:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f49a008f870 con 0x7f49a815b1e0 2024-09-11T00:14:41.206 INFO:teuthology.orchestra.run.smithi092.stdout:60129542153 2024-09-11T00:14:41.210 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:41.208+0000 7f498d7fa640 1 -- 172.21.15.92:0/1394318209 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f4994078040 msgr2=0x7f499407a500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:41.210 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:41.208+0000 7f498d7fa640 1 --2- 172.21.15.92:0/1394318209 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f4994078040 0x7f499407a500 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f49980046b0 tx=0x7f4998007f50 comp rx=0 tx=0).stop 2024-09-11T00:14:41.210 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:41.208+0000 7f498d7fa640 1 -- 172.21.15.92:0/1394318209 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f49a815b1e0 msgr2=0x7f49a81534a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:41.210 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:41.208+0000 7f1027f52640 1 -- 172.21.15.92:0/2109925255 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f1008005850 con 0x7f1020071370 2024-09-11T00:14:41.211 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:41.209+0000 7f498d7fa640 1 --2- 172.21.15.92:0/1394318209 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f49a815b1e0 0x7f49a81534a0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f49a0031000 tx=0x7f49a00045e0 comp rx=0 tx=0).stop 2024-09-11T00:14:41.211 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:41.209+0000 7f498d7fa640 1 -- 172.21.15.92:0/1394318209 shutdown_connections 2024-09-11T00:14:41.211 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:41.209+0000 7f498d7fa640 1 --2- 172.21.15.92:0/1394318209 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f4994078040 0x7f499407a500 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:41.211 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:41.209+0000 7f498d7fa640 1 --2- 172.21.15.92:0/1394318209 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f49a815b1e0 0x7f49a81534a0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:41.212 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:41.209+0000 7f498d7fa640 1 --2- 172.21.15.92:0/1394318209 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f49a813cf80 0x7f49a8151c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:41.212 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:41.209+0000 7f498d7fa640 1 --2- 172.21.15.92:0/1394318209 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f49a806fe60 0x7f49a8159a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:41.212 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:41.209+0000 7f10167fc640 1 -- 172.21.15.92:0/2109925255 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f1018062db0 con 0x7f1020071370 2024-09-11T00:14:41.212 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:41.209+0000 7f498d7fa640 1 -- 172.21.15.92:0/1394318209 >> 172.21.15.92:0/1394318209 conn(0x7f49a80b1760 msgr2=0x7f49a80b0ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:14:41.212 INFO:teuthology.orchestra.run.smithi092.stdout:64424509448 2024-09-11T00:14:41.213 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:41.209+0000 7f498d7fa640 1 -- 172.21.15.92:0/1394318209 shutdown_connections 2024-09-11T00:14:41.213 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:41.209+0000 7f498d7fa640 1 -- 172.21.15.92:0/1394318209 wait complete. 2024-09-11T00:14:41.213 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:41.211+0000 7f6dcefd3640 1 -- 172.21.15.92:0/1868786211 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f6dc80c5ac0 con 0x7f6dc80c6ad0 2024-09-11T00:14:41.213 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:41.212+0000 7f6dc57fa640 1 -- 172.21.15.92:0/1868786211 <== mon.2 v2:172.21.15.145:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f6dc00833e0 con 0x7f6dc80c6ad0 2024-09-11T00:14:41.214 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:41.212+0000 7f8e2f356640 1 -- 172.21.15.92:0/314022199 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f8e28075e70 con 0x7f8e280b2410 2024-09-11T00:14:41.214 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:41.212+0000 7f5feffd3640 1 -- 172.21.15.92:0/2814677507 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f5fd0005580 con 0x7f5fe813ee70 2024-09-11T00:14:41.214 INFO:teuthology.orchestra.run.smithi092.stdout:64424509450 2024-09-11T00:14:41.214 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:41.213+0000 7f8e1dffb640 1 -- 172.21.15.92:0/314022199 <== mon.2 v2:172.21.15.145:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f8e24065df0 con 0x7f8e280b2410 2024-09-11T00:14:41.215 INFO:teuthology.orchestra.run.smithi092.stdout:55834574857 2024-09-11T00:14:41.216 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509450 got 64424509449 for osd.5 2024-09-11T00:14:41.216 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:41.213+0000 7f5fde7fc640 1 -- 172.21.15.92:0/2814677507 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f5fd80871e0 con 0x7f5fe813ee70 2024-09-11T00:14:41.216 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:41.213+0000 7f1027f52640 1 -- 172.21.15.92:0/2109925255 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f1004078040 msgr2=0x7f100407a500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:41.216 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:41.213+0000 7f1027f52640 1 --2- 172.21.15.92:0/2109925255 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f1004078040 0x7f100407a500 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f1010034000 tx=0x7f10100046c0 comp rx=0 tx=0).stop 2024-09-11T00:14:41.216 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:41.213+0000 7f1027f52640 1 -- 172.21.15.92:0/2109925255 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1020071370 msgr2=0x7f10200af040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:41.216 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:41.213+0000 7f1027f52640 1 --2- 172.21.15.92:0/2109925255 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1020071370 0x7f10200af040 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f101800cbb0 tx=0x7f101800a430 comp rx=0 tx=0).stop 2024-09-11T00:14:41.217 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:41.213+0000 7f1027f52640 1 -- 172.21.15.92:0/2109925255 shutdown_connections 2024-09-11T00:14:41.217 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:41.213+0000 7f1027f52640 1 --2- 172.21.15.92:0/2109925255 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f1004078040 0x7f100407a500 secure :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f1010034000 tx=0x7f10100046c0 comp rx=0 tx=0).stop 2024-09-11T00:14:41.217 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:41.213+0000 7f1027f52640 1 --2- 172.21.15.92:0/2109925255 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f10200b0bc0 0x7f10200af580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:41.217 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:41.213+0000 7f1027f52640 1 --2- 172.21.15.92:0/2109925255 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1020071370 0x7f10200af040 secure :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f101800cbb0 tx=0x7f101800a430 comp rx=0 tx=0).stop 2024-09-11T00:14:41.217 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:41.213+0000 7f1027f52640 1 --2- 172.21.15.92:0/2109925255 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1020070f90 0x7f102015dbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:41.217 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:41.213+0000 7f1027f52640 1 -- 172.21.15.92:0/2109925255 >> 172.21.15.92:0/2109925255 conn(0x7f10200d1d10 msgr2=0x7f102006db60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:14:41.217 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:41.213+0000 7f1027f52640 1 -- 172.21.15.92:0/2109925255 shutdown_connections 2024-09-11T00:14:41.217 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:41.213+0000 7f1027f52640 1 -- 172.21.15.92:0/2109925255 wait complete. 2024-09-11T00:14:41.217 INFO:teuthology.orchestra.run.smithi092.stdout:64424509448 2024-09-11T00:14:41.218 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:41.215+0000 7fe6c551b640 1 -- 172.21.15.92:0/1909943525 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7fe6a0005850 con 0x7fe6c015b170 2024-09-11T00:14:41.218 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:41.216+0000 7fe6bcff9640 1 -- 172.21.15.92:0/1909943525 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fe6b80635a0 con 0x7fe6c015b170 2024-09-11T00:14:41.218 INFO:teuthology.orchestra.run.smithi092.stdout:64424509449 2024-09-11T00:14:41.219 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:41.216+0000 7f6dcefd3640 1 -- 172.21.15.92:0/1868786211 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f6db4077f70 msgr2=0x7f6db407a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:41.219 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:41.216+0000 7f6dcefd3640 1 --2- 172.21.15.92:0/1868786211 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f6db4077f70 0x7f6db407a430 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f6dc80cd850 tx=0x7f6dbc005f90 comp rx=0 tx=0).stop 2024-09-11T00:14:41.219 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:41.216+0000 7f6dcefd3640 1 -- 172.21.15.92:0/1868786211 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6dc80c6ad0 msgr2=0x7f6dc81e8e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:41.219 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:41.216+0000 7f6dcefd3640 1 --2- 172.21.15.92:0/1868786211 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6dc80c6ad0 0x7f6dc81e8e70 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f6dc0006010 tx=0x7f6dc0003820 comp rx=0 tx=0).stop 2024-09-11T00:14:41.219 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:41.216+0000 7f6dcefd3640 1 -- 172.21.15.92:0/1868786211 shutdown_connections 2024-09-11T00:14:41.220 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:41.216+0000 7f6dcefd3640 1 --2- 172.21.15.92:0/1868786211 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f6db4077f70 0x7f6db407a430 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:41.220 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:41.216+0000 7f6dcefd3640 1 --2- 172.21.15.92:0/1868786211 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6dc80c6ad0 0x7f6dc81e8e70 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:41.220 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:41.216+0000 7f6dcefd3640 1 --2- 172.21.15.92:0/1868786211 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6dc80b5e40 0x7f6dc8156e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:41.220 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:41.217+0000 7f6dcefd3640 1 --2- 172.21.15.92:0/1868786211 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6dc80b0870 0x7f6dc81fb6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:41.220 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:41.217+0000 7f6dcefd3640 1 -- 172.21.15.92:0/1868786211 >> 172.21.15.92:0/1868786211 conn(0x7f6dc8074190 msgr2=0x7f6dc80ad190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:14:41.220 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:41.217+0000 7f5feffd3640 1 -- 172.21.15.92:0/2814677507 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f5fcc077f70 msgr2=0x7f5fcc07a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:41.220 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:41.217+0000 7f5feffd3640 1 --2- 172.21.15.92:0/2814677507 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f5fcc077f70 0x7f5fcc07a430 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f5fe80cf200 tx=0x7f5fe0011040 comp rx=0 tx=0).stop 2024-09-11T00:14:41.221 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:41.217+0000 7f5feffd3640 1 -- 172.21.15.92:0/2814677507 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5fe813ee70 msgr2=0x7f5fe80aeaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:41.221 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:41.217+0000 7f5feffd3640 1 --2- 172.21.15.92:0/2814677507 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5fe813ee70 0x7f5fe80aeaf0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f5fd8006f20 tx=0x7f5fd8006570 comp rx=0 tx=0).stop 2024-09-11T00:14:41.221 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:41.217+0000 7f8e2f356640 1 -- 172.21.15.92:0/314022199 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f8e0c078170 msgr2=0x7f8e0c07a630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:41.221 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:41.217+0000 7f6dcefd3640 1 -- 172.21.15.92:0/1868786211 shutdown_connections 2024-09-11T00:14:41.221 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:41.217+0000 7f8e2f356640 1 --2- 172.21.15.92:0/314022199 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f8e0c078170 0x7f8e0c07a630 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f8e2815cf80 tx=0x7f8e18005f90 comp rx=0 tx=0).stop 2024-09-11T00:14:41.222 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:41.217+0000 7f5feffd3640 1 -- 172.21.15.92:0/2814677507 shutdown_connections 2024-09-11T00:14:41.222 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:41.217+0000 7f8e2f356640 1 -- 172.21.15.92:0/314022199 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8e280b2410 msgr2=0x7f8e280cd5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:41.222 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:41.217+0000 7f6dcefd3640 1 -- 172.21.15.92:0/1868786211 wait complete. 2024-09-11T00:14:41.222 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:41.217+0000 7f5feffd3640 1 --2- 172.21.15.92:0/2814677507 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f5fcc077f70 0x7f5fcc07a430 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:41.223 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:41.217+0000 7f5feffd3640 1 --2- 172.21.15.92:0/2814677507 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5fe80cd420 0x7f5fe8073990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:41.223 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:41.217+0000 7f8e2f356640 1 --2- 172.21.15.92:0/314022199 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8e280b2410 0x7f8e280cd5b0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f8e2400c410 tx=0x7f8e2400c8d0 comp rx=0 tx=0).stop 2024-09-11T00:14:41.223 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:41.217+0000 7f5feffd3640 1 --2- 172.21.15.92:0/2814677507 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5fe813ee70 0x7f5fe80aeaf0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:41.223 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:41.217+0000 7f5feffd3640 1 --2- 172.21.15.92:0/2814677507 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f5fd4004800 0x7f5fe813e930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:41.223 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:41.217+0000 7f8e2f356640 1 -- 172.21.15.92:0/314022199 shutdown_connections 2024-09-11T00:14:41.224 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:41.217+0000 7f5feffd3640 1 -- 172.21.15.92:0/2814677507 >> 172.21.15.92:0/2814677507 conn(0x7f5fe80af660 msgr2=0x7f5fe815f730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:14:41.224 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:41.217+0000 7f8e2f356640 1 --2- 172.21.15.92:0/314022199 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f8e0c078170 0x7f8e0c07a630 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:41.224 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:41.217+0000 7f8e2f356640 1 --2- 172.21.15.92:0/314022199 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8e2815dea0 0x7f8e280b5f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:41.224 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:41.217+0000 7f8e2f356640 1 --2- 172.21.15.92:0/314022199 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8e280d2300 0x7f8e281f4280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:41.225 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:41.217+0000 7f8e2f356640 1 --2- 172.21.15.92:0/314022199 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8e280b2410 0x7f8e280cd5b0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:41.225 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:41.217+0000 7f8e2f356640 1 -- 172.21.15.92:0/314022199 >> 172.21.15.92:0/314022199 conn(0x7f8e280d3db0 msgr2=0x7f8e280d4190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:14:41.225 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:41.217+0000 7f8e2f356640 1 -- 172.21.15.92:0/314022199 shutdown_connections 2024-09-11T00:14:41.225 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:41.217+0000 7f8e2f356640 1 -- 172.21.15.92:0/314022199 wait complete. 2024-09-11T00:14:41.225 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:41.217+0000 7f5feffd3640 1 -- 172.21.15.92:0/2814677507 shutdown_connections 2024-09-11T00:14:41.225 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:41.217+0000 7f5feffd3640 1 -- 172.21.15.92:0/2814677507 wait complete. 2024-09-11T00:14:41.226 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509450 got 64424509449 for osd.7 2024-09-11T00:14:41.227 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:41.219+0000 7fe6c551b640 1 -- 172.21.15.92:0/1909943525 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7fe6ac078040 msgr2=0x7fe6ac07a500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:41.227 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:41.219+0000 7fe6c551b640 1 --2- 172.21.15.92:0/1909943525 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7fe6ac078040 0x7fe6ac07a500 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fe6b0034000 tx=0x7fe6b00046c0 comp rx=0 tx=0).stop 2024-09-11T00:14:41.227 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:41.219+0000 7fe6c551b640 1 -- 172.21.15.92:0/1909943525 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe6c015b170 msgr2=0x7fe6c01f7e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:41.227 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:41.219+0000 7fe6c551b640 1 --2- 172.21.15.92:0/1909943525 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe6c015b170 0x7fe6c01f7e80 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fe6b800cd10 tx=0x7fe6b800a620 comp rx=0 tx=0).stop 2024-09-11T00:14:41.227 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:41.219+0000 7fe6c551b640 1 -- 172.21.15.92:0/1909943525 shutdown_connections 2024-09-11T00:14:41.227 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:41.219+0000 7fe6c551b640 1 --2- 172.21.15.92:0/1909943525 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7fe6ac078040 0x7fe6ac07a500 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:41.227 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:41.220+0000 7fe6c551b640 1 --2- 172.21.15.92:0/1909943525 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe6c015b170 0x7fe6c01f7e80 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:41.227 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:41.220+0000 7fe6c551b640 1 --2- 172.21.15.92:0/1909943525 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe6c015a850 0x7fe6c01f7940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:41.228 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:41.220+0000 7fe6c551b640 1 --2- 172.21.15.92:0/1909943525 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe6c0074090 0x7fe6c0142be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:41.228 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:41.220+0000 7fe6c551b640 1 -- 172.21.15.92:0/1909943525 >> 172.21.15.92:0/1909943525 conn(0x7fe6c006ce40 msgr2=0x7fe6c00ad890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:14:41.228 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:41.220+0000 7fe6c551b640 1 -- 172.21.15.92:0/1909943525 shutdown_connections 2024-09-11T00:14:41.228 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:41.220+0000 7fe6c551b640 1 -- 172.21.15.92:0/1909943525 wait complete. 2024-09-11T00:14:41.229 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542154 got 60129542153 for osd.2 2024-09-11T00:14:41.236 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509450 got 64424509449 for osd.0 2024-09-11T00:14:41.238 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509449 got 64424509448 for osd.3 2024-09-11T00:14:41.240 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509449 got 64424509448 for osd.4 2024-09-11T00:14:41.241 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509451 got 64424509450 for osd.1 2024-09-11T00:14:41.241 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574857 for osd.6 2024-09-11T00:14:42.216 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-11T00:14:42.227 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-11T00:14:42.230 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-11T00:14:42.237 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-11T00:14:42.239 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-11T00:14:42.241 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-11T00:14:42.242 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-11T00:14:42.242 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-11T00:14:42.379 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.376+0000 7f90ac3d3640 1 -- 172.21.15.92:0/2399050707 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f909c0370c0 msgr2=0x7f909c0374f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:42.379 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.376+0000 7f90ac3d3640 1 --2- 172.21.15.92:0/2399050707 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f909c0370c0 0x7f909c0374f0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f90a40661a0 tx=0x7f90a40a5ae0 comp rx=0 tx=0).stop 2024-09-11T00:14:42.379 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.377+0000 7f90ac3d3640 1 -- 172.21.15.92:0/2399050707 shutdown_connections 2024-09-11T00:14:42.379 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.377+0000 7f90ac3d3640 1 --2- 172.21.15.92:0/2399050707 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f909c0370c0 0x7f909c0374f0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:42.379 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.377+0000 7f90ac3d3640 1 --2- 172.21.15.92:0/2399050707 >> v2:172.21.15.145:3300/0 conn(0x7f909c0df7a0 0x7f909c036a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:42.379 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.377+0000 7f90ac3d3640 1 -- 172.21.15.92:0/2399050707 >> 172.21.15.92:0/2399050707 conn(0x7f909c01e890 msgr2=0x7f909c055640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:14:42.383 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.377+0000 7f90ac3d3640 1 -- 172.21.15.92:0/2399050707 shutdown_connections 2024-09-11T00:14:42.383 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.377+0000 7f90ac3d3640 1 -- 172.21.15.92:0/2399050707 wait complete. 2024-09-11T00:14:42.383 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.379+0000 7f90ac3d3640 1 Processor -- start 2024-09-11T00:14:42.383 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.379+0000 7f90ac3d3640 1 -- start start 2024-09-11T00:14:42.383 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.381+0000 7f90ac3d3640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f909c034340 0x7f909c048480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:42.384 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.382+0000 7f90aa16f640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f909c034340 0x7f909c048480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:42.384 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.382+0000 7f90aa16f640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f909c034340 0x7f909c048480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:50614/0 (socket says 172.21.15.92:50614) 2024-09-11T00:14:42.384 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.382+0000 7f90aa16f640 1 -- 172.21.15.92:0/1865957213 learned_addr learned my addr 172.21.15.92:0/1865957213 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-11T00:14:42.384 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.382+0000 7f90ac3d3640 1 --2- 172.21.15.92:0/1865957213 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f909c0370c0 0x7f909c0541d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:42.384 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.382+0000 7f90ac3d3640 1 --2- 172.21.15.92:0/1865957213 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f909c0df7a0 0x7f909c054710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:42.384 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.382+0000 7f90a996e640 1 --2- 172.21.15.92:0/1865957213 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f909c0370c0 0x7f909c0541d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:42.384 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.382+0000 7f90aa970640 1 --2- 172.21.15.92:0/1865957213 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f909c0df7a0 0x7f909c054710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:42.386 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.383+0000 7f90ac3d3640 1 -- 172.21.15.92:0/1865957213 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f909c0084f0 con 0x7f909c034340 2024-09-11T00:14:42.387 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.383+0000 7f90ac3d3640 1 -- 172.21.15.92:0/1865957213 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f909c008370 con 0x7f909c0370c0 2024-09-11T00:14:42.387 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.383+0000 7f90ac3d3640 1 -- 172.21.15.92:0/1865957213 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f909c008670 con 0x7f909c0df7a0 2024-09-11T00:14:42.387 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.383+0000 7f90aa16f640 1 -- 172.21.15.92:0/1865957213 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f909c0df7a0 msgr2=0x7f909c054710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:42.387 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.383+0000 7f90aa16f640 1 --2- 172.21.15.92:0/1865957213 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f909c0df7a0 0x7f909c054710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:42.387 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.383+0000 7f90aa16f640 1 -- 172.21.15.92:0/1865957213 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f909c0370c0 msgr2=0x7f909c0541d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:42.387 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.383+0000 7f90aa16f640 1 --2- 172.21.15.92:0/1865957213 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f909c0370c0 0x7f909c0541d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:42.387 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.383+0000 7f90aa16f640 1 -- 172.21.15.92:0/1865957213 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f909c196f70 con 0x7f909c034340 2024-09-11T00:14:42.387 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.384+0000 7f90aa16f640 1 --2- 172.21.15.92:0/1865957213 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f909c034340 0x7f909c048480 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f9094009f70 tx=0x7f909400bb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:14:42.387 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.385+0000 7f909affd640 1 -- 172.21.15.92:0/1865957213 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f909402a070 con 0x7f909c034340 2024-09-11T00:14:42.388 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.385+0000 7f90ac3d3640 1 -- 172.21.15.92:0/1865957213 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f909c1971f0 con 0x7f909c034340 2024-09-11T00:14:42.388 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.385+0000 7f90ac3d3640 1 -- 172.21.15.92:0/1865957213 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f909c1977b0 con 0x7f909c034340 2024-09-11T00:14:42.390 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.388+0000 7f909affd640 1 -- 172.21.15.92:0/1865957213 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f909401d840 con 0x7f909c034340 2024-09-11T00:14:42.391 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.389+0000 7f909affd640 1 -- 172.21.15.92:0/1865957213 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f909401dcd0 con 0x7f909c034340 2024-09-11T00:14:42.391 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.390+0000 7f909affd640 1 -- 172.21.15.92:0/1865957213 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f909402e3b0 con 0x7f909c034340 2024-09-11T00:14:42.392 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.390+0000 7f909affd640 1 --2- 172.21.15.92:0/1865957213 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f9088078070 0x7f908807a530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:42.392 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.391+0000 7f909affd640 1 -- 172.21.15.92:0/1865957213 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f90940aa810 con 0x7f909c034340 2024-09-11T00:14:42.392 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.391+0000 7f90a996e640 1 --2- 172.21.15.92:0/1865957213 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f9088078070 0x7f908807a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:42.393 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.392+0000 7f90a996e640 1 --2- 172.21.15.92:0/1865957213 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f9088078070 0x7f908807a530 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f909c051a20 tx=0x7f90a0014040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:14:42.393 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.392+0000 7f90ac3d3640 1 -- 172.21.15.92:0/1865957213 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f908c005290 con 0x7f909c034340 2024-09-11T00:14:42.402 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.401+0000 7f909affd640 1 -- 172.21.15.92:0/1865957213 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f909c196f70 con 0x7f909c034340 2024-09-11T00:14:42.437 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.436+0000 7fd3405bb640 1 -- 172.21.15.92:0/503036271 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd3380b2cd0 msgr2=0x7fd3380b4960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:42.437 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.436+0000 7fd3405bb640 1 --2- 172.21.15.92:0/503036271 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd3380b2cd0 0x7fd3380b4960 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fd334009860 tx=0x7fd33402a520 comp rx=0 tx=0).stop 2024-09-11T00:14:42.438 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.436+0000 7f2c90991640 1 -- 172.21.15.92:0/1886482494 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2c8404eb20 msgr2=0x7f2c84036110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:42.438 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.436+0000 7f2c90991640 1 --2- 172.21.15.92:0/1886482494 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2c8404eb20 0x7f2c84036110 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f2c8c069f00 tx=0x7f2c8c0a5a60 comp rx=0 tx=0).stop 2024-09-11T00:14:42.438 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.436+0000 7fd3405bb640 1 -- 172.21.15.92:0/503036271 shutdown_connections 2024-09-11T00:14:42.438 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.436+0000 7fd3405bb640 1 --2- 172.21.15.92:0/503036271 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd3380b2cd0 0x7fd3380b4960 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:42.438 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.436+0000 7fd3405bb640 1 -- 172.21.15.92:0/503036271 >> 172.21.15.92:0/503036271 conn(0x7fd3380cfaf0 msgr2=0x7fd3380cff00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:14:42.439 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.436+0000 7f0a1759e640 1 -- 172.21.15.92:0/278665894 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0a1003b9e0 msgr2=0x7f0a100e2500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:42.439 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.436+0000 7fafcaffd640 1 -- 172.21.15.92:0/1383069901 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafcc0a7e40 con 0x7fafc4054860 2024-09-11T00:14:42.439 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.436+0000 7f0a1759e640 1 --2- 172.21.15.92:0/278665894 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0a1003b9e0 0x7f0a100e2500 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f0a10007e90 tx=0x7f0a0c02a540 comp rx=0 tx=0).stop 2024-09-11T00:14:42.439 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.436+0000 7f9986f24640 1 -- 172.21.15.92:0/2655797493 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f99800d2720 msgr2=0x7f99800ce730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:42.439 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.436+0000 7f9986f24640 1 --2- 172.21.15.92:0/2655797493 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f99800d2720 0x7f99800ce730 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f998008c550 tx=0x7f997802aa50 comp rx=0 tx=0).stop 2024-09-11T00:14:42.440 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.436+0000 7f0a1759e640 1 -- 172.21.15.92:0/278665894 shutdown_connections 2024-09-11T00:14:42.440 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.436+0000 7f0a1759e640 1 --2- 172.21.15.92:0/278665894 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0a1003b9e0 0x7f0a100e2500 secure :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f0a10007e90 tx=0x7f0a0c02a540 comp rx=0 tx=0).stop 2024-09-11T00:14:42.440 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.436+0000 7f0a1759e640 1 --2- 172.21.15.92:0/278665894 >> v2:172.21.15.145:3300/0 conn(0x7f0a100e6530 0x7f0a10053880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:42.440 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.436+0000 7f0a1759e640 1 -- 172.21.15.92:0/278665894 >> 172.21.15.92:0/278665894 conn(0x7f0a1000e1e0 msgr2=0x7f0a1000e5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:14:42.440 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.436+0000 7f9986f24640 1 -- 172.21.15.92:0/2655797493 shutdown_connections 2024-09-11T00:14:42.440 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.436+0000 7f9986f24640 1 --2- 172.21.15.92:0/2655797493 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f99800d2720 0x7f99800ce730 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:42.441 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.436+0000 7f9986f24640 1 --2- 172.21.15.92:0/2655797493 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f99800d0580 0x7f99800d21e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:42.441 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.436+0000 7f9986f24640 1 --2- 172.21.15.92:0/2655797493 >> v2:172.21.15.145:3300/0 conn(0x7f998015dd10 0x7f99800d19b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:42.441 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.436+0000 7f9986f24640 1 -- 172.21.15.92:0/2655797493 >> 172.21.15.92:0/2655797493 conn(0x7f998009ceb0 msgr2=0x7f99800d3c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:14:42.441 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.436+0000 7f2c90991640 1 -- 172.21.15.92:0/1886482494 shutdown_connections 2024-09-11T00:14:42.441 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.436+0000 7f2c90991640 1 --2- 172.21.15.92:0/1886482494 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2c8404eb20 0x7f2c84036110 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:42.441 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.436+0000 7f2c90991640 1 --2- 172.21.15.92:0/1886482494 >> v2:172.21.15.92:3300/0 conn(0x7f2c840e69b0 0x7f2c84006e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:42.441 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.436+0000 7f2c90991640 1 -- 172.21.15.92:0/1886482494 >> 172.21.15.92:0/1886482494 conn(0x7f2c8401d770 msgr2=0x7f2c84054560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:14:42.442 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.436+0000 7fd3405bb640 1 -- 172.21.15.92:0/503036271 shutdown_connections 2024-09-11T00:14:42.442 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.436+0000 7fd3405bb640 1 -- 172.21.15.92:0/503036271 wait complete. 2024-09-11T00:14:42.442 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.437+0000 7fafd145d640 1 -- 172.21.15.92:0/1383069901 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fafc4054860 msgr2=0x7fafc4054c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:42.442 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.437+0000 7fafd145d640 1 --2- 172.21.15.92:0/1383069901 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fafc4054860 0x7fafc4054c40 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fafcc069f00 tx=0x7fafcc0a5b30 comp rx=0 tx=0).stop 2024-09-11T00:14:42.442 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.437+0000 7f9986f24640 1 -- 172.21.15.92:0/2655797493 shutdown_connections 2024-09-11T00:14:42.442 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.437+0000 7f9986f24640 1 -- 172.21.15.92:0/2655797493 wait complete. 2024-09-11T00:14:42.443 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.437+0000 7f0a1759e640 1 -- 172.21.15.92:0/278665894 shutdown_connections 2024-09-11T00:14:42.443 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.437+0000 7f330737d640 1 -- 172.21.15.92:0/3536018218 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f32f8006ed0 msgr2=0x7f32f80369c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:42.443 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.437+0000 7f330737d640 1 --2- 172.21.15.92:0/3536018218 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f32f8006ed0 0x7f32f80369c0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f33000661a0 tx=0x7f33000a5b70 comp rx=0 tx=0).stop 2024-09-11T00:14:42.443 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.437+0000 7f0a1759e640 1 -- 172.21.15.92:0/278665894 wait complete. 2024-09-11T00:14:42.444 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.438+0000 7f330737d640 1 -- 172.21.15.92:0/3536018218 shutdown_connections 2024-09-11T00:14:42.444 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.438+0000 7f330737d640 1 --2- 172.21.15.92:0/3536018218 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f32f8006ed0 0x7f32f80369c0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:42.444 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.438+0000 7f330737d640 1 -- 172.21.15.92:0/3536018218 >> 172.21.15.92:0/3536018218 conn(0x7f32f801d770 msgr2=0x7f32f8054560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:14:42.444 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.438+0000 7fafd145d640 1 -- 172.21.15.92:0/1383069901 shutdown_connections 2024-09-11T00:14:42.444 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.438+0000 7fafd145d640 1 --2- 172.21.15.92:0/1383069901 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fafc4034ba0 0x7fafc4008640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:42.444 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.438+0000 7fafd145d640 1 --2- 172.21.15.92:0/1383069901 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fafc4054860 0x7fafc4054c40 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:42.444 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.438+0000 7fafd145d640 1 -- 172.21.15.92:0/1383069901 >> 172.21.15.92:0/1383069901 conn(0x7fafc401e890 msgr2=0x7fafc4055640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:14:42.445 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.438+0000 7f2c90991640 1 -- 172.21.15.92:0/1886482494 shutdown_connections 2024-09-11T00:14:42.445 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.438+0000 7f2c90991640 1 -- 172.21.15.92:0/1886482494 wait complete. 2024-09-11T00:14:42.445 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.438+0000 7fd3405bb640 1 Processor -- start 2024-09-11T00:14:42.445 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.438+0000 7f330737d640 1 -- 172.21.15.92:0/3536018218 shutdown_connections 2024-09-11T00:14:42.446 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.438+0000 7fafd145d640 1 -- 172.21.15.92:0/1383069901 shutdown_connections 2024-09-11T00:14:42.446 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.439+0000 7f330737d640 1 -- 172.21.15.92:0/3536018218 wait complete. 2024-09-11T00:14:42.446 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.439+0000 7f9986f24640 1 Processor -- start 2024-09-11T00:14:42.446 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.439+0000 7f9986f24640 1 -- start start 2024-09-11T00:14:42.447 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.439+0000 7f0a1759e640 1 Processor -- start 2024-09-11T00:14:42.447 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.438+0000 7fd3405bb640 1 -- start start 2024-09-11T00:14:42.447 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.439+0000 7f40752c6640 1 -- 172.21.15.92:0/3616149061 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f40701477b0 msgr2=0x7f40700b4960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:42.447 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.439+0000 7f40752c6640 1 --2- 172.21.15.92:0/3616149061 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f40701477b0 0x7f40700b4960 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f4068005fd0 tx=0x7f406802a870 comp rx=0 tx=0).stop 2024-09-11T00:14:42.447 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.439+0000 7f0a1759e640 1 -- start start 2024-09-11T00:14:42.448 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.439+0000 7f40752c6640 1 -- 172.21.15.92:0/3616149061 shutdown_connections 2024-09-11T00:14:42.448 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.439+0000 7f40752c6640 1 --2- 172.21.15.92:0/3616149061 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f40701477b0 0x7f40700b4960 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:42.448 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.439+0000 7f40752c6640 1 -- 172.21.15.92:0/3616149061 >> 172.21.15.92:0/3616149061 conn(0x7f40700cfaf0 msgr2=0x7f40700cff00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:14:42.448 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.439+0000 7f2c90991640 1 Processor -- start 2024-09-11T00:14:42.448 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.439+0000 7fd3405bb640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd338072560 0x7fd33813e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:42.449 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.439+0000 7f40752c6640 1 -- 172.21.15.92:0/3616149061 shutdown_connections 2024-09-11T00:14:42.449 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.439+0000 7fd3405bb640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd3380b2cd0 0x7fd3381f87e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:42.449 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.440+0000 7fd3405bb640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd3380b30b0 0x7fd33813b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:42.449 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.440+0000 7f2c90991640 1 -- start start 2024-09-11T00:14:42.450 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.440+0000 7f0a1759e640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0a1003be30 0x7f0a100e49e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:42.450 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.440+0000 7f9986f24640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f99800d0580 0x7f99800b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:42.450 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.440+0000 7f9986f24640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f99800d2720 0x7f998015ac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:42.450 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.440+0000 7f9986f24640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f998015dd10 0x7f99800ccb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:42.450 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.440+0000 7f9986f24640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f99800cedf0 con 0x7f99800d0580 2024-09-11T00:14:42.450 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.440+0000 7f9986f24640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f99800cec70 con 0x7f99800d2720 2024-09-11T00:14:42.451 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.440+0000 7f9986f24640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f99800cef70 con 0x7f998015dd10 2024-09-11T00:14:42.451 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.441+0000 7f99854c1640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f998015dd10 0x7f99800ccb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:42.451 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.441+0000 7f9984cc0640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f99800d0580 0x7f99800b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:42.451 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.441+0000 7f330737d640 1 Processor -- start 2024-09-11T00:14:42.451 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.441+0000 7f2c90991640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2c8404eb20 0x7f2c840dede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:42.452 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.441+0000 7f9984cc0640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f99800d0580 0x7f99800b7230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:50642/0 (socket says 172.21.15.92:50642) 2024-09-11T00:14:42.452 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.441+0000 7f9984cc0640 1 -- 172.21.15.92:0/1312832381 learned_addr learned my addr 172.21.15.92:0/1312832381 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-11T00:14:42.452 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.441+0000 7f997ffff640 1 --2- 172.21.15.92:0/1312832381 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f99800d2720 0x7f998015ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:42.452 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.441+0000 7f0a1659c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0a1003be30 0x7f0a100e49e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:42.452 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.441+0000 7f0a1659c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0a1003be30 0x7f0a100e49e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:50648/0 (socket says 172.21.15.92:50648) 2024-09-11T00:14:42.453 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.441+0000 7f0a1659c640 1 -- 172.21.15.92:0/1811480199 learned_addr learned my addr 172.21.15.92:0/1811480199 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-11T00:14:42.453 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.441+0000 7f0a1759e640 1 --2- 172.21.15.92:0/1811480199 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f0a100e6530 0x7f0a1017e470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:42.453 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.441+0000 7f2c90991640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2c840e69b0 0x7f2c84031a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:42.453 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.441+0000 7f2c90991640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2c840e6d90 0x7f2c8404a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:42.453 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.441+0000 7f2c90991640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f2c84055200 con 0x7f2c8404eb20 2024-09-11T00:14:42.453 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.441+0000 7f2c8b7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2c8404eb20 0x7f2c840dede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:42.453 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.441+0000 7f0a1759e640 1 --2- 172.21.15.92:0/1811480199 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0a1003db70 0x7f0a100dc240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:42.454 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.441+0000 7f2c8b7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2c8404eb20 0x7f2c840dede0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:50650/0 (socket says 172.21.15.92:50650) 2024-09-11T00:14:42.454 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.441+0000 7f2c8b7fe640 1 -- 172.21.15.92:0/2540364061 learned_addr learned my addr 172.21.15.92:0/2540364061 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-11T00:14:42.454 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.441+0000 7f2c90991640 1 -- 172.21.15.92:0/2540364061 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f2c84055080 con 0x7f2c840e6d90 2024-09-11T00:14:42.454 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.441+0000 7f2c90991640 1 -- 172.21.15.92:0/2540364061 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f2c84055380 con 0x7f2c840e69b0 2024-09-11T00:14:42.454 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.441+0000 7f9984cc0640 1 -- 172.21.15.92:0/1312832381 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f998015dd10 msgr2=0x7f99800ccb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:42.454 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.441+0000 7f9984cc0640 1 --2- 172.21.15.92:0/1312832381 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f998015dd10 0x7f99800ccb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:42.454 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.441+0000 7f9984cc0640 1 -- 172.21.15.92:0/1312832381 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f99800d2720 msgr2=0x7f998015ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:42.455 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.441+0000 7f9984cc0640 1 --2- 172.21.15.92:0/1312832381 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f99800d2720 0x7f998015ac10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:42.455 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.441+0000 7f9984cc0640 1 -- 172.21.15.92:0/1312832381 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9980161040 con 0x7f99800d0580 2024-09-11T00:14:42.455 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.439+0000 7f40752c6640 1 -- 172.21.15.92:0/3616149061 wait complete. 2024-09-11T00:14:42.455 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.441+0000 7f40752c6640 1 Processor -- start 2024-09-11T00:14:42.455 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.441+0000 7f0a1759e640 1 -- 172.21.15.92:0/1811480199 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f0a100e2a40 con 0x7f0a1003be30 2024-09-11T00:14:42.456 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.441+0000 7f40752c6640 1 -- start start 2024-09-11T00:14:42.456 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.441+0000 7f9984cc0640 1 --2- 172.21.15.92:0/1312832381 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f99800d0580 0x7f99800b7230 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f997400c970 tx=0x7f997400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:14:42.456 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.441+0000 7f0a16d9d640 1 --2- 172.21.15.92:0/1811480199 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0a1003db70 0x7f0a100dc240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:42.456 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.440+0000 7fafd145d640 1 -- 172.21.15.92:0/1383069901 wait complete. 2024-09-11T00:14:42.457 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.442+0000 7f0a1759e640 1 -- 172.21.15.92:0/1811480199 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f0a100e7340 con 0x7f0a1003db70 2024-09-11T00:14:42.457 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.442+0000 7fafd145d640 1 Processor -- start 2024-09-11T00:14:42.457 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.442+0000 7f0a1759e640 1 -- 172.21.15.92:0/1811480199 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f0a100e2bc0 con 0x7f0a100e6530 2024-09-11T00:14:42.457 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.442+0000 7f0a15d9b640 1 --2- 172.21.15.92:0/1811480199 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f0a100e6530 0x7f0a1017e470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:42.458 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.442+0000 7f997d7fa640 1 -- 172.21.15.92:0/1312832381 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9974007bb0 con 0x7f99800d0580 2024-09-11T00:14:42.458 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.442+0000 7f997d7fa640 1 -- 172.21.15.92:0/1312832381 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9974007e40 con 0x7f99800d0580 2024-09-11T00:14:42.458 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.442+0000 7f997d7fa640 1 -- 172.21.15.92:0/1312832381 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9974005260 con 0x7f99800d0580 2024-09-11T00:14:42.458 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.442+0000 7f2c8b7fe640 1 -- 172.21.15.92:0/2540364061 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2c840e69b0 msgr2=0x7f2c84031a50 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-11T00:14:42.458 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.442+0000 7f2c8b7fe640 1 --2- 172.21.15.92:0/2540364061 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2c840e69b0 0x7f2c84031a50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:42.459 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.442+0000 7f2c8b7fe640 1 -- 172.21.15.92:0/2540364061 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2c840e6d90 msgr2=0x7f2c8404a4e0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-11T00:14:42.459 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.442+0000 7f2c8b7fe640 1 --2- 172.21.15.92:0/2540364061 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2c840e6d90 0x7f2c8404a4e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:42.459 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.442+0000 7f2c8b7fe640 1 -- 172.21.15.92:0/2540364061 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c840de240 con 0x7f2c8404eb20 2024-09-11T00:14:42.459 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.442+0000 7f0a1659c640 1 -- 172.21.15.92:0/1811480199 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f0a100e6530 msgr2=0x7f0a1017e470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:42.459 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.442+0000 7f0a1659c640 1 --2- 172.21.15.92:0/1811480199 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f0a100e6530 0x7f0a1017e470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:42.459 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.442+0000 7f0a1659c640 1 -- 172.21.15.92:0/1811480199 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0a1003db70 msgr2=0x7f0a100dc240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:42.459 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.442+0000 7f0a1659c640 1 --2- 172.21.15.92:0/1811480199 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0a1003db70 0x7f0a100dc240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:42.459 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.442+0000 7f2c8b7fe640 1 --2- 172.21.15.92:0/2540364061 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2c8404eb20 0x7f2c840dede0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f2c7800ca30 tx=0x7f2c7800cef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:14:42.460 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.442+0000 7f0a1659c640 1 -- 172.21.15.92:0/1811480199 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a1017e9b0 con 0x7f0a1003be30 2024-09-11T00:14:42.460 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.440+0000 7fd33e357640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd338072560 0x7fd33813e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:42.460 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.442+0000 7f0a15d9b640 1 --2- 172.21.15.92:0/1811480199 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f0a100e6530 0x7f0a1017e470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:14:42.461 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.440+0000 7fd33e357640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd338072560 0x7fd33813e840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:50636/0 (socket says 172.21.15.92:50636) 2024-09-11T00:14:42.461 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.440+0000 7fd33e357640 1 -- 172.21.15.92:0/3965793367 learned_addr learned my addr 172.21.15.92:0/3965793367 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-11T00:14:42.461 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.440+0000 7fd3405bb640 1 -- 172.21.15.92:0/3965793367 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fd338145eb0 con 0x7fd338072560 2024-09-11T00:14:42.461 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.440+0000 7fd3405bb640 1 -- 172.21.15.92:0/3965793367 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fd3380ceca0 con 0x7fd3380b30b0 2024-09-11T00:14:42.461 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.440+0000 7fd3405bb640 1 -- 172.21.15.92:0/3965793367 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7fd338146030 con 0x7fd3380b2cd0 2024-09-11T00:14:42.462 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.441+0000 7fd33e357640 1 -- 172.21.15.92:0/3965793367 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd3380b2cd0 msgr2=0x7fd3381f87e0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-11T00:14:42.462 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.441+0000 7fd33e357640 1 --2- 172.21.15.92:0/3965793367 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd3380b2cd0 0x7fd3381f87e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:42.462 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.441+0000 7fd33e357640 1 -- 172.21.15.92:0/3965793367 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd3380b30b0 msgr2=0x7fd33813b760 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T00:14:42.462 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.442+0000 7f9986f24640 1 -- 172.21.15.92:0/1312832381 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99800cbd40 con 0x7f99800d0580 2024-09-11T00:14:42.462 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.441+0000 7fd33e357640 1 --2- 172.21.15.92:0/3965793367 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd3380b30b0 0x7fd33813b760 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:42.462 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.441+0000 7fd33e357640 1 -- 172.21.15.92:0/3965793367 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd33813e4b0 con 0x7fd338072560 2024-09-11T00:14:42.462 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.441+0000 7fd33e357640 1 --2- 172.21.15.92:0/3965793367 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd338072560 0x7fd33813e840 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fd334009980 tx=0x7fd334032f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:14:42.462 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.442+0000 7fd32effd640 1 -- 172.21.15.92:0/3965793367 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd334040070 con 0x7fd338072560 2024-09-11T00:14:42.463 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.442+0000 7fd32effd640 1 -- 172.21.15.92:0/3965793367 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd334005310 con 0x7fd338072560 2024-09-11T00:14:42.463 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.442+0000 7fd32effd640 1 -- 172.21.15.92:0/3965793367 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3340047a0 con 0x7fd338072560 2024-09-11T00:14:42.463 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.442+0000 7fd3405bb640 1 -- 172.21.15.92:0/3965793367 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd338141500 con 0x7fd338072560 2024-09-11T00:14:42.463 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.442+0000 7fd3405bb640 1 -- 172.21.15.92:0/3965793367 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3381f8d20 con 0x7fd338072560 2024-09-11T00:14:42.463 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.443+0000 7f40752c6640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f40700ad890 0x7f40700aceb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:42.463 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.443+0000 7f0a1659c640 1 --2- 172.21.15.92:0/1811480199 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0a1003be30 0x7f0a100e49e0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f0a0800d740 tx=0x7f0a0800dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:14:42.464 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.442+0000 7f9986f24640 1 -- 172.21.15.92:0/1312832381 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99800cc300 con 0x7f99800d0580 2024-09-11T00:14:42.464 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.443+0000 7f40752c6640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f40700b3170 0x7f4070158ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:42.464 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.443+0000 7f40752c6640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f40701477b0 0x7f40701f6dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:42.464 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.442+0000 7f330737d640 1 -- start start 2024-09-11T00:14:42.465 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.443+0000 7f330737d640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f32f8006ed0 0x7f32f804c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:42.465 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.443+0000 7f330737d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f32f8034230 0x7f32f80de6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:42.465 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.443+0000 7f330737d640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f32f80e1fb0 0x7f32f80dc5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:42.465 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.443+0000 7f330737d640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f32f8054df0 con 0x7f32f8034230 2024-09-11T00:14:42.465 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.443+0000 7f330737d640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f32f8054c70 con 0x7f32f80e1fb0 2024-09-11T00:14:42.465 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.443+0000 7f330737d640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f32f80399c0 con 0x7f32f8006ed0 2024-09-11T00:14:42.465 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.443+0000 7f0a06ffd640 1 -- 172.21.15.92:0/1811480199 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a08017070 con 0x7f0a1003be30 2024-09-11T00:14:42.466 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.443+0000 7f0a06ffd640 1 -- 172.21.15.92:0/1811480199 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0a08009c30 con 0x7f0a1003be30 2024-09-11T00:14:42.466 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.443+0000 7f0a06ffd640 1 -- 172.21.15.92:0/1811480199 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a080106c0 con 0x7f0a1003be30 2024-09-11T00:14:42.466 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.443+0000 7f0a1759e640 1 -- 172.21.15.92:0/1811480199 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0a10181050 con 0x7f0a1003be30 2024-09-11T00:14:42.466 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.443+0000 7f406e7fc640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f40700b3170 0x7f4070158ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:42.467 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.443+0000 7f40752c6640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f40701692f0 con 0x7f40700ad890 2024-09-11T00:14:42.467 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.443+0000 7f40752c6640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f4070169170 con 0x7f40700b3170 2024-09-11T00:14:42.467 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.443+0000 7f40752c6640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f4070169470 con 0x7f40701477b0 2024-09-11T00:14:42.467 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.444+0000 7f406effd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f40700ad890 0x7f40700aceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:42.467 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.444+0000 7f406e7fc640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f40700b3170 0x7f4070158ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.92:47210/0 (socket says 172.21.15.92:47210) 2024-09-11T00:14:42.467 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.444+0000 7f3304918640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f32f8034230 0x7f32f80de6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:42.467 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.444+0000 7f3304918640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f32f8034230 0x7f32f80de6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:50658/0 (socket says 172.21.15.92:50658) 2024-09-11T00:14:42.467 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.444+0000 7f3304918640 1 -- 172.21.15.92:0/1262159250 learned_addr learned my addr 172.21.15.92:0/1262159250 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-11T00:14:42.468 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.444+0000 7fafd145d640 1 -- start start 2024-09-11T00:14:42.468 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.444+0000 7f9986f24640 1 -- 172.21.15.92:0/1312832381 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f99800cf410 con 0x7f99800d0580 2024-09-11T00:14:42.468 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.445+0000 7f0a1759e640 1 -- 172.21.15.92:0/1811480199 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0a10181610 con 0x7f0a1003be30 2024-09-11T00:14:42.468 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.444+0000 7f3304918640 1 -- 172.21.15.92:0/1262159250 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f32f8006ed0 msgr2=0x7f32f804c0c0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-11T00:14:42.469 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.444+0000 7f3304918640 1 --2- 172.21.15.92:0/1262159250 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f32f8006ed0 0x7f32f804c0c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:42.469 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.444+0000 7f3304918640 1 -- 172.21.15.92:0/1262159250 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f32f80e1fb0 msgr2=0x7f32f80dc5e0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-11T00:14:42.469 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.444+0000 7f3304918640 1 --2- 172.21.15.92:0/1262159250 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f32f80e1fb0 0x7f32f80dc5e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:42.469 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.445+0000 7f3304918640 1 -- 172.21.15.92:0/1262159250 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32f804c980 con 0x7f32f8034230 2024-09-11T00:14:42.469 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.445+0000 7f3304918640 1 --2- 172.21.15.92:0/1262159250 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f32f8034230 0x7f32f80de6c0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f32f000c490 tx=0x7f32f000c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:14:42.469 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.445+0000 7fafd145d640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fafc4034650 0x7fafc4008a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:42.469 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.445+0000 7fafd145d640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fafc4034ba0 0x7fafc4006620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:42.469 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.445+0000 7fafd145d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fafc4054860 0x7fafc4189c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:42.469 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.445+0000 7fafd145d640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fafc40e69c0 con 0x7fafc4054860 2024-09-11T00:14:42.470 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.445+0000 7fafd145d640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fafc40e6840 con 0x7fafc4034650 2024-09-11T00:14:42.470 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.445+0000 7fafd145d640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7fafc403a540 con 0x7fafc4034ba0 2024-09-11T00:14:42.470 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.445+0000 7fd32effd640 1 -- 172.21.15.92:0/3965793367 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fd334004940 con 0x7fd338072560 2024-09-11T00:14:42.470 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.444+0000 7f406e7fc640 1 -- 172.21.15.92:0/4093904735 learned_addr learned my addr 172.21.15.92:0/4093904735 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-11T00:14:42.470 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.444+0000 7f406effd640 1 -- 172.21.15.92:0/4093904735 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f40701477b0 msgr2=0x7f40701f6dc0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T00:14:42.470 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.444+0000 7f406effd640 1 --2- 172.21.15.92:0/4093904735 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f40701477b0 0x7f40701f6dc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:42.470 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.444+0000 7f406effd640 1 -- 172.21.15.92:0/4093904735 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f40700b3170 msgr2=0x7f4070158ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:42.471 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.444+0000 7f406effd640 1 --2- 172.21.15.92:0/4093904735 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f40700b3170 0x7f4070158ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:42.471 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.444+0000 7f406effd640 1 -- 172.21.15.92:0/4093904735 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40700a95b0 con 0x7f40700ad890 2024-09-11T00:14:42.471 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.445+0000 7fafd0c5c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fafc4054860 0x7fafc4189c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:42.471 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.444+0000 7f406effd640 1 --2- 172.21.15.92:0/4093904735 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f40700ad890 0x7f40700aceb0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f4068009000 tx=0x7f40680338d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:14:42.472 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.445+0000 7fafd0c5c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fafc4054860 0x7fafc4189c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:50672/0 (socket says 172.21.15.92:50672) 2024-09-11T00:14:42.472 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.445+0000 7fafd0c5c640 1 -- 172.21.15.92:0/1780860682 learned_addr learned my addr 172.21.15.92:0/1780860682 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-11T00:14:42.472 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.445+0000 7fafcbfff640 1 --2- 172.21.15.92:0/1780860682 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fafc4034650 0x7fafc4008a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:42.472 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.446+0000 7fafd0c5c640 1 -- 172.21.15.92:0/1780860682 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fafc4034ba0 msgr2=0x7fafc4006620 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T00:14:42.472 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.446+0000 7fafd0c5c640 1 --2- 172.21.15.92:0/1780860682 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fafc4034ba0 0x7fafc4006620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:42.472 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.446+0000 7fafd0c5c640 1 -- 172.21.15.92:0/1780860682 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fafc4034650 msgr2=0x7fafc4008a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:42.472 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.446+0000 7fd32effd640 1 --2- 172.21.15.92:0/3965793367 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7fd31c088fd0 0x7fd31c08b490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:42.473 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.446+0000 7fafd0c5c640 1 --2- 172.21.15.92:0/1780860682 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fafc4034650 0x7fafc4008a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:42.473 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.446+0000 7fafd0c5c640 1 -- 172.21.15.92:0/1780860682 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fafc4034060 con 0x7fafc4054860 2024-09-11T00:14:42.473 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.446+0000 7fd32effd640 1 -- 172.21.15.92:0/3965793367 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fd3340bb1d0 con 0x7fd338072560 2024-09-11T00:14:42.473 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.446+0000 7f40577fe640 1 -- 172.21.15.92:0/4093904735 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4068042020 con 0x7f40700ad890 2024-09-11T00:14:42.474 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.446+0000 7f40752c6640 1 -- 172.21.15.92:0/4093904735 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f40700a9890 con 0x7f40700ad890 2024-09-11T00:14:42.474 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.446+0000 7f40752c6640 1 -- 172.21.15.92:0/4093904735 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40700a9e50 con 0x7f40700ad890 2024-09-11T00:14:42.474 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.446+0000 7fafd0c5c640 1 --2- 172.21.15.92:0/1780860682 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fafc4054860 0x7fafc4189c60 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fafc000c730 tx=0x7fafc000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:14:42.474 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.447+0000 7fd33db56640 1 --2- 172.21.15.92:0/3965793367 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7fd31c088fd0 0x7fd31c08b490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:42.474 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.447+0000 7f2c77fff640 1 -- 172.21.15.92:0/2540364061 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c78007d30 con 0x7f2c8404eb20 2024-09-11T00:14:42.475 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.446+0000 7f997d7fa640 1 -- 172.21.15.92:0/1312832381 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f9974005400 con 0x7f99800d0580 2024-09-11T00:14:42.475 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.447+0000 7fd3405bb640 1 -- 172.21.15.92:0/3965793367 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd320005290 con 0x7fd338072560 2024-09-11T00:14:42.475 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.447+0000 7f997d7fa640 1 --2- 172.21.15.92:0/1312832381 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f9964077f70 0x7f996407a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:42.475 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.447+0000 7f2c90991640 1 -- 172.21.15.92:0/2540364061 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c840de520 con 0x7f2c8404eb20 2024-09-11T00:14:42.476 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.447+0000 7f997d7fa640 1 -- 172.21.15.92:0/1312832381 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f997409a940 con 0x7f99800d0580 2024-09-11T00:14:42.476 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.447+0000 7f2c90991640 1 -- 172.21.15.92:0/2540364061 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c840522f0 con 0x7f2c8404eb20 2024-09-11T00:14:42.476 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.447+0000 7f2c77fff640 1 -- 172.21.15.92:0/2540364061 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2c78004020 con 0x7f2c8404eb20 2024-09-11T00:14:42.476 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.447+0000 7f997ffff640 1 --2- 172.21.15.92:0/1312832381 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f9964077f70 0x7f996407a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:42.477 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.446+0000 7f0a1759e640 1 -- 172.21.15.92:0/1811480199 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0a10053880 con 0x7f0a1003be30 2024-09-11T00:14:42.477 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.447+0000 7f0a06ffd640 1 -- 172.21.15.92:0/1811480199 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f0a08010860 con 0x7f0a1003be30 2024-09-11T00:14:42.477 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.447+0000 7f32f5ffb640 1 -- 172.21.15.92:0/1262159250 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32f0007030 con 0x7f32f8034230 2024-09-11T00:14:42.477 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.447+0000 7f330737d640 1 -- 172.21.15.92:0/1262159250 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32f8180f10 con 0x7f32f8034230 2024-09-11T00:14:42.477 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.447+0000 7f330737d640 1 -- 172.21.15.92:0/1262159250 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32f804cc60 con 0x7f32f8034230 2024-09-11T00:14:42.478 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.448+0000 7f40752c6640 1 -- 172.21.15.92:0/4093904735 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4070072040 con 0x7f40700ad890 2024-09-11T00:14:42.478 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.448+0000 7f2c77fff640 1 -- 172.21.15.92:0/2540364061 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c78004470 con 0x7f2c8404eb20 2024-09-11T00:14:42.478 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.448+0000 7f0a06ffd640 1 --2- 172.21.15.92:0/1811480199 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f09f8077fc0 0x7f09f807a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:42.478 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.448+0000 7fd33db56640 1 --2- 172.21.15.92:0/3965793367 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7fd31c088fd0 0x7fd31c08b490 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fd33813b270 tx=0x7fd3280078a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:14:42.479 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.448+0000 7f997ffff640 1 --2- 172.21.15.92:0/1312832381 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f9964077f70 0x7f996407a430 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f99800a1d00 tx=0x7f996c0090e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:14:42.479 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.448+0000 7f0a15d9b640 1 --2- 172.21.15.92:0/1811480199 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f09f8077fc0 0x7f09f807a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:42.479 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.449+0000 7f2c90991640 1 -- 172.21.15.92:0/2540364061 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2c6c005290 con 0x7f2c8404eb20 2024-09-11T00:14:42.480 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.449+0000 7f330737d640 1 -- 172.21.15.92:0/1262159250 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f32f8181300 con 0x7f32f8034230 2024-09-11T00:14:42.480 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.449+0000 7f0a15d9b640 1 --2- 172.21.15.92:0/1811480199 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f09f8077fc0 0x7f09f807a480 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f0a0c034000 tx=0x7f0a0c004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:14:42.480 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.452+0000 7f0a06ffd640 1 -- 172.21.15.92:0/1811480199 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f0a0805e7c0 con 0x7f0a1003be30 2024-09-11T00:14:42.480 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.452+0000 7f997d7fa640 1 -- 172.21.15.92:0/1312832381 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f9974014030 con 0x7f99800d0580 2024-09-11T00:14:42.481 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.452+0000 7f32f5ffb640 1 -- 172.21.15.92:0/1262159250 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f32f00071d0 con 0x7f32f8034230 2024-09-11T00:14:42.481 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.452+0000 7f32f5ffb640 1 -- 172.21.15.92:0/1262159250 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32f0007640 con 0x7f32f8034230 2024-09-11T00:14:42.481 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.453+0000 7fafc8ff9640 1 -- 172.21.15.92:0/1780860682 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafc00050d0 con 0x7fafc4054860 2024-09-11T00:14:42.481 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.453+0000 7f40577fe640 1 -- 172.21.15.92:0/4093904735 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f406802d070 con 0x7f40700ad890 2024-09-11T00:14:42.482 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.453+0000 7f40577fe640 1 -- 172.21.15.92:0/4093904735 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4068037040 con 0x7f40700ad890 2024-09-11T00:14:42.482 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.453+0000 7fafd145d640 1 -- 172.21.15.92:0/1780860682 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fafc40e19c0 con 0x7fafc4054860 2024-09-11T00:14:42.482 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.453+0000 7fafd145d640 1 -- 172.21.15.92:0/1780860682 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fafc40e1670 con 0x7fafc4054860 2024-09-11T00:14:42.482 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.454+0000 7f2c77fff640 1 -- 172.21.15.92:0/2540364061 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f2c780035f0 con 0x7f2c8404eb20 2024-09-11T00:14:42.482 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.454+0000 7f2c77fff640 1 --2- 172.21.15.92:0/2540364061 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f2c70077fc0 0x7f2c7007a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:42.483 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.454+0000 7fafd145d640 1 -- 172.21.15.92:0/1780860682 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fafc4054c40 con 0x7fafc4054860 2024-09-11T00:14:42.483 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.454+0000 7f2c8affd640 1 --2- 172.21.15.92:0/2540364061 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f2c70077fc0 0x7f2c7007a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:42.483 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.455+0000 7f2c8affd640 1 --2- 172.21.15.92:0/2540364061 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f2c70077fc0 0x7f2c7007a480 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f2c84006680 tx=0x7f2c8c066930 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:14:42.483 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.457+0000 7fd32effd640 1 -- 172.21.15.92:0/3965793367 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fd334083b00 con 0x7fd338072560 2024-09-11T00:14:42.484 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.461+0000 7f2c77fff640 1 -- 172.21.15.92:0/2540364061 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f2c7805ee90 con 0x7f2c8404eb20 2024-09-11T00:14:42.484 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.462+0000 7f0a06ffd640 1 -- 172.21.15.92:0/1811480199 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f0a1017e9b0 con 0x7f0a1003be30 2024-09-11T00:14:42.484 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.462+0000 7fafc8ff9640 1 -- 172.21.15.92:0/1780860682 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fafc0005270 con 0x7fafc4054860 2024-09-11T00:14:42.484 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.463+0000 7fafc8ff9640 1 -- 172.21.15.92:0/1780860682 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafc000a880 con 0x7fafc4054860 2024-09-11T00:14:42.485 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.464+0000 7f40577fe640 1 -- 172.21.15.92:0/4093904735 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f4068004040 con 0x7f40700ad890 2024-09-11T00:14:42.485 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.464+0000 7f32f5ffb640 1 -- 172.21.15.92:0/1262159250 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f32f0006790 con 0x7f32f8034230 2024-09-11T00:14:42.485 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.464+0000 7f40577fe640 1 --2- 172.21.15.92:0/4093904735 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f405c077f70 0x7f405c07a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:42.485 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.465+0000 7f32f5ffb640 1 --2- 172.21.15.92:0/1262159250 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f32e4077fa0 0x7f32e407a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:42.486 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.465+0000 7f406e7fc640 1 --2- 172.21.15.92:0/4093904735 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f405c077f70 0x7f405c07a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:42.486 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.465+0000 7f3305119640 1 --2- 172.21.15.92:0/1262159250 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f32e4077fa0 0x7f32e407a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:42.486 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.466+0000 7f406e7fc640 1 --2- 172.21.15.92:0/4093904735 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f405c077f70 0x7f405c07a430 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f40700aa7b0 tx=0x7f4064009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:14:42.486 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.466+0000 7f3305119640 1 --2- 172.21.15.92:0/1262159250 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f32e4077fa0 0x7f32e407a460 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f32fc001080 tx=0x7f32fc0079b0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:14:42.487 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.471+0000 7f2c77fff640 1 -- 172.21.15.92:0/2540364061 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f2c78014030 con 0x7f2c8404eb20 2024-09-11T00:14:42.487 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.471+0000 7f40577fe640 1 -- 172.21.15.92:0/4093904735 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f406807f420 con 0x7f40700ad890 2024-09-11T00:14:42.487 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.472+0000 7f32f5ffb640 1 -- 172.21.15.92:0/1262159250 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f32f0015e10 con 0x7f32f8034230 2024-09-11T00:14:42.488 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.474+0000 7fafc8ff9640 1 -- 172.21.15.92:0/1780860682 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fafc000aa20 con 0x7fafc4054860 2024-09-11T00:14:42.488 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.475+0000 7fafc8ff9640 1 --2- 172.21.15.92:0/1780860682 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7fafb0077f70 0x7fafb007a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:42.488 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.475+0000 7fafcbfff640 1 --2- 172.21.15.92:0/1780860682 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7fafb0077f70 0x7fafb007a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:42.488 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.476+0000 7fafcbfff640 1 --2- 172.21.15.92:0/1780860682 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7fafb0077f70 0x7fafb007a430 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fafc400d3f0 tx=0x7fafcc066930 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:14:42.488 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.482+0000 7f40577fe640 1 -- 172.21.15.92:0/4093904735 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f4070072040 con 0x7f40700ad890 2024-09-11T00:14:42.495 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.492+0000 7fafc8ff9640 1 -- 172.21.15.92:0/1780860682 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fafc000ad40 con 0x7fafc4054860 2024-09-11T00:14:42.495 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.491+0000 7f32f5ffb640 1 -- 172.21.15.92:0/1262159250 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f32f0062be0 con 0x7f32f8034230 2024-09-11T00:14:42.501 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.500+0000 7fafc8ff9640 1 -- 172.21.15.92:0/1780860682 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fafc0062e20 con 0x7fafc4054860 2024-09-11T00:14:42.770 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.768+0000 7f90ac3d3640 1 -- 172.21.15.92:0/1865957213 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f908c005580 con 0x7f909c034340 2024-09-11T00:14:42.770 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.769+0000 7f909affd640 1 -- 172.21.15.92:0/1865957213 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f9094072b30 con 0x7f909c034340 2024-09-11T00:14:42.770 INFO:teuthology.orchestra.run.smithi092.stdout:64424509450 2024-09-11T00:14:42.774 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.773+0000 7f9098ff9640 1 -- 172.21.15.92:0/1865957213 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f9088078070 msgr2=0x7f908807a530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:42.774 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.773+0000 7f9098ff9640 1 --2- 172.21.15.92:0/1865957213 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f9088078070 0x7f908807a530 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f909c051a20 tx=0x7f90a0014040 comp rx=0 tx=0).stop 2024-09-11T00:14:42.774 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.773+0000 7f9098ff9640 1 -- 172.21.15.92:0/1865957213 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f909c034340 msgr2=0x7f909c048480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:42.775 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.773+0000 7f9098ff9640 1 --2- 172.21.15.92:0/1865957213 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f909c034340 0x7f909c048480 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f9094009f70 tx=0x7f909400bb60 comp rx=0 tx=0).stop 2024-09-11T00:14:42.775 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.773+0000 7f9098ff9640 1 -- 172.21.15.92:0/1865957213 shutdown_connections 2024-09-11T00:14:42.776 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.773+0000 7f9098ff9640 1 --2- 172.21.15.92:0/1865957213 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f9088078070 0x7f908807a530 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:42.776 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.773+0000 7f9098ff9640 1 --2- 172.21.15.92:0/1865957213 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f909c0df7a0 0x7f909c054710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:42.776 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.774+0000 7f9098ff9640 1 --2- 172.21.15.92:0/1865957213 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f909c0370c0 0x7f909c0541d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:42.776 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.774+0000 7f9098ff9640 1 --2- 172.21.15.92:0/1865957213 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f909c034340 0x7f909c048480 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:42.776 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.774+0000 7f9098ff9640 1 -- 172.21.15.92:0/1865957213 >> 172.21.15.92:0/1865957213 conn(0x7f909c01e890 msgr2=0x7f909c055640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:14:42.776 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.774+0000 7f9098ff9640 1 -- 172.21.15.92:0/1865957213 shutdown_connections 2024-09-11T00:14:42.776 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.774+0000 7f9098ff9640 1 -- 172.21.15.92:0/1865957213 wait complete. 2024-09-11T00:14:42.791 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509450 got 64424509450 for osd.5 2024-09-11T00:14:42.792 DEBUG:teuthology.parallel:result is None 2024-09-11T00:14:42.831 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.829+0000 7f0a1759e640 1 -- 172.21.15.92:0/1811480199 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f0a100061b0 con 0x7f0a1003be30 2024-09-11T00:14:42.831 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.829+0000 7f0a06ffd640 1 -- 172.21.15.92:0/1811480199 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f0a08009e20 con 0x7f0a1003be30 2024-09-11T00:14:42.831 INFO:teuthology.orchestra.run.smithi092.stdout:64424509449 2024-09-11T00:14:42.834 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.832+0000 7f0a1759e640 1 -- 172.21.15.92:0/1811480199 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f09f8077fc0 msgr2=0x7f09f807a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:42.834 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.832+0000 7f0a1759e640 1 --2- 172.21.15.92:0/1811480199 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f09f8077fc0 0x7f09f807a480 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f0a0c034000 tx=0x7f0a0c004730 comp rx=0 tx=0).stop 2024-09-11T00:14:42.834 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.832+0000 7f0a1759e640 1 -- 172.21.15.92:0/1811480199 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0a1003be30 msgr2=0x7f0a100e49e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:42.834 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.832+0000 7f0a1759e640 1 --2- 172.21.15.92:0/1811480199 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0a1003be30 0x7f0a100e49e0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f0a0800d740 tx=0x7f0a0800dc00 comp rx=0 tx=0).stop 2024-09-11T00:14:42.834 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.832+0000 7f0a1759e640 1 -- 172.21.15.92:0/1811480199 shutdown_connections 2024-09-11T00:14:42.834 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.832+0000 7f0a1759e640 1 --2- 172.21.15.92:0/1811480199 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f09f8077fc0 0x7f09f807a480 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:42.834 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.832+0000 7f0a1759e640 1 --2- 172.21.15.92:0/1811480199 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0a1003db70 0x7f0a100dc240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:42.834 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.832+0000 7f0a1759e640 1 --2- 172.21.15.92:0/1811480199 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f0a100e6530 0x7f0a1017e470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:42.834 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.832+0000 7f0a1759e640 1 --2- 172.21.15.92:0/1811480199 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0a1003be30 0x7f0a100e49e0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:42.834 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.832+0000 7f0a1759e640 1 -- 172.21.15.92:0/1811480199 >> 172.21.15.92:0/1811480199 conn(0x7f0a1000e1e0 msgr2=0x7f0a100066d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:14:42.834 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.832+0000 7f0a1759e640 1 -- 172.21.15.92:0/1811480199 shutdown_connections 2024-09-11T00:14:42.834 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.832+0000 7f0a1759e640 1 -- 172.21.15.92:0/1811480199 wait complete. 2024-09-11T00:14:42.839 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.838+0000 7f9986f24640 1 -- 172.21.15.92:0/1312832381 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f99800b7770 con 0x7f99800d0580 2024-09-11T00:14:42.839 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.838+0000 7f997d7fa640 1 -- 172.21.15.92:0/1312832381 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f9974062a90 con 0x7f99800d0580 2024-09-11T00:14:42.840 INFO:teuthology.orchestra.run.smithi092.stdout:64424509449 2024-09-11T00:14:42.843 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.842+0000 7f9986f24640 1 -- 172.21.15.92:0/1312832381 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f9964077f70 msgr2=0x7f996407a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:42.843 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.842+0000 7f9986f24640 1 --2- 172.21.15.92:0/1312832381 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f9964077f70 0x7f996407a430 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f99800a1d00 tx=0x7f996c0090e0 comp rx=0 tx=0).stop 2024-09-11T00:14:42.844 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.842+0000 7f9986f24640 1 -- 172.21.15.92:0/1312832381 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f99800d0580 msgr2=0x7f99800b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:42.844 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.842+0000 7f9986f24640 1 --2- 172.21.15.92:0/1312832381 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f99800d0580 0x7f99800b7230 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f997400c970 tx=0x7f997400ce30 comp rx=0 tx=0).stop 2024-09-11T00:14:42.844 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.842+0000 7f9986f24640 1 -- 172.21.15.92:0/1312832381 shutdown_connections 2024-09-11T00:14:42.844 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.842+0000 7f9986f24640 1 --2- 172.21.15.92:0/1312832381 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f9964077f70 0x7f996407a430 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:42.844 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.842+0000 7f9986f24640 1 --2- 172.21.15.92:0/1312832381 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f998015dd10 0x7f99800ccb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:42.844 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.842+0000 7f9986f24640 1 --2- 172.21.15.92:0/1312832381 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f99800d2720 0x7f998015ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:42.844 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.842+0000 7f9986f24640 1 --2- 172.21.15.92:0/1312832381 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f99800d0580 0x7f99800b7230 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:42.844 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.842+0000 7f9986f24640 1 -- 172.21.15.92:0/1312832381 >> 172.21.15.92:0/1312832381 conn(0x7f998009ceb0 msgr2=0x7f99800b0a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:14:42.845 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.842+0000 7f9986f24640 1 -- 172.21.15.92:0/1312832381 shutdown_connections 2024-09-11T00:14:42.845 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.842+0000 7f9986f24640 1 -- 172.21.15.92:0/1312832381 wait complete. 2024-09-11T00:14:42.846 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509449 got 64424509449 for osd.4 2024-09-11T00:14:42.846 DEBUG:teuthology.parallel:result is None 2024-09-11T00:14:42.859 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509449 got 64424509449 for osd.3 2024-09-11T00:14:42.860 DEBUG:teuthology.parallel:result is None 2024-09-11T00:14:42.876 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.875+0000 7f40752c6640 1 -- 172.21.15.92:0/4093904735 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f40700b4960 con 0x7f40700ad890 2024-09-11T00:14:42.877 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.875+0000 7f40577fe640 1 -- 172.21.15.92:0/4093904735 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f4068088e20 con 0x7f40700ad890 2024-09-11T00:14:42.877 INFO:teuthology.orchestra.run.smithi092.stdout:64424509451 2024-09-11T00:14:42.878 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.876+0000 7fd3405bb640 1 -- 172.21.15.92:0/3965793367 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7fd320005850 con 0x7fd338072560 2024-09-11T00:14:42.878 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.877+0000 7fd32effd640 1 -- 172.21.15.92:0/3965793367 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fd334083400 con 0x7fd338072560 2024-09-11T00:14:42.878 INFO:teuthology.orchestra.run.smithi092.stdout:64424509450 2024-09-11T00:14:42.879 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.877+0000 7f40752c6640 1 -- 172.21.15.92:0/4093904735 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f405c077f70 msgr2=0x7f405c07a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:42.879 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.877+0000 7f40752c6640 1 --2- 172.21.15.92:0/4093904735 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f405c077f70 0x7f405c07a430 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f40700aa7b0 tx=0x7f4064009040 comp rx=0 tx=0).stop 2024-09-11T00:14:42.879 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.877+0000 7f40752c6640 1 -- 172.21.15.92:0/4093904735 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f40700ad890 msgr2=0x7f40700aceb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:42.879 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.877+0000 7f40752c6640 1 --2- 172.21.15.92:0/4093904735 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f40700ad890 0x7f40700aceb0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f4068009000 tx=0x7f40680338d0 comp rx=0 tx=0).stop 2024-09-11T00:14:42.879 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.877+0000 7f40752c6640 1 -- 172.21.15.92:0/4093904735 shutdown_connections 2024-09-11T00:14:42.879 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.877+0000 7f40752c6640 1 --2- 172.21.15.92:0/4093904735 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f405c077f70 0x7f405c07a430 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:42.880 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.877+0000 7f40752c6640 1 --2- 172.21.15.92:0/4093904735 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f40701477b0 0x7f40701f6dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:42.880 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.877+0000 7f40752c6640 1 --2- 172.21.15.92:0/4093904735 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f40700b3170 0x7f4070158ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:42.880 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.877+0000 7f40752c6640 1 --2- 172.21.15.92:0/4093904735 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f40700ad890 0x7f40700aceb0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:42.881 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.877+0000 7f40752c6640 1 -- 172.21.15.92:0/4093904735 >> 172.21.15.92:0/4093904735 conn(0x7f40700cfaf0 msgr2=0x7f4070072b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:14:42.881 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.877+0000 7f40752c6640 1 -- 172.21.15.92:0/4093904735 shutdown_connections 2024-09-11T00:14:42.881 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.877+0000 7f40752c6640 1 -- 172.21.15.92:0/4093904735 wait complete. 2024-09-11T00:14:42.882 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.880+0000 7fd3405bb640 1 -- 172.21.15.92:0/3965793367 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7fd31c088fd0 msgr2=0x7fd31c08b490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:42.882 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.880+0000 7fd3405bb640 1 --2- 172.21.15.92:0/3965793367 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7fd31c088fd0 0x7fd31c08b490 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fd33813b270 tx=0x7fd3280078a0 comp rx=0 tx=0).stop 2024-09-11T00:14:42.882 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.880+0000 7fd3405bb640 1 -- 172.21.15.92:0/3965793367 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd338072560 msgr2=0x7fd33813e840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:42.882 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.880+0000 7fd3405bb640 1 --2- 172.21.15.92:0/3965793367 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd338072560 0x7fd33813e840 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fd334009980 tx=0x7fd334032f00 comp rx=0 tx=0).stop 2024-09-11T00:14:42.882 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.880+0000 7fd3405bb640 1 -- 172.21.15.92:0/3965793367 shutdown_connections 2024-09-11T00:14:42.883 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.880+0000 7fd3405bb640 1 --2- 172.21.15.92:0/3965793367 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7fd31c088fd0 0x7fd31c08b490 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:42.883 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.880+0000 7fd3405bb640 1 --2- 172.21.15.92:0/3965793367 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd3380b30b0 0x7fd33813b760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:42.883 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.880+0000 7fd3405bb640 1 --2- 172.21.15.92:0/3965793367 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd3380b2cd0 0x7fd3381f87e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:42.883 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.880+0000 7fd3405bb640 1 --2- 172.21.15.92:0/3965793367 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd338072560 0x7fd33813e840 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:42.883 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.880+0000 7fd3405bb640 1 -- 172.21.15.92:0/3965793367 >> 172.21.15.92:0/3965793367 conn(0x7fd3380cfaf0 msgr2=0x7fd338147480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:14:42.883 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.880+0000 7fd3405bb640 1 -- 172.21.15.92:0/3965793367 shutdown_connections 2024-09-11T00:14:42.883 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.880+0000 7fd3405bb640 1 -- 172.21.15.92:0/3965793367 wait complete. 2024-09-11T00:14:42.890 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509451 got 64424509451 for osd.1 2024-09-11T00:14:42.890 DEBUG:teuthology.parallel:result is None 2024-09-11T00:14:42.892 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.891+0000 7f2c90991640 1 -- 172.21.15.92:0/2540364061 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f2c6c005850 con 0x7f2c8404eb20 2024-09-11T00:14:42.892 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.891+0000 7f2c77fff640 1 -- 172.21.15.92:0/2540364061 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f2c78063320 con 0x7f2c8404eb20 2024-09-11T00:14:42.893 INFO:teuthology.orchestra.run.smithi092.stdout:64424509450 2024-09-11T00:14:42.894 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509450 got 64424509450 for osd.7 2024-09-11T00:14:42.894 DEBUG:teuthology.parallel:result is None 2024-09-11T00:14:42.896 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.894+0000 7f2c90991640 1 -- 172.21.15.92:0/2540364061 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f2c70077fc0 msgr2=0x7f2c7007a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:42.896 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.894+0000 7f2c90991640 1 --2- 172.21.15.92:0/2540364061 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f2c70077fc0 0x7f2c7007a480 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f2c84006680 tx=0x7f2c8c066930 comp rx=0 tx=0).stop 2024-09-11T00:14:42.896 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.894+0000 7f2c90991640 1 -- 172.21.15.92:0/2540364061 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2c8404eb20 msgr2=0x7f2c840dede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:42.896 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.894+0000 7f2c90991640 1 --2- 172.21.15.92:0/2540364061 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2c8404eb20 0x7f2c840dede0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f2c7800ca30 tx=0x7f2c7800cef0 comp rx=0 tx=0).stop 2024-09-11T00:14:42.896 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.894+0000 7f2c90991640 1 -- 172.21.15.92:0/2540364061 shutdown_connections 2024-09-11T00:14:42.896 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.894+0000 7f2c90991640 1 --2- 172.21.15.92:0/2540364061 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f2c70077fc0 0x7f2c7007a480 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:42.896 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.894+0000 7f2c90991640 1 --2- 172.21.15.92:0/2540364061 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2c840e6d90 0x7f2c8404a4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:42.896 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.894+0000 7f2c90991640 1 --2- 172.21.15.92:0/2540364061 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2c840e69b0 0x7f2c84031a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:42.896 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.894+0000 7f2c90991640 1 --2- 172.21.15.92:0/2540364061 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2c8404eb20 0x7f2c840dede0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:42.897 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.894+0000 7f2c90991640 1 -- 172.21.15.92:0/2540364061 >> 172.21.15.92:0/2540364061 conn(0x7f2c8401d770 msgr2=0x7f2c840dcca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:14:42.897 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.894+0000 7f2c90991640 1 -- 172.21.15.92:0/2540364061 shutdown_connections 2024-09-11T00:14:42.897 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.894+0000 7f2c90991640 1 -- 172.21.15.92:0/2540364061 wait complete. 2024-09-11T00:14:42.901 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.900+0000 7fafd145d640 1 -- 172.21.15.92:0/1780860682 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7fafc40de8c0 con 0x7fafc4054860 2024-09-11T00:14:42.902 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.900+0000 7fafc8ff9640 1 -- 172.21.15.92:0/1780860682 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fafc0062720 con 0x7fafc4054860 2024-09-11T00:14:42.902 INFO:teuthology.orchestra.run.smithi092.stdout:60129542155 2024-09-11T00:14:42.902 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.900+0000 7f330737d640 1 -- 172.21.15.92:0/1262159250 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f32f80369c0 con 0x7f32f8034230 2024-09-11T00:14:42.903 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.901+0000 7f32f5ffb640 1 -- 172.21.15.92:0/1262159250 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f32f80369c0 con 0x7f32f8034230 2024-09-11T00:14:42.903 INFO:teuthology.orchestra.run.smithi092.stdout:55834574859 2024-09-11T00:14:42.905 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.903+0000 7fafd145d640 1 -- 172.21.15.92:0/1780860682 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7fafb0077f70 msgr2=0x7fafb007a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:42.905 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.903+0000 7fafd145d640 1 --2- 172.21.15.92:0/1780860682 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7fafb0077f70 0x7fafb007a430 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fafc400d3f0 tx=0x7fafcc066930 comp rx=0 tx=0).stop 2024-09-11T00:14:42.905 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.903+0000 7fafd145d640 1 -- 172.21.15.92:0/1780860682 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fafc4054860 msgr2=0x7fafc4189c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:42.906 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.903+0000 7fafd145d640 1 --2- 172.21.15.92:0/1780860682 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fafc4054860 0x7fafc4189c60 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fafc000c730 tx=0x7fafc000cbf0 comp rx=0 tx=0).stop 2024-09-11T00:14:42.906 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.903+0000 7fafd145d640 1 -- 172.21.15.92:0/1780860682 shutdown_connections 2024-09-11T00:14:42.906 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.903+0000 7fafd145d640 1 --2- 172.21.15.92:0/1780860682 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7fafb0077f70 0x7fafb007a430 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:42.906 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.903+0000 7fafd145d640 1 --2- 172.21.15.92:0/1780860682 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fafc4054860 0x7fafc4189c60 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:42.906 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.903+0000 7fafd145d640 1 --2- 172.21.15.92:0/1780860682 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fafc4034ba0 0x7fafc4006620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:42.906 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.903+0000 7fafd145d640 1 --2- 172.21.15.92:0/1780860682 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fafc4034650 0x7fafc4008a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:42.906 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.903+0000 7fafd145d640 1 -- 172.21.15.92:0/1780860682 >> 172.21.15.92:0/1780860682 conn(0x7fafc401e890 msgr2=0x7fafc400ae10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:14:42.906 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.903+0000 7fafd145d640 1 -- 172.21.15.92:0/1780860682 shutdown_connections 2024-09-11T00:14:42.906 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.903+0000 7fafd145d640 1 -- 172.21.15.92:0/1780860682 wait complete. 2024-09-11T00:14:42.907 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.903+0000 7f330737d640 1 -- 172.21.15.92:0/1262159250 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f32e4077fa0 msgr2=0x7f32e407a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:42.907 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.903+0000 7f330737d640 1 --2- 172.21.15.92:0/1262159250 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f32e4077fa0 0x7f32e407a460 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f32fc001080 tx=0x7f32fc0079b0 comp rx=0 tx=0).stop 2024-09-11T00:14:42.907 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.903+0000 7f330737d640 1 -- 172.21.15.92:0/1262159250 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f32f8034230 msgr2=0x7f32f80de6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:42.907 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.903+0000 7f330737d640 1 --2- 172.21.15.92:0/1262159250 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f32f8034230 0x7f32f80de6c0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f32f000c490 tx=0x7f32f000c950 comp rx=0 tx=0).stop 2024-09-11T00:14:42.907 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.903+0000 7f330737d640 1 -- 172.21.15.92:0/1262159250 shutdown_connections 2024-09-11T00:14:42.907 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.903+0000 7f330737d640 1 --2- 172.21.15.92:0/1262159250 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f32e4077fa0 0x7f32e407a460 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:42.907 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.903+0000 7f330737d640 1 --2- 172.21.15.92:0/1262159250 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f32f80e1fb0 0x7f32f80dc5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:42.907 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.903+0000 7f330737d640 1 --2- 172.21.15.92:0/1262159250 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f32f8034230 0x7f32f80de6c0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:42.908 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.903+0000 7f330737d640 1 --2- 172.21.15.92:0/1262159250 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f32f8006ed0 0x7f32f804c0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:42.908 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.903+0000 7f330737d640 1 -- 172.21.15.92:0/1262159250 >> 172.21.15.92:0/1262159250 conn(0x7f32f801d770 msgr2=0x7f32f800ab30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:14:42.908 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.903+0000 7f330737d640 1 -- 172.21.15.92:0/1262159250 shutdown_connections 2024-09-11T00:14:42.908 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:42.903+0000 7f330737d640 1 -- 172.21.15.92:0/1262159250 wait complete. 2024-09-11T00:14:42.908 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509450 got 64424509450 for osd.0 2024-09-11T00:14:42.909 DEBUG:teuthology.parallel:result is None 2024-09-11T00:14:42.916 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542154 got 60129542155 for osd.2 2024-09-11T00:14:42.916 DEBUG:teuthology.parallel:result is None 2024-09-11T00:14:42.917 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574859 for osd.6 2024-09-11T00:14:42.917 DEBUG:teuthology.parallel:result is None 2024-09-11T00:14:42.917 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-11T00:14:42.917 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T00:14:43.059 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:43.057+0000 7f143b732640 1 -- 172.21.15.92:0/1689305598 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1420004800 msgr2=0x7f1420004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:43.059 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:43.057+0000 7f143b732640 1 --2- 172.21.15.92:0/1689305598 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1420004800 0x7f1420004c80 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f1430009b50 tx=0x7f1420005830 comp rx=0 tx=0).stop 2024-09-11T00:14:43.059 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:43.057+0000 7f143b732640 1 -- 172.21.15.92:0/1689305598 shutdown_connections 2024-09-11T00:14:43.059 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:43.057+0000 7f143b732640 1 --2- 172.21.15.92:0/1689305598 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1420004800 0x7f1420004c80 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:43.059 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:43.057+0000 7f143b732640 1 -- 172.21.15.92:0/1689305598 >> 172.21.15.92:0/1689305598 conn(0x7f14340d3f70 msgr2=0x7f14340d4350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:14:43.059 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:43.057+0000 7f143b732640 1 -- 172.21.15.92:0/1689305598 shutdown_connections 2024-09-11T00:14:43.059 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:43.057+0000 7f143b732640 1 -- 172.21.15.92:0/1689305598 wait complete. 2024-09-11T00:14:43.060 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:43.058+0000 7f143b732640 1 Processor -- start 2024-09-11T00:14:43.060 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:43.058+0000 7f143b732640 1 -- start start 2024-09-11T00:14:43.062 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:43.059+0000 7f143b732640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1420004800 0x7f14340cb040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:43.062 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:43.059+0000 7f143b732640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f14340cd2a0 0x7f14340cb580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:43.062 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:43.059+0000 7f143b732640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f14341494c0 0x7f1434149900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:43.062 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:43.059+0000 7f143b732640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f14340d24e0 con 0x7f14340cd2a0 2024-09-11T00:14:43.062 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:43.059+0000 7f143b732640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f14340d2f80 con 0x7f14341494c0 2024-09-11T00:14:43.062 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:43.059+0000 7f143b732640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f14340d2660 con 0x7f1420004800 2024-09-11T00:14:43.062 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:43.059+0000 7f1438ccd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f14340cd2a0 0x7f14340cb580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:43.062 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:43.059+0000 7f1438ccd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f14340cd2a0 0x7f14340cb580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:50696/0 (socket says 172.21.15.92:50696) 2024-09-11T00:14:43.062 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:43.059+0000 7f1438ccd640 1 -- 172.21.15.92:0/2472725705 learned_addr learned my addr 172.21.15.92:0/2472725705 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-11T00:14:43.062 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:43.059+0000 7f14394ce640 1 --2- 172.21.15.92:0/2472725705 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1420004800 0x7f14340cb040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:43.063 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:43.059+0000 7f1439ccf640 1 --2- 172.21.15.92:0/2472725705 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f14341494c0 0x7f1434149900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:43.063 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:43.059+0000 7f1438ccd640 1 -- 172.21.15.92:0/2472725705 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1420004800 msgr2=0x7f14340cb040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:43.063 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:43.059+0000 7f1438ccd640 1 --2- 172.21.15.92:0/2472725705 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1420004800 0x7f14340cb040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:43.063 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:43.059+0000 7f1438ccd640 1 -- 172.21.15.92:0/2472725705 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f14341494c0 msgr2=0x7f1434149900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:43.063 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:43.059+0000 7f1438ccd640 1 --2- 172.21.15.92:0/2472725705 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f14341494c0 0x7f1434149900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:43.063 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:43.059+0000 7f1438ccd640 1 -- 172.21.15.92:0/2472725705 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14340cd840 con 0x7f14340cd2a0 2024-09-11T00:14:43.063 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:43.059+0000 7f1439ccf640 1 --2- 172.21.15.92:0/2472725705 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f14341494c0 0x7f1434149900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:14:43.063 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:43.059+0000 7f1438ccd640 1 --2- 172.21.15.92:0/2472725705 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f14340cd2a0 0x7f14340cb580 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f1430009c70 tx=0x7f14300336f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:14:43.063 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:43.060+0000 7f1425ffb640 1 -- 172.21.15.92:0/2472725705 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1430038040 con 0x7f14340cd2a0 2024-09-11T00:14:43.063 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:43.060+0000 7f1425ffb640 1 -- 172.21.15.92:0/2472725705 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1430041070 con 0x7f14340cd2a0 2024-09-11T00:14:43.063 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:43.060+0000 7f143b732640 1 -- 172.21.15.92:0/2472725705 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f14340cdb20 con 0x7f14340cd2a0 2024-09-11T00:14:43.063 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:43.060+0000 7f1425ffb640 1 -- 172.21.15.92:0/2472725705 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f143003c430 con 0x7f14340cd2a0 2024-09-11T00:14:43.063 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:43.060+0000 7f143b732640 1 -- 172.21.15.92:0/2472725705 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14340ce0e0 con 0x7f14340cd2a0 2024-09-11T00:14:43.064 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:43.061+0000 7f143b732640 1 -- 172.21.15.92:0/2472725705 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f14340b6e50 con 0x7f14340cd2a0 2024-09-11T00:14:43.064 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:43.061+0000 7f1425ffb640 1 -- 172.21.15.92:0/2472725705 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f143003b070 con 0x7f14340cd2a0 2024-09-11T00:14:43.065 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:43.062+0000 7f1425ffb640 1 --2- 172.21.15.92:0/2472725705 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f1418077fa0 0x7f141807a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:43.065 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:43.062+0000 7f1425ffb640 1 -- 172.21.15.92:0/2472725705 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f14300ba4d0 con 0x7f14340cd2a0 2024-09-11T00:14:43.065 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:43.062+0000 7f14394ce640 1 --2- 172.21.15.92:0/2472725705 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f1418077fa0 0x7f141807a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:43.065 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:43.063+0000 7f14394ce640 1 --2- 172.21.15.92:0/2472725705 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f1418077fa0 0x7f141807a460 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f1428001120 tx=0x7f1428006040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:14:43.067 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:43.066+0000 7f1425ffb640 1 -- 172.21.15.92:0/2472725705 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f14300826d0 con 0x7f14340cd2a0 2024-09-11T00:14:43.237 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:43.236+0000 7f143b732640 1 -- 172.21.15.92:0/2472725705 --> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f143408dfa0 con 0x7f1418077fa0 2024-09-11T00:14:43.243 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:43.242+0000 7f1425ffb640 1 -- 172.21.15.92:0/2472725705 <== mgr.4100 v2:172.21.15.145:6800/325490785 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332523 (secure 0 0 0) 0x7f143408dfa0 con 0x7f1418077fa0 2024-09-11T00:14:43.247 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:14:43.249 INFO:teuthology.orchestra.run.smithi092.stderr:dumped all 2024-09-11T00:14:43.251 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:43.245+0000 7f143b732640 1 -- 172.21.15.92:0/2472725705 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f1418077fa0 msgr2=0x7f141807a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:43.251 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:43.245+0000 7f143b732640 1 --2- 172.21.15.92:0/2472725705 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f1418077fa0 0x7f141807a460 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f1428001120 tx=0x7f1428006040 comp rx=0 tx=0).stop 2024-09-11T00:14:43.251 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:43.245+0000 7f143b732640 1 -- 172.21.15.92:0/2472725705 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f14340cd2a0 msgr2=0x7f14340cb580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:43.251 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:43.245+0000 7f143b732640 1 --2- 172.21.15.92:0/2472725705 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f14340cd2a0 0x7f14340cb580 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f1430009c70 tx=0x7f14300336f0 comp rx=0 tx=0).stop 2024-09-11T00:14:43.251 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:43.245+0000 7f143b732640 1 -- 172.21.15.92:0/2472725705 shutdown_connections 2024-09-11T00:14:43.251 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:43.245+0000 7f143b732640 1 --2- 172.21.15.92:0/2472725705 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f1418077fa0 0x7f141807a460 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:43.251 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:43.245+0000 7f143b732640 1 --2- 172.21.15.92:0/2472725705 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f14341494c0 0x7f1434149900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:43.251 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:43.245+0000 7f143b732640 1 --2- 172.21.15.92:0/2472725705 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f14340cd2a0 0x7f14340cb580 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:43.251 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:43.245+0000 7f143b732640 1 --2- 172.21.15.92:0/2472725705 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1420004800 0x7f14340cb040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:43.251 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:43.245+0000 7f143b732640 1 -- 172.21.15.92:0/2472725705 >> 172.21.15.92:0/2472725705 conn(0x7f14340d3f70 msgr2=0x7f1434161a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:14:43.251 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:43.245+0000 7f143b732640 1 -- 172.21.15.92:0/2472725705 shutdown_connections 2024-09-11T00:14:43.252 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:43.245+0000 7f143b732640 1 -- 172.21.15.92:0/2472725705 wait complete. 2024-09-11T00:14:43.258 INFO:teuthology.orchestra.run.smithi092.stdout:{"pg_ready":true,"pg_map":{"version":37,"stamp":"2024-09-11T00:14:42.279272+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":149,"num_write_kb":1646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":114,"ondisk_log_size":114,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219464,"kb_used_data":3240,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755256,"statfs":{"total":773094113280,"available":772869382144,"internally_reserved":0,"allocated":3317760,"data_stored":2011304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2230,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003552"},"pg_stats":[{"pgid":"2.1f","version":"20'4","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:24.883591+0000","last_change":"2024-09-11T00:14:17.626124+0000","last_active":"2024-09-11T00:14:24.883591+0000","last_peered":"2024-09-11T00:14:24.883591+0000","last_clean":"2024-09-11T00:14:24.883591+0000","last_became_active":"2024-09-11T00:14:17.625641+0000","last_became_peered":"2024-09-11T00:14:17.625641+0000","last_unstale":"2024-09-11T00:14:24.883591+0000","last_undegraded":"2024-09-11T00:14:24.883591+0000","last_fullsized":"2024-09-11T00:14:24.883591+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:16.598908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:16.598908+0000","last_clean_scrub_stamp":"2024-09-11T00:14:16.598908+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:34:04.062752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:23.649065+0000","last_change":"2024-09-11T00:14:18.635793+0000","last_active":"2024-09-11T00:14:23.649065+0000","last_peered":"2024-09-11T00:14:23.649065+0000","last_clean":"2024-09-11T00:14:23.649065+0000","last_became_active":"2024-09-11T00:14:18.635544+0000","last_became_peered":"2024-09-11T00:14:18.635544+0000","last_unstale":"2024-09-11T00:14:23.649065+0000","last_undegraded":"2024-09-11T00:14:23.649065+0000","last_fullsized":"2024-09-11T00:14:23.649065+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_clean_scrub_stamp":"2024-09-11T00:14:17.606538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:24:44.702294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:23.648231+0000","last_change":"2024-09-11T00:14:22.691295+0000","last_active":"2024-09-11T00:14:23.648231+0000","last_peered":"2024-09-11T00:14:23.648231+0000","last_clean":"2024-09-11T00:14:23.648231+0000","last_became_active":"2024-09-11T00:14:22.690445+0000","last_became_peered":"2024-09-11T00:14:22.690445+0000","last_unstale":"2024-09-11T00:14:23.648231+0000","last_undegraded":"2024-09-11T00:14:23.648231+0000","last_fullsized":"2024-09-11T00:14:23.648231+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:21.633629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:21.633629+0000","last_clean_scrub_stamp":"2024-09-11T00:14:21.633629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:15:47.491554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:23.649169+0000","last_change":"2024-09-11T00:14:17.627802+0000","last_active":"2024-09-11T00:14:23.649169+0000","last_peered":"2024-09-11T00:14:23.649169+0000","last_clean":"2024-09-11T00:14:23.649169+0000","last_became_active":"2024-09-11T00:14:17.627530+0000","last_became_peered":"2024-09-11T00:14:17.627530+0000","last_unstale":"2024-09-11T00:14:23.649169+0000","last_undegraded":"2024-09-11T00:14:23.649169+0000","last_fullsized":"2024-09-11T00:14:23.649169+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:16.598908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:16.598908+0000","last_clean_scrub_stamp":"2024-09-11T00:14:16.598908+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:34:04.062752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:24.883447+0000","last_change":"2024-09-11T00:14:18.632474+0000","last_active":"2024-09-11T00:14:24.883447+0000","last_peered":"2024-09-11T00:14:24.883447+0000","last_clean":"2024-09-11T00:14:24.883447+0000","last_became_active":"2024-09-11T00:14:18.631284+0000","last_became_peered":"2024-09-11T00:14:18.631284+0000","last_unstale":"2024-09-11T00:14:24.883447+0000","last_undegraded":"2024-09-11T00:14:24.883447+0000","last_fullsized":"2024-09-11T00:14:24.883447+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_clean_scrub_stamp":"2024-09-11T00:14:17.606538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:25:01.082594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:23.650003+0000","last_change":"2024-09-11T00:14:22.677620+0000","last_active":"2024-09-11T00:14:23.650003+0000","last_peered":"2024-09-11T00:14:23.650003+0000","last_clean":"2024-09-11T00:14:23.650003+0000","last_became_active":"2024-09-11T00:14:22.677257+0000","last_became_peered":"2024-09-11T00:14:22.677257+0000","last_unstale":"2024-09-11T00:14:23.650003+0000","last_undegraded":"2024-09-11T00:14:23.650003+0000","last_fullsized":"2024-09-11T00:14:23.650003+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:21.633629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:21.633629+0000","last_clean_scrub_stamp":"2024-09-11T00:14:21.633629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:21:42.822631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:25.443495+0000","last_change":"2024-09-11T00:14:17.636163+0000","last_active":"2024-09-11T00:14:25.443495+0000","last_peered":"2024-09-11T00:14:25.443495+0000","last_clean":"2024-09-11T00:14:25.443495+0000","last_became_active":"2024-09-11T00:14:17.635781+0000","last_became_peered":"2024-09-11T00:14:17.635781+0000","last_unstale":"2024-09-11T00:14:25.443495+0000","last_undegraded":"2024-09-11T00:14:25.443495+0000","last_fullsized":"2024-09-11T00:14:25.443495+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:16.598908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:16.598908+0000","last_clean_scrub_stamp":"2024-09-11T00:14:16.598908+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:17:54.010379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:23.650820+0000","last_change":"2024-09-11T00:14:18.632344+0000","last_active":"2024-09-11T00:14:23.650820+0000","last_peered":"2024-09-11T00:14:23.650820+0000","last_clean":"2024-09-11T00:14:23.650820+0000","last_became_active":"2024-09-11T00:14:18.632058+0000","last_became_peered":"2024-09-11T00:14:18.632058+0000","last_unstale":"2024-09-11T00:14:23.650820+0000","last_undegraded":"2024-09-11T00:14:23.650820+0000","last_fullsized":"2024-09-11T00:14:23.650820+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_clean_scrub_stamp":"2024-09-11T00:14:17.606538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:41:28.876392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:23.650371+0000","last_change":"2024-09-11T00:14:22.675694+0000","last_active":"2024-09-11T00:14:23.650371+0000","last_peered":"2024-09-11T00:14:23.650371+0000","last_clean":"2024-09-11T00:14:23.650371+0000","last_became_active":"2024-09-11T00:14:22.675123+0000","last_became_peered":"2024-09-11T00:14:22.675123+0000","last_unstale":"2024-09-11T00:14:23.650371+0000","last_undegraded":"2024-09-11T00:14:23.650371+0000","last_fullsized":"2024-09-11T00:14:23.650371+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:21.633629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:21.633629+0000","last_clean_scrub_stamp":"2024-09-11T00:14:21.633629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:55:42.669376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:25.443208+0000","last_change":"2024-09-11T00:14:17.634109+0000","last_active":"2024-09-11T00:14:25.443208+0000","last_peered":"2024-09-11T00:14:25.443208+0000","last_clean":"2024-09-11T00:14:25.443208+0000","last_became_active":"2024-09-11T00:14:17.633815+0000","last_became_peered":"2024-09-11T00:14:17.633815+0000","last_unstale":"2024-09-11T00:14:25.443208+0000","last_undegraded":"2024-09-11T00:14:25.443208+0000","last_fullsized":"2024-09-11T00:14:25.443208+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:16.598908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:16.598908+0000","last_clean_scrub_stamp":"2024-09-11T00:14:16.598908+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:43:47.266406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:23.651249+0000","last_change":"2024-09-11T00:14:18.633804+0000","last_active":"2024-09-11T00:14:23.651249+0000","last_peered":"2024-09-11T00:14:23.651249+0000","last_clean":"2024-09-11T00:14:23.651249+0000","last_became_active":"2024-09-11T00:14:18.633530+0000","last_became_peered":"2024-09-11T00:14:18.633530+0000","last_unstale":"2024-09-11T00:14:23.651249+0000","last_undegraded":"2024-09-11T00:14:23.651249+0000","last_fullsized":"2024-09-11T00:14:23.651249+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_clean_scrub_stamp":"2024-09-11T00:14:17.606538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:28:10.132283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:23.650244+0000","last_change":"2024-09-11T00:14:22.674158+0000","last_active":"2024-09-11T00:14:23.650244+0000","last_peered":"2024-09-11T00:14:23.650244+0000","last_clean":"2024-09-11T00:14:23.650244+0000","last_became_active":"2024-09-11T00:14:22.673563+0000","last_became_peered":"2024-09-11T00:14:22.673563+0000","last_unstale":"2024-09-11T00:14:23.650244+0000","last_undegraded":"2024-09-11T00:14:23.650244+0000","last_fullsized":"2024-09-11T00:14:23.650244+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:21.633629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:21.633629+0000","last_clean_scrub_stamp":"2024-09-11T00:14:21.633629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:34:20.263638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:24.934581+0000","last_change":"2024-09-11T00:14:18.641584+0000","last_active":"2024-09-11T00:14:24.934581+0000","last_peered":"2024-09-11T00:14:24.934581+0000","last_clean":"2024-09-11T00:14:24.934581+0000","last_became_active":"2024-09-11T00:14:18.641317+0000","last_became_peered":"2024-09-11T00:14:18.641317+0000","last_unstale":"2024-09-11T00:14:24.934581+0000","last_undegraded":"2024-09-11T00:14:24.934581+0000","last_fullsized":"2024-09-11T00:14:24.934581+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_clean_scrub_stamp":"2024-09-11T00:14:17.606538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:44:05.910673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:25.443377+0000","last_change":"2024-09-11T00:14:17.636350+0000","last_active":"2024-09-11T00:14:25.443377+0000","last_peered":"2024-09-11T00:14:25.443377+0000","last_clean":"2024-09-11T00:14:25.443377+0000","last_became_active":"2024-09-11T00:14:17.636071+0000","last_became_peered":"2024-09-11T00:14:17.636071+0000","last_unstale":"2024-09-11T00:14:25.443377+0000","last_undegraded":"2024-09-11T00:14:25.443377+0000","last_fullsized":"2024-09-11T00:14:25.443377+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:16.598908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:16.598908+0000","last_clean_scrub_stamp":"2024-09-11T00:14:16.598908+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:01:31.822965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:23.651799+0000","last_change":"2024-09-11T00:14:22.669178+0000","last_active":"2024-09-11T00:14:23.651799+0000","last_peered":"2024-09-11T00:14:23.651799+0000","last_clean":"2024-09-11T00:14:23.651799+0000","last_became_active":"2024-09-11T00:14:22.668916+0000","last_became_peered":"2024-09-11T00:14:22.668916+0000","last_unstale":"2024-09-11T00:14:23.651799+0000","last_undegraded":"2024-09-11T00:14:23.651799+0000","last_fullsized":"2024-09-11T00:14:23.651799+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:21.633629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:21.633629+0000","last_clean_scrub_stamp":"2024-09-11T00:14:21.633629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:52:50.029560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:23.648642+0000","last_change":"2024-09-11T00:14:18.632035+0000","last_active":"2024-09-11T00:14:23.648642+0000","last_peered":"2024-09-11T00:14:23.648642+0000","last_clean":"2024-09-11T00:14:23.648642+0000","last_became_active":"2024-09-11T00:14:18.631678+0000","last_became_peered":"2024-09-11T00:14:18.631678+0000","last_unstale":"2024-09-11T00:14:23.648642+0000","last_undegraded":"2024-09-11T00:14:23.648642+0000","last_fullsized":"2024-09-11T00:14:23.648642+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_clean_scrub_stamp":"2024-09-11T00:14:17.606538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:19:35.541198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:25.448740+0000","last_change":"2024-09-11T00:14:17.632840+0000","last_active":"2024-09-11T00:14:25.448740+0000","last_peered":"2024-09-11T00:14:25.448740+0000","last_clean":"2024-09-11T00:14:25.448740+0000","last_became_active":"2024-09-11T00:14:17.632551+0000","last_became_peered":"2024-09-11T00:14:17.632551+0000","last_unstale":"2024-09-11T00:14:25.448740+0000","last_undegraded":"2024-09-11T00:14:25.448740+0000","last_fullsized":"2024-09-11T00:14:25.448740+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:16.598908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:16.598908+0000","last_clean_scrub_stamp":"2024-09-11T00:14:16.598908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:11:19.690215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:23.651772+0000","last_change":"2024-09-11T00:14:22.675212+0000","last_active":"2024-09-11T00:14:23.651772+0000","last_peered":"2024-09-11T00:14:23.651772+0000","last_clean":"2024-09-11T00:14:23.651772+0000","last_became_active":"2024-09-11T00:14:22.674046+0000","last_became_peered":"2024-09-11T00:14:22.674046+0000","last_unstale":"2024-09-11T00:14:23.651772+0000","last_undegraded":"2024-09-11T00:14:23.651772+0000","last_fullsized":"2024-09-11T00:14:23.651772+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:21.633629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:21.633629+0000","last_clean_scrub_stamp":"2024-09-11T00:14:21.633629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:58:10.766640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:23.648499+0000","last_change":"2024-09-11T00:14:18.625163+0000","last_active":"2024-09-11T00:14:23.648499+0000","last_peered":"2024-09-11T00:14:23.648499+0000","last_clean":"2024-09-11T00:14:23.648499+0000","last_became_active":"2024-09-11T00:14:18.624834+0000","last_became_peered":"2024-09-11T00:14:18.624834+0000","last_unstale":"2024-09-11T00:14:23.648499+0000","last_undegraded":"2024-09-11T00:14:23.648499+0000","last_fullsized":"2024-09-11T00:14:23.648499+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_clean_scrub_stamp":"2024-09-11T00:14:17.606538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:27:39.530704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:25.448769+0000","last_change":"2024-09-11T00:14:17.627946+0000","last_active":"2024-09-11T00:14:25.448769+0000","last_peered":"2024-09-11T00:14:25.448769+0000","last_clean":"2024-09-11T00:14:25.448769+0000","last_became_active":"2024-09-11T00:14:17.627667+0000","last_became_peered":"2024-09-11T00:14:17.627667+0000","last_unstale":"2024-09-11T00:14:25.448769+0000","last_undegraded":"2024-09-11T00:14:25.448769+0000","last_fullsized":"2024-09-11T00:14:25.448769+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:16.598908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:16.598908+0000","last_clean_scrub_stamp":"2024-09-11T00:14:16.598908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:01:31.822965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:25.448522+0000","last_change":"2024-09-11T00:14:22.692404+0000","last_active":"2024-09-11T00:14:25.448522+0000","last_peered":"2024-09-11T00:14:25.448522+0000","last_clean":"2024-09-11T00:14:25.448522+0000","last_became_active":"2024-09-11T00:14:22.691884+0000","last_became_peered":"2024-09-11T00:14:22.691884+0000","last_unstale":"2024-09-11T00:14:25.448522+0000","last_undegraded":"2024-09-11T00:14:25.448522+0000","last_fullsized":"2024-09-11T00:14:25.448522+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:21.633629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:21.633629+0000","last_clean_scrub_stamp":"2024-09-11T00:14:21.633629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:38:50.912075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:23.650767+0000","last_change":"2024-09-11T00:14:18.623840+0000","last_active":"2024-09-11T00:14:23.650767+0000","last_peered":"2024-09-11T00:14:23.650767+0000","last_clean":"2024-09-11T00:14:23.650767+0000","last_became_active":"2024-09-11T00:14:18.623528+0000","last_became_peered":"2024-09-11T00:14:18.623528+0000","last_unstale":"2024-09-11T00:14:23.650767+0000","last_undegraded":"2024-09-11T00:14:23.650767+0000","last_fullsized":"2024-09-11T00:14:23.650767+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_clean_scrub_stamp":"2024-09-11T00:14:17.606538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:22:17.854518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:25.442955+0000","last_change":"2024-09-11T00:14:17.633107+0000","last_active":"2024-09-11T00:14:25.442955+0000","last_peered":"2024-09-11T00:14:25.442955+0000","last_clean":"2024-09-11T00:14:25.442955+0000","last_became_active":"2024-09-11T00:14:17.632860+0000","last_became_peered":"2024-09-11T00:14:17.632860+0000","last_unstale":"2024-09-11T00:14:25.442955+0000","last_undegraded":"2024-09-11T00:14:25.442955+0000","last_fullsized":"2024-09-11T00:14:25.442955+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:16.598908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:16.598908+0000","last_clean_scrub_stamp":"2024-09-11T00:14:16.598908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:24:18.954419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:23.651684+0000","last_change":"2024-09-11T00:14:22.673902+0000","last_active":"2024-09-11T00:14:23.651684+0000","last_peered":"2024-09-11T00:14:23.651684+0000","last_clean":"2024-09-11T00:14:23.651684+0000","last_became_active":"2024-09-11T00:14:22.673397+0000","last_became_peered":"2024-09-11T00:14:22.673397+0000","last_unstale":"2024-09-11T00:14:23.651684+0000","last_undegraded":"2024-09-11T00:14:23.651684+0000","last_fullsized":"2024-09-11T00:14:23.651684+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:21.633629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:21.633629+0000","last_clean_scrub_stamp":"2024-09-11T00:14:21.633629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:24:27.330659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:24.883685+0000","last_change":"2024-09-11T00:14:18.632296+0000","last_active":"2024-09-11T00:14:24.883685+0000","last_peered":"2024-09-11T00:14:24.883685+0000","last_clean":"2024-09-11T00:14:24.883685+0000","last_became_active":"2024-09-11T00:14:18.632026+0000","last_became_peered":"2024-09-11T00:14:18.632026+0000","last_unstale":"2024-09-11T00:14:24.883685+0000","last_undegraded":"2024-09-11T00:14:24.883685+0000","last_fullsized":"2024-09-11T00:14:24.883685+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_clean_scrub_stamp":"2024-09-11T00:14:17.606538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:03:25.203629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:24.935388+0000","last_change":"2024-09-11T00:14:17.636547+0000","last_active":"2024-09-11T00:14:24.935388+0000","last_peered":"2024-09-11T00:14:24.935388+0000","last_clean":"2024-09-11T00:14:24.935388+0000","last_became_active":"2024-09-11T00:14:17.636264+0000","last_became_peered":"2024-09-11T00:14:17.636264+0000","last_unstale":"2024-09-11T00:14:24.935388+0000","last_undegraded":"2024-09-11T00:14:24.935388+0000","last_fullsized":"2024-09-11T00:14:24.935388+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:16.598908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:16.598908+0000","last_clean_scrub_stamp":"2024-09-11T00:14:16.598908+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:52:38.739834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:23.650267+0000","last_change":"2024-09-11T00:14:22.688870+0000","last_active":"2024-09-11T00:14:23.650267+0000","last_peered":"2024-09-11T00:14:23.650267+0000","last_clean":"2024-09-11T00:14:23.650267+0000","last_became_active":"2024-09-11T00:14:22.688144+0000","last_became_peered":"2024-09-11T00:14:22.688144+0000","last_unstale":"2024-09-11T00:14:23.650267+0000","last_undegraded":"2024-09-11T00:14:23.650267+0000","last_fullsized":"2024-09-11T00:14:23.650267+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:21.633629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:21.633629+0000","last_clean_scrub_stamp":"2024-09-11T00:14:21.633629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:47:00.821912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:23.649305+0000","last_change":"2024-09-11T00:14:18.644563+0000","last_active":"2024-09-11T00:14:23.649305+0000","last_peered":"2024-09-11T00:14:23.649305+0000","last_clean":"2024-09-11T00:14:23.649305+0000","last_became_active":"2024-09-11T00:14:18.644258+0000","last_became_peered":"2024-09-11T00:14:18.644258+0000","last_unstale":"2024-09-11T00:14:23.649305+0000","last_undegraded":"2024-09-11T00:14:23.649305+0000","last_fullsized":"2024-09-11T00:14:23.649305+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_clean_scrub_stamp":"2024-09-11T00:14:17.606538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:28:22.113765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:25.448636+0000","last_change":"2024-09-11T00:14:17.633279+0000","last_active":"2024-09-11T00:14:25.448636+0000","last_peered":"2024-09-11T00:14:25.448636+0000","last_clean":"2024-09-11T00:14:25.448636+0000","last_became_active":"2024-09-11T00:14:17.633023+0000","last_became_peered":"2024-09-11T00:14:17.633023+0000","last_unstale":"2024-09-11T00:14:25.448636+0000","last_undegraded":"2024-09-11T00:14:25.448636+0000","last_fullsized":"2024-09-11T00:14:25.448636+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:16.598908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:16.598908+0000","last_clean_scrub_stamp":"2024-09-11T00:14:16.598908+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:24:18.954419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:23.648131+0000","last_change":"2024-09-11T00:14:22.689579+0000","last_active":"2024-09-11T00:14:23.648131+0000","last_peered":"2024-09-11T00:14:23.648131+0000","last_clean":"2024-09-11T00:14:23.648131+0000","last_became_active":"2024-09-11T00:14:22.688060+0000","last_became_peered":"2024-09-11T00:14:22.688060+0000","last_unstale":"2024-09-11T00:14:23.648131+0000","last_undegraded":"2024-09-11T00:14:23.648131+0000","last_fullsized":"2024-09-11T00:14:23.648131+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:21.633629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:21.633629+0000","last_clean_scrub_stamp":"2024-09-11T00:14:21.633629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:02:04.039334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:25.448843+0000","last_change":"2024-09-11T00:14:18.622047+0000","last_active":"2024-09-11T00:14:25.448843+0000","last_peered":"2024-09-11T00:14:25.448843+0000","last_clean":"2024-09-11T00:14:25.448843+0000","last_became_active":"2024-09-11T00:14:18.621777+0000","last_became_peered":"2024-09-11T00:14:18.621777+0000","last_unstale":"2024-09-11T00:14:25.448843+0000","last_undegraded":"2024-09-11T00:14:25.448843+0000","last_fullsized":"2024-09-11T00:14:25.448843+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_clean_scrub_stamp":"2024-09-11T00:14:17.606538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:05:45.558170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:25.443646+0000","last_change":"2024-09-11T00:14:17.631489+0000","last_active":"2024-09-11T00:14:25.443646+0000","last_peered":"2024-09-11T00:14:25.443646+0000","last_clean":"2024-09-11T00:14:25.443646+0000","last_became_active":"2024-09-11T00:14:17.631206+0000","last_became_peered":"2024-09-11T00:14:17.631206+0000","last_unstale":"2024-09-11T00:14:25.443646+0000","last_undegraded":"2024-09-11T00:14:25.443646+0000","last_fullsized":"2024-09-11T00:14:25.443646+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:16.598908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:16.598908+0000","last_clean_scrub_stamp":"2024-09-11T00:14:16.598908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:51:33.532444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:24.883278+0000","last_change":"2024-09-11T00:14:22.689420+0000","last_active":"2024-09-11T00:14:24.883278+0000","last_peered":"2024-09-11T00:14:24.883278+0000","last_clean":"2024-09-11T00:14:24.883278+0000","last_became_active":"2024-09-11T00:14:22.689043+0000","last_became_peered":"2024-09-11T00:14:22.689043+0000","last_unstale":"2024-09-11T00:14:24.883278+0000","last_undegraded":"2024-09-11T00:14:24.883278+0000","last_fullsized":"2024-09-11T00:14:24.883278+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:21.633629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:21.633629+0000","last_clean_scrub_stamp":"2024-09-11T00:14:21.633629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:25:22.425586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:23.651349+0000","last_change":"2024-09-11T00:14:18.628564+0000","last_active":"2024-09-11T00:14:23.651349+0000","last_peered":"2024-09-11T00:14:23.651349+0000","last_clean":"2024-09-11T00:14:23.651349+0000","last_became_active":"2024-09-11T00:14:18.628095+0000","last_became_peered":"2024-09-11T00:14:18.628095+0000","last_unstale":"2024-09-11T00:14:23.651349+0000","last_undegraded":"2024-09-11T00:14:23.651349+0000","last_fullsized":"2024-09-11T00:14:23.651349+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_clean_scrub_stamp":"2024-09-11T00:14:17.606538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:51:25.519292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:25.448944+0000","last_change":"2024-09-11T00:14:17.629702+0000","last_active":"2024-09-11T00:14:25.448944+0000","last_peered":"2024-09-11T00:14:25.448944+0000","last_clean":"2024-09-11T00:14:25.448944+0000","last_became_active":"2024-09-11T00:14:17.629450+0000","last_became_peered":"2024-09-11T00:14:17.629450+0000","last_unstale":"2024-09-11T00:14:25.448944+0000","last_undegraded":"2024-09-11T00:14:25.448944+0000","last_fullsized":"2024-09-11T00:14:25.448944+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:16.598908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:16.598908+0000","last_clean_scrub_stamp":"2024-09-11T00:14:16.598908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:52:22.626375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:25.448461+0000","last_change":"2024-09-11T00:14:22.665536+0000","last_active":"2024-09-11T00:14:25.448461+0000","last_peered":"2024-09-11T00:14:25.448461+0000","last_clean":"2024-09-11T00:14:25.448461+0000","last_became_active":"2024-09-11T00:14:22.663100+0000","last_became_peered":"2024-09-11T00:14:22.663100+0000","last_unstale":"2024-09-11T00:14:25.448461+0000","last_undegraded":"2024-09-11T00:14:25.448461+0000","last_fullsized":"2024-09-11T00:14:25.448461+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:21.633629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:21.633629+0000","last_clean_scrub_stamp":"2024-09-11T00:14:21.633629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:28:14.159374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:23.650922+0000","last_change":"2024-09-11T00:14:18.642032+0000","last_active":"2024-09-11T00:14:23.650922+0000","last_peered":"2024-09-11T00:14:23.650922+0000","last_clean":"2024-09-11T00:14:23.650922+0000","last_became_active":"2024-09-11T00:14:18.641783+0000","last_became_peered":"2024-09-11T00:14:18.641783+0000","last_unstale":"2024-09-11T00:14:23.650922+0000","last_undegraded":"2024-09-11T00:14:23.650922+0000","last_fullsized":"2024-09-11T00:14:23.650922+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_clean_scrub_stamp":"2024-09-11T00:14:17.606538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:06:55.661773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:23.652407+0000","last_change":"2024-09-11T00:14:17.630077+0000","last_active":"2024-09-11T00:14:23.652407+0000","last_peered":"2024-09-11T00:14:23.652407+0000","last_clean":"2024-09-11T00:14:23.652407+0000","last_became_active":"2024-09-11T00:14:17.629668+0000","last_became_peered":"2024-09-11T00:14:17.629668+0000","last_unstale":"2024-09-11T00:14:23.652407+0000","last_undegraded":"2024-09-11T00:14:23.652407+0000","last_fullsized":"2024-09-11T00:14:23.652407+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:16.598908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:16.598908+0000","last_clean_scrub_stamp":"2024-09-11T00:14:16.598908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:43:47.266406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:25.448669+0000","last_change":"2024-09-11T00:14:22.674145+0000","last_active":"2024-09-11T00:14:25.448669+0000","last_peered":"2024-09-11T00:14:25.448669+0000","last_clean":"2024-09-11T00:14:25.448669+0000","last_became_active":"2024-09-11T00:14:22.673757+0000","last_became_peered":"2024-09-11T00:14:22.673757+0000","last_unstale":"2024-09-11T00:14:25.448669+0000","last_undegraded":"2024-09-11T00:14:25.448669+0000","last_fullsized":"2024-09-11T00:14:25.448669+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:21.633629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:21.633629+0000","last_clean_scrub_stamp":"2024-09-11T00:14:21.633629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:52:37.859110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:25.448150+0000","last_change":"2024-09-11T00:14:18.621350+0000","last_active":"2024-09-11T00:14:25.448150+0000","last_peered":"2024-09-11T00:14:25.448150+0000","last_clean":"2024-09-11T00:14:25.448150+0000","last_became_active":"2024-09-11T00:14:18.621079+0000","last_became_peered":"2024-09-11T00:14:18.621079+0000","last_unstale":"2024-09-11T00:14:25.448150+0000","last_undegraded":"2024-09-11T00:14:25.448150+0000","last_fullsized":"2024-09-11T00:14:25.448150+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_clean_scrub_stamp":"2024-09-11T00:14:17.606538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:46:52.007701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:25.448126+0000","last_change":"2024-09-11T00:14:17.623009+0000","last_active":"2024-09-11T00:14:25.448126+0000","last_peered":"2024-09-11T00:14:25.448126+0000","last_clean":"2024-09-11T00:14:25.448126+0000","last_became_active":"2024-09-11T00:14:17.622719+0000","last_became_peered":"2024-09-11T00:14:17.622719+0000","last_unstale":"2024-09-11T00:14:25.448126+0000","last_undegraded":"2024-09-11T00:14:25.448126+0000","last_fullsized":"2024-09-11T00:14:25.448126+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:16.598908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:16.598908+0000","last_clean_scrub_stamp":"2024-09-11T00:14:16.598908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:22:22.640376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:25.448720+0000","last_change":"2024-09-11T00:14:22.668160+0000","last_active":"2024-09-11T00:14:25.448720+0000","last_peered":"2024-09-11T00:14:25.448720+0000","last_clean":"2024-09-11T00:14:25.448720+0000","last_became_active":"2024-09-11T00:14:22.667750+0000","last_became_peered":"2024-09-11T00:14:22.667750+0000","last_unstale":"2024-09-11T00:14:25.448720+0000","last_undegraded":"2024-09-11T00:14:25.448720+0000","last_fullsized":"2024-09-11T00:14:25.448720+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:21.633629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:21.633629+0000","last_clean_scrub_stamp":"2024-09-11T00:14:21.633629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:51:29.546383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:24.883081+0000","last_change":"2024-09-11T00:14:18.642039+0000","last_active":"2024-09-11T00:14:24.883081+0000","last_peered":"2024-09-11T00:14:24.883081+0000","last_clean":"2024-09-11T00:14:24.883081+0000","last_became_active":"2024-09-11T00:14:18.641748+0000","last_became_peered":"2024-09-11T00:14:18.641748+0000","last_unstale":"2024-09-11T00:14:24.883081+0000","last_undegraded":"2024-09-11T00:14:24.883081+0000","last_fullsized":"2024-09-11T00:14:24.883081+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_clean_scrub_stamp":"2024-09-11T00:14:17.606538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:47:41.811458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:25.442962+0000","last_change":"2024-09-11T00:14:17.631555+0000","last_active":"2024-09-11T00:14:25.442962+0000","last_peered":"2024-09-11T00:14:25.442962+0000","last_clean":"2024-09-11T00:14:25.442962+0000","last_became_active":"2024-09-11T00:14:17.631295+0000","last_became_peered":"2024-09-11T00:14:17.631295+0000","last_unstale":"2024-09-11T00:14:25.442962+0000","last_undegraded":"2024-09-11T00:14:25.442962+0000","last_fullsized":"2024-09-11T00:14:25.442962+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:16.598908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:16.598908+0000","last_clean_scrub_stamp":"2024-09-11T00:14:16.598908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:31:48.757466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:24.883605+0000","last_change":"2024-09-11T00:14:22.688647+0000","last_active":"2024-09-11T00:14:24.883605+0000","last_peered":"2024-09-11T00:14:24.883605+0000","last_clean":"2024-09-11T00:14:24.883605+0000","last_became_active":"2024-09-11T00:14:22.688255+0000","last_became_peered":"2024-09-11T00:14:22.688255+0000","last_unstale":"2024-09-11T00:14:24.883605+0000","last_undegraded":"2024-09-11T00:14:24.883605+0000","last_fullsized":"2024-09-11T00:14:24.883605+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:21.633629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:21.633629+0000","last_clean_scrub_stamp":"2024-09-11T00:14:21.633629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:12:56.442243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:23.648452+0000","last_change":"2024-09-11T00:14:18.626265+0000","last_active":"2024-09-11T00:14:23.648452+0000","last_peered":"2024-09-11T00:14:23.648452+0000","last_clean":"2024-09-11T00:14:23.648452+0000","last_became_active":"2024-09-11T00:14:18.625997+0000","last_became_peered":"2024-09-11T00:14:18.625997+0000","last_unstale":"2024-09-11T00:14:23.648452+0000","last_undegraded":"2024-09-11T00:14:23.648452+0000","last_fullsized":"2024-09-11T00:14:23.648452+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_clean_scrub_stamp":"2024-09-11T00:14:17.606538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:34:07.533694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:23.651593+0000","last_change":"2024-09-11T00:14:17.627078+0000","last_active":"2024-09-11T00:14:23.651593+0000","last_peered":"2024-09-11T00:14:23.651593+0000","last_clean":"2024-09-11T00:14:23.651593+0000","last_became_active":"2024-09-11T00:14:17.626791+0000","last_became_peered":"2024-09-11T00:14:17.626791+0000","last_unstale":"2024-09-11T00:14:23.651593+0000","last_undegraded":"2024-09-11T00:14:23.651593+0000","last_fullsized":"2024-09-11T00:14:23.651593+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:16.598908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:16.598908+0000","last_clean_scrub_stamp":"2024-09-11T00:14:16.598908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:41:57.300139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":119,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:25.443097+0000","last_change":"2024-09-11T00:14:08.221813+0000","last_active":"2024-09-11T00:14:25.443097+0000","last_peered":"2024-09-11T00:14:25.443097+0000","last_clean":"2024-09-11T00:14:25.443097+0000","last_became_active":"2024-09-11T00:14:08.220663+0000","last_became_peered":"2024-09-11T00:14:08.220663+0000","last_unstale":"2024-09-11T00:14:25.443097+0000","last_undegraded":"2024-09-11T00:14:25.443097+0000","last_fullsized":"2024-09-11T00:14:25.443097+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:06.563107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:06.563107+0000","last_clean_scrub_stamp":"2024-09-11T00:14:06.563107+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:44:49.322583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:24.935219+0000","last_change":"2024-09-11T00:14:22.692059+0000","last_active":"2024-09-11T00:14:24.935219+0000","last_peered":"2024-09-11T00:14:24.935219+0000","last_clean":"2024-09-11T00:14:24.935219+0000","last_became_active":"2024-09-11T00:14:22.691622+0000","last_became_peered":"2024-09-11T00:14:22.691622+0000","last_unstale":"2024-09-11T00:14:24.935219+0000","last_undegraded":"2024-09-11T00:14:24.935219+0000","last_fullsized":"2024-09-11T00:14:24.935219+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:21.633629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:21.633629+0000","last_clean_scrub_stamp":"2024-09-11T00:14:21.633629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:17:20.492407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:25.443365+0000","last_change":"2024-09-11T00:14:18.643287+0000","last_active":"2024-09-11T00:14:25.443365+0000","last_peered":"2024-09-11T00:14:25.443365+0000","last_clean":"2024-09-11T00:14:25.443365+0000","last_became_active":"2024-09-11T00:14:18.642274+0000","last_became_peered":"2024-09-11T00:14:18.642274+0000","last_unstale":"2024-09-11T00:14:25.443365+0000","last_undegraded":"2024-09-11T00:14:25.443365+0000","last_fullsized":"2024-09-11T00:14:25.443365+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_clean_scrub_stamp":"2024-09-11T00:14:17.606538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:28:22.113765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:25.448581+0000","last_change":"2024-09-11T00:14:17.633759+0000","last_active":"2024-09-11T00:14:25.448581+0000","last_peered":"2024-09-11T00:14:25.448581+0000","last_clean":"2024-09-11T00:14:25.448581+0000","last_became_active":"2024-09-11T00:14:17.633445+0000","last_became_peered":"2024-09-11T00:14:17.633445+0000","last_unstale":"2024-09-11T00:14:25.448581+0000","last_undegraded":"2024-09-11T00:14:25.448581+0000","last_fullsized":"2024-09-11T00:14:25.448581+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:16.598908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:16.598908+0000","last_clean_scrub_stamp":"2024-09-11T00:14:16.598908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:52:38.739834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:24.934823+0000","last_change":"2024-09-11T00:14:22.688646+0000","last_active":"2024-09-11T00:14:24.934823+0000","last_peered":"2024-09-11T00:14:24.934823+0000","last_clean":"2024-09-11T00:14:24.934823+0000","last_became_active":"2024-09-11T00:14:22.688254+0000","last_became_peered":"2024-09-11T00:14:22.688254+0000","last_unstale":"2024-09-11T00:14:24.934823+0000","last_undegraded":"2024-09-11T00:14:24.934823+0000","last_fullsized":"2024-09-11T00:14:24.934823+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:21.633629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:21.633629+0000","last_clean_scrub_stamp":"2024-09-11T00:14:21.633629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:12:15.928177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:23.650905+0000","last_change":"2024-09-11T00:14:18.629290+0000","last_active":"2024-09-11T00:14:23.650905+0000","last_peered":"2024-09-11T00:14:23.650905+0000","last_clean":"2024-09-11T00:14:23.650905+0000","last_became_active":"2024-09-11T00:14:18.629028+0000","last_became_peered":"2024-09-11T00:14:18.629028+0000","last_unstale":"2024-09-11T00:14:23.650905+0000","last_undegraded":"2024-09-11T00:14:23.650905+0000","last_fullsized":"2024-09-11T00:14:23.650905+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_clean_scrub_stamp":"2024-09-11T00:14:17.606538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:49:46.087276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:25.448972+0000","last_change":"2024-09-11T00:14:17.634168+0000","last_active":"2024-09-11T00:14:25.448972+0000","last_peered":"2024-09-11T00:14:25.448972+0000","last_clean":"2024-09-11T00:14:25.448972+0000","last_became_active":"2024-09-11T00:14:17.633920+0000","last_became_peered":"2024-09-11T00:14:17.633920+0000","last_unstale":"2024-09-11T00:14:25.448972+0000","last_undegraded":"2024-09-11T00:14:25.448972+0000","last_fullsized":"2024-09-11T00:14:25.448972+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:16.598908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:16.598908+0000","last_clean_scrub_stamp":"2024-09-11T00:14:16.598908+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:31:48.757466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:24.883419+0000","last_change":"2024-09-11T00:14:22.669596+0000","last_active":"2024-09-11T00:14:24.883419+0000","last_peered":"2024-09-11T00:14:24.883419+0000","last_clean":"2024-09-11T00:14:24.883419+0000","last_became_active":"2024-09-11T00:14:22.669123+0000","last_became_peered":"2024-09-11T00:14:22.669123+0000","last_unstale":"2024-09-11T00:14:24.883419+0000","last_undegraded":"2024-09-11T00:14:24.883419+0000","last_fullsized":"2024-09-11T00:14:24.883419+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:21.633629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:21.633629+0000","last_clean_scrub_stamp":"2024-09-11T00:14:21.633629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:07:41.648631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:25.443770+0000","last_change":"2024-09-11T00:14:18.647802+0000","last_active":"2024-09-11T00:14:25.443770+0000","last_peered":"2024-09-11T00:14:25.443770+0000","last_clean":"2024-09-11T00:14:25.443770+0000","last_became_active":"2024-09-11T00:14:18.647512+0000","last_became_peered":"2024-09-11T00:14:18.647512+0000","last_unstale":"2024-09-11T00:14:25.443770+0000","last_undegraded":"2024-09-11T00:14:25.443770+0000","last_fullsized":"2024-09-11T00:14:25.443770+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_clean_scrub_stamp":"2024-09-11T00:14:17.606538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:04:59.988406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:25.448274+0000","last_change":"2024-09-11T00:14:17.624944+0000","last_active":"2024-09-11T00:14:25.448274+0000","last_peered":"2024-09-11T00:14:25.448274+0000","last_clean":"2024-09-11T00:14:25.448274+0000","last_became_active":"2024-09-11T00:14:17.624613+0000","last_became_peered":"2024-09-11T00:14:17.624613+0000","last_unstale":"2024-09-11T00:14:25.448274+0000","last_undegraded":"2024-09-11T00:14:25.448274+0000","last_fullsized":"2024-09-11T00:14:25.448274+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:16.598908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:16.598908+0000","last_clean_scrub_stamp":"2024-09-11T00:14:16.598908+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:30:53.963229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:23.650179+0000","last_change":"2024-09-11T00:14:22.689788+0000","last_active":"2024-09-11T00:14:23.650179+0000","last_peered":"2024-09-11T00:14:23.650179+0000","last_clean":"2024-09-11T00:14:23.650179+0000","last_became_active":"2024-09-11T00:14:22.689360+0000","last_became_peered":"2024-09-11T00:14:22.689360+0000","last_unstale":"2024-09-11T00:14:23.650179+0000","last_undegraded":"2024-09-11T00:14:23.650179+0000","last_fullsized":"2024-09-11T00:14:23.650179+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:21.633629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:21.633629+0000","last_clean_scrub_stamp":"2024-09-11T00:14:21.633629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:07:21.973974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:25.443628+0000","last_change":"2024-09-11T00:14:18.645675+0000","last_active":"2024-09-11T00:14:25.443628+0000","last_peered":"2024-09-11T00:14:25.443628+0000","last_clean":"2024-09-11T00:14:25.443628+0000","last_became_active":"2024-09-11T00:14:18.645400+0000","last_became_peered":"2024-09-11T00:14:18.645400+0000","last_unstale":"2024-09-11T00:14:25.443628+0000","last_undegraded":"2024-09-11T00:14:25.443628+0000","last_fullsized":"2024-09-11T00:14:25.443628+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_clean_scrub_stamp":"2024-09-11T00:14:17.606538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:18:45.202473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:23.652104+0000","last_change":"2024-09-11T00:14:17.634002+0000","last_active":"2024-09-11T00:14:23.652104+0000","last_peered":"2024-09-11T00:14:23.652104+0000","last_clean":"2024-09-11T00:14:23.652104+0000","last_became_active":"2024-09-11T00:14:17.633722+0000","last_became_peered":"2024-09-11T00:14:17.633722+0000","last_unstale":"2024-09-11T00:14:23.652104+0000","last_undegraded":"2024-09-11T00:14:23.652104+0000","last_fullsized":"2024-09-11T00:14:23.652104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:16.598908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:16.598908+0000","last_clean_scrub_stamp":"2024-09-11T00:14:16.598908+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:38:48.805212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:23.649985+0000","last_change":"2024-09-11T00:14:22.674989+0000","last_active":"2024-09-11T00:14:23.649985+0000","last_peered":"2024-09-11T00:14:23.649985+0000","last_clean":"2024-09-11T00:14:23.649985+0000","last_became_active":"2024-09-11T00:14:22.674093+0000","last_became_peered":"2024-09-11T00:14:22.674093+0000","last_unstale":"2024-09-11T00:14:23.649985+0000","last_undegraded":"2024-09-11T00:14:23.649985+0000","last_fullsized":"2024-09-11T00:14:23.649985+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:21.633629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:21.633629+0000","last_clean_scrub_stamp":"2024-09-11T00:14:21.633629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:51:34.161600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:25.443210+0000","last_change":"2024-09-11T00:14:18.645760+0000","last_active":"2024-09-11T00:14:25.443210+0000","last_peered":"2024-09-11T00:14:25.443210+0000","last_clean":"2024-09-11T00:14:25.443210+0000","last_became_active":"2024-09-11T00:14:18.645462+0000","last_became_peered":"2024-09-11T00:14:18.645462+0000","last_unstale":"2024-09-11T00:14:25.443210+0000","last_undegraded":"2024-09-11T00:14:25.443210+0000","last_fullsized":"2024-09-11T00:14:25.443210+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_clean_scrub_stamp":"2024-09-11T00:14:17.606538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:05:22.680084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":31,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:25.447934+0000","last_change":"2024-09-11T00:14:17.628485+0000","last_active":"2024-09-11T00:14:25.447934+0000","last_peered":"2024-09-11T00:14:25.447934+0000","last_clean":"2024-09-11T00:14:25.447934+0000","last_became_active":"2024-09-11T00:14:17.628222+0000","last_became_peered":"2024-09-11T00:14:17.628222+0000","last_unstale":"2024-09-11T00:14:25.447934+0000","last_undegraded":"2024-09-11T00:14:25.447934+0000","last_fullsized":"2024-09-11T00:14:25.447934+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:16.598908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:16.598908+0000","last_clean_scrub_stamp":"2024-09-11T00:14:16.598908+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:10:29.159080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:24.883394+0000","last_change":"2024-09-11T00:14:22.667660+0000","last_active":"2024-09-11T00:14:24.883394+0000","last_peered":"2024-09-11T00:14:24.883394+0000","last_clean":"2024-09-11T00:14:24.883394+0000","last_became_active":"2024-09-11T00:14:22.667251+0000","last_became_peered":"2024-09-11T00:14:22.667251+0000","last_unstale":"2024-09-11T00:14:24.883394+0000","last_undegraded":"2024-09-11T00:14:24.883394+0000","last_fullsized":"2024-09-11T00:14:24.883394+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:21.633629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:21.633629+0000","last_clean_scrub_stamp":"2024-09-11T00:14:21.633629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:49:50.114367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:24.934702+0000","last_change":"2024-09-11T00:14:18.638920+0000","last_active":"2024-09-11T00:14:24.934702+0000","last_peered":"2024-09-11T00:14:24.934702+0000","last_clean":"2024-09-11T00:14:24.934702+0000","last_became_active":"2024-09-11T00:14:18.638610+0000","last_became_peered":"2024-09-11T00:14:18.638610+0000","last_unstale":"2024-09-11T00:14:24.934702+0000","last_undegraded":"2024-09-11T00:14:24.934702+0000","last_fullsized":"2024-09-11T00:14:24.934702+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_clean_scrub_stamp":"2024-09-11T00:14:17.606538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:54:59.724551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:24.934755+0000","last_change":"2024-09-11T00:14:17.637068+0000","last_active":"2024-09-11T00:14:24.934755+0000","last_peered":"2024-09-11T00:14:24.934755+0000","last_clean":"2024-09-11T00:14:24.934755+0000","last_became_active":"2024-09-11T00:14:17.636624+0000","last_became_peered":"2024-09-11T00:14:17.636624+0000","last_unstale":"2024-09-11T00:14:24.934755+0000","last_undegraded":"2024-09-11T00:14:24.934755+0000","last_fullsized":"2024-09-11T00:14:24.934755+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:16.598908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:16.598908+0000","last_clean_scrub_stamp":"2024-09-11T00:14:16.598908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:10:29.159080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:23.649270+0000","last_change":"2024-09-11T00:14:22.690799+0000","last_active":"2024-09-11T00:14:23.649270+0000","last_peered":"2024-09-11T00:14:23.649270+0000","last_clean":"2024-09-11T00:14:23.649270+0000","last_became_active":"2024-09-11T00:14:22.690297+0000","last_became_peered":"2024-09-11T00:14:22.690297+0000","last_unstale":"2024-09-11T00:14:23.649270+0000","last_undegraded":"2024-09-11T00:14:23.649270+0000","last_fullsized":"2024-09-11T00:14:23.649270+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:21.633629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:21.633629+0000","last_clean_scrub_stamp":"2024-09-11T00:14:21.633629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:22:53.801030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:25.443367+0000","last_change":"2024-09-11T00:14:18.642784+0000","last_active":"2024-09-11T00:14:25.443367+0000","last_peered":"2024-09-11T00:14:25.443367+0000","last_clean":"2024-09-11T00:14:25.443367+0000","last_became_active":"2024-09-11T00:14:18.642508+0000","last_became_peered":"2024-09-11T00:14:18.642508+0000","last_unstale":"2024-09-11T00:14:25.443367+0000","last_undegraded":"2024-09-11T00:14:25.443367+0000","last_fullsized":"2024-09-11T00:14:25.443367+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_clean_scrub_stamp":"2024-09-11T00:14:17.606538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:25:18.398495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:23.652298+0000","last_change":"2024-09-11T00:14:17.623667+0000","last_active":"2024-09-11T00:14:23.652298+0000","last_peered":"2024-09-11T00:14:23.652298+0000","last_clean":"2024-09-11T00:14:23.652298+0000","last_became_active":"2024-09-11T00:14:17.623380+0000","last_became_peered":"2024-09-11T00:14:17.623380+0000","last_unstale":"2024-09-11T00:14:23.652298+0000","last_undegraded":"2024-09-11T00:14:23.652298+0000","last_fullsized":"2024-09-11T00:14:23.652298+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:16.598908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:16.598908+0000","last_clean_scrub_stamp":"2024-09-11T00:14:16.598908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:42:38.574433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:23.648776+0000","last_change":"2024-09-11T00:14:22.688511+0000","last_active":"2024-09-11T00:14:23.648776+0000","last_peered":"2024-09-11T00:14:23.648776+0000","last_clean":"2024-09-11T00:14:23.648776+0000","last_became_active":"2024-09-11T00:14:22.688105+0000","last_became_peered":"2024-09-11T00:14:22.688105+0000","last_unstale":"2024-09-11T00:14:23.648776+0000","last_undegraded":"2024-09-11T00:14:23.648776+0000","last_fullsized":"2024-09-11T00:14:23.648776+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:21.633629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:21.633629+0000","last_clean_scrub_stamp":"2024-09-11T00:14:21.633629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:23:20.020672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:24.883270+0000","last_change":"2024-09-11T00:14:18.641786+0000","last_active":"2024-09-11T00:14:24.883270+0000","last_peered":"2024-09-11T00:14:24.883270+0000","last_clean":"2024-09-11T00:14:24.883270+0000","last_became_active":"2024-09-11T00:14:18.641529+0000","last_became_peered":"2024-09-11T00:14:18.641529+0000","last_unstale":"2024-09-11T00:14:24.883270+0000","last_undegraded":"2024-09-11T00:14:24.883270+0000","last_fullsized":"2024-09-11T00:14:24.883270+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_clean_scrub_stamp":"2024-09-11T00:14:17.606538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:35:44.502418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:24.883594+0000","last_change":"2024-09-11T00:14:17.635250+0000","last_active":"2024-09-11T00:14:24.883594+0000","last_peered":"2024-09-11T00:14:24.883594+0000","last_clean":"2024-09-11T00:14:24.883594+0000","last_became_active":"2024-09-11T00:14:17.634962+0000","last_became_peered":"2024-09-11T00:14:17.634962+0000","last_unstale":"2024-09-11T00:14:24.883594+0000","last_undegraded":"2024-09-11T00:14:24.883594+0000","last_fullsized":"2024-09-11T00:14:24.883594+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:16.598908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:16.598908+0000","last_clean_scrub_stamp":"2024-09-11T00:14:16.598908+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:02:04.954945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:23.651089+0000","last_change":"2024-09-11T00:14:22.688665+0000","last_active":"2024-09-11T00:14:23.651089+0000","last_peered":"2024-09-11T00:14:23.651089+0000","last_clean":"2024-09-11T00:14:23.651089+0000","last_became_active":"2024-09-11T00:14:22.688285+0000","last_became_peered":"2024-09-11T00:14:22.688285+0000","last_unstale":"2024-09-11T00:14:23.651089+0000","last_undegraded":"2024-09-11T00:14:23.651089+0000","last_fullsized":"2024-09-11T00:14:23.651089+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:21.633629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:21.633629+0000","last_clean_scrub_stamp":"2024-09-11T00:14:21.633629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:14:32.578348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:25.443331+0000","last_change":"2024-09-11T00:14:18.644136+0000","last_active":"2024-09-11T00:14:25.443331+0000","last_peered":"2024-09-11T00:14:25.443331+0000","last_clean":"2024-09-11T00:14:25.443331+0000","last_became_active":"2024-09-11T00:14:18.642976+0000","last_became_peered":"2024-09-11T00:14:18.642976+0000","last_unstale":"2024-09-11T00:14:25.443331+0000","last_undegraded":"2024-09-11T00:14:25.443331+0000","last_fullsized":"2024-09-11T00:14:25.443331+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_clean_scrub_stamp":"2024-09-11T00:14:17.606538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:58:16.831016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"25'9","reported_seq":32,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:28.050349+0000","last_change":"2024-09-11T00:14:17.633618+0000","last_active":"2024-09-11T00:14:28.050349+0000","last_peered":"2024-09-11T00:14:28.050349+0000","last_clean":"2024-09-11T00:14:28.050349+0000","last_became_active":"2024-09-11T00:14:17.632701+0000","last_became_peered":"2024-09-11T00:14:17.632701+0000","last_unstale":"2024-09-11T00:14:28.050349+0000","last_undegraded":"2024-09-11T00:14:28.050349+0000","last_fullsized":"2024-09-11T00:14:28.050349+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:16.598908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:16.598908+0000","last_clean_scrub_stamp":"2024-09-11T00:14:16.598908+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:10:37.852358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:25.448757+0000","last_change":"2024-09-11T00:14:22.664837+0000","last_active":"2024-09-11T00:14:25.448757+0000","last_peered":"2024-09-11T00:14:25.448757+0000","last_clean":"2024-09-11T00:14:25.448757+0000","last_became_active":"2024-09-11T00:14:22.663868+0000","last_became_peered":"2024-09-11T00:14:22.663868+0000","last_unstale":"2024-09-11T00:14:25.448757+0000","last_undegraded":"2024-09-11T00:14:25.448757+0000","last_fullsized":"2024-09-11T00:14:25.448757+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:21.633629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:21.633629+0000","last_clean_scrub_stamp":"2024-09-11T00:14:21.633629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:51:23.630707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:23.652267+0000","last_change":"2024-09-11T00:14:18.641013+0000","last_active":"2024-09-11T00:14:23.652267+0000","last_peered":"2024-09-11T00:14:23.652267+0000","last_clean":"2024-09-11T00:14:23.652267+0000","last_became_active":"2024-09-11T00:14:18.640690+0000","last_became_peered":"2024-09-11T00:14:18.640690+0000","last_unstale":"2024-09-11T00:14:23.652267+0000","last_undegraded":"2024-09-11T00:14:23.652267+0000","last_fullsized":"2024-09-11T00:14:23.652267+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_clean_scrub_stamp":"2024-09-11T00:14:17.606538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:22:59.454003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:25.448873+0000","last_change":"2024-09-11T00:14:17.637712+0000","last_active":"2024-09-11T00:14:25.448873+0000","last_peered":"2024-09-11T00:14:25.448873+0000","last_clean":"2024-09-11T00:14:25.448873+0000","last_became_active":"2024-09-11T00:14:17.637463+0000","last_became_peered":"2024-09-11T00:14:17.637463+0000","last_unstale":"2024-09-11T00:14:25.448873+0000","last_undegraded":"2024-09-11T00:14:25.448873+0000","last_fullsized":"2024-09-11T00:14:25.448873+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:16.598908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:16.598908+0000","last_clean_scrub_stamp":"2024-09-11T00:14:16.598908+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:43:47.266406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:23.650677+0000","last_change":"2024-09-11T00:14:22.664447+0000","last_active":"2024-09-11T00:14:23.650677+0000","last_peered":"2024-09-11T00:14:23.650677+0000","last_clean":"2024-09-11T00:14:23.650677+0000","last_became_active":"2024-09-11T00:14:22.663920+0000","last_became_peered":"2024-09-11T00:14:22.663920+0000","last_unstale":"2024-09-11T00:14:23.650677+0000","last_undegraded":"2024-09-11T00:14:23.650677+0000","last_fullsized":"2024-09-11T00:14:23.650677+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:21.633629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:21.633629+0000","last_clean_scrub_stamp":"2024-09-11T00:14:21.633629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:55:56.768777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:24.883554+0000","last_change":"2024-09-11T00:14:18.630232+0000","last_active":"2024-09-11T00:14:24.883554+0000","last_peered":"2024-09-11T00:14:24.883554+0000","last_clean":"2024-09-11T00:14:24.883554+0000","last_became_active":"2024-09-11T00:14:18.629885+0000","last_became_peered":"2024-09-11T00:14:18.629885+0000","last_unstale":"2024-09-11T00:14:24.883554+0000","last_undegraded":"2024-09-11T00:14:24.883554+0000","last_fullsized":"2024-09-11T00:14:24.883554+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_clean_scrub_stamp":"2024-09-11T00:14:17.606538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:05:45.558170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:23.650676+0000","last_change":"2024-09-11T00:14:17.632228+0000","last_active":"2024-09-11T00:14:23.650676+0000","last_peered":"2024-09-11T00:14:23.650676+0000","last_clean":"2024-09-11T00:14:23.650676+0000","last_became_active":"2024-09-11T00:14:17.631908+0000","last_became_peered":"2024-09-11T00:14:17.631908+0000","last_unstale":"2024-09-11T00:14:23.650676+0000","last_undegraded":"2024-09-11T00:14:23.650676+0000","last_fullsized":"2024-09-11T00:14:23.650676+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:16.598908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:16.598908+0000","last_clean_scrub_stamp":"2024-09-11T00:14:16.598908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:11:19.690215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:23.648399+0000","last_change":"2024-09-11T00:14:22.671970+0000","last_active":"2024-09-11T00:14:23.648399+0000","last_peered":"2024-09-11T00:14:23.648399+0000","last_clean":"2024-09-11T00:14:23.648399+0000","last_became_active":"2024-09-11T00:14:22.671536+0000","last_became_peered":"2024-09-11T00:14:22.671536+0000","last_unstale":"2024-09-11T00:14:23.648399+0000","last_undegraded":"2024-09-11T00:14:23.648399+0000","last_fullsized":"2024-09-11T00:14:23.648399+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:21.633629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:21.633629+0000","last_clean_scrub_stamp":"2024-09-11T00:14:21.633629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:42:10.576151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:23.650561+0000","last_change":"2024-09-11T00:14:18.639664+0000","last_active":"2024-09-11T00:14:23.650561+0000","last_peered":"2024-09-11T00:14:23.650561+0000","last_clean":"2024-09-11T00:14:23.650561+0000","last_became_active":"2024-09-11T00:14:18.639215+0000","last_became_peered":"2024-09-11T00:14:18.639215+0000","last_unstale":"2024-09-11T00:14:23.650561+0000","last_undegraded":"2024-09-11T00:14:23.650561+0000","last_fullsized":"2024-09-11T00:14:23.650561+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_clean_scrub_stamp":"2024-09-11T00:14:17.606538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:38:46.884984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:24.935237+0000","last_change":"2024-09-11T00:14:17.638296+0000","last_active":"2024-09-11T00:14:24.935237+0000","last_peered":"2024-09-11T00:14:24.935237+0000","last_clean":"2024-09-11T00:14:24.935237+0000","last_became_active":"2024-09-11T00:14:17.637629+0000","last_became_peered":"2024-09-11T00:14:17.637629+0000","last_unstale":"2024-09-11T00:14:24.935237+0000","last_undegraded":"2024-09-11T00:14:24.935237+0000","last_fullsized":"2024-09-11T00:14:24.935237+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:16.598908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:16.598908+0000","last_clean_scrub_stamp":"2024-09-11T00:14:16.598908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:30:53.963229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:23.648342+0000","last_change":"2024-09-11T00:14:22.692320+0000","last_active":"2024-09-11T00:14:23.648342+0000","last_peered":"2024-09-11T00:14:23.648342+0000","last_clean":"2024-09-11T00:14:23.648342+0000","last_became_active":"2024-09-11T00:14:22.691110+0000","last_became_peered":"2024-09-11T00:14:22.691110+0000","last_unstale":"2024-09-11T00:14:23.648342+0000","last_undegraded":"2024-09-11T00:14:23.648342+0000","last_fullsized":"2024-09-11T00:14:23.648342+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:21.633629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:21.633629+0000","last_clean_scrub_stamp":"2024-09-11T00:14:21.633629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:19:13.639166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:24.883414+0000","last_change":"2024-09-11T00:14:22.692131+0000","last_active":"2024-09-11T00:14:24.883414+0000","last_peered":"2024-09-11T00:14:24.883414+0000","last_clean":"2024-09-11T00:14:24.883414+0000","last_became_active":"2024-09-11T00:14:22.691743+0000","last_became_peered":"2024-09-11T00:14:22.691743+0000","last_unstale":"2024-09-11T00:14:24.883414+0000","last_undegraded":"2024-09-11T00:14:24.883414+0000","last_fullsized":"2024-09-11T00:14:24.883414+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:21.633629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:21.633629+0000","last_clean_scrub_stamp":"2024-09-11T00:14:21.633629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:18:49.229564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:25.448449+0000","last_change":"2024-09-11T00:14:18.627489+0000","last_active":"2024-09-11T00:14:25.448449+0000","last_peered":"2024-09-11T00:14:25.448449+0000","last_clean":"2024-09-11T00:14:25.448449+0000","last_became_active":"2024-09-11T00:14:18.627227+0000","last_became_peered":"2024-09-11T00:14:18.627227+0000","last_unstale":"2024-09-11T00:14:25.448449+0000","last_undegraded":"2024-09-11T00:14:25.448449+0000","last_fullsized":"2024-09-11T00:14:25.448449+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_clean_scrub_stamp":"2024-09-11T00:14:17.606538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:20:59.721295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:23.650568+0000","last_change":"2024-09-11T00:14:17.633563+0000","last_active":"2024-09-11T00:14:23.650568+0000","last_peered":"2024-09-11T00:14:23.650568+0000","last_clean":"2024-09-11T00:14:23.650568+0000","last_became_active":"2024-09-11T00:14:17.633316+0000","last_became_peered":"2024-09-11T00:14:17.633316+0000","last_unstale":"2024-09-11T00:14:23.650568+0000","last_undegraded":"2024-09-11T00:14:23.650568+0000","last_fullsized":"2024-09-11T00:14:23.650568+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:16.598908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:16.598908+0000","last_clean_scrub_stamp":"2024-09-11T00:14:16.598908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:52:22.626375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:24.935339+0000","last_change":"2024-09-11T00:14:22.670666+0000","last_active":"2024-09-11T00:14:24.935339+0000","last_peered":"2024-09-11T00:14:24.935339+0000","last_clean":"2024-09-11T00:14:24.935339+0000","last_became_active":"2024-09-11T00:14:22.670286+0000","last_became_peered":"2024-09-11T00:14:22.670286+0000","last_unstale":"2024-09-11T00:14:24.935339+0000","last_undegraded":"2024-09-11T00:14:24.935339+0000","last_fullsized":"2024-09-11T00:14:24.935339+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:21.633629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:21.633629+0000","last_clean_scrub_stamp":"2024-09-11T00:14:21.633629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:53:06.573918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:23.648370+0000","last_change":"2024-09-11T00:14:18.634072+0000","last_active":"2024-09-11T00:14:23.648370+0000","last_peered":"2024-09-11T00:14:23.648370+0000","last_clean":"2024-09-11T00:14:23.648370+0000","last_became_active":"2024-09-11T00:14:18.633811+0000","last_became_peered":"2024-09-11T00:14:18.633811+0000","last_unstale":"2024-09-11T00:14:23.648370+0000","last_undegraded":"2024-09-11T00:14:23.648370+0000","last_fullsized":"2024-09-11T00:14:23.648370+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_clean_scrub_stamp":"2024-09-11T00:14:17.606538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:35:44.502418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:23.648649+0000","last_change":"2024-09-11T00:14:17.631993+0000","last_active":"2024-09-11T00:14:23.648649+0000","last_peered":"2024-09-11T00:14:23.648649+0000","last_clean":"2024-09-11T00:14:23.648649+0000","last_became_active":"2024-09-11T00:14:17.631645+0000","last_became_peered":"2024-09-11T00:14:17.631645+0000","last_unstale":"2024-09-11T00:14:23.648649+0000","last_undegraded":"2024-09-11T00:14:23.648649+0000","last_fullsized":"2024-09-11T00:14:23.648649+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:16.598908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:16.598908+0000","last_clean_scrub_stamp":"2024-09-11T00:14:16.598908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:55:22.582535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:24.934838+0000","last_change":"2024-09-11T00:14:17.634075+0000","last_active":"2024-09-11T00:14:24.934838+0000","last_peered":"2024-09-11T00:14:24.934838+0000","last_clean":"2024-09-11T00:14:24.934838+0000","last_became_active":"2024-09-11T00:14:17.633595+0000","last_became_peered":"2024-09-11T00:14:17.633595+0000","last_unstale":"2024-09-11T00:14:24.934838+0000","last_undegraded":"2024-09-11T00:14:24.934838+0000","last_fullsized":"2024-09-11T00:14:24.934838+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:16.598908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:16.598908+0000","last_clean_scrub_stamp":"2024-09-11T00:14:16.598908+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:51:02.481656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:24.883579+0000","last_change":"2024-09-11T00:14:18.642731+0000","last_active":"2024-09-11T00:14:24.883579+0000","last_peered":"2024-09-11T00:14:24.883579+0000","last_clean":"2024-09-11T00:14:24.883579+0000","last_became_active":"2024-09-11T00:14:18.642296+0000","last_became_peered":"2024-09-11T00:14:18.642296+0000","last_unstale":"2024-09-11T00:14:24.883579+0000","last_undegraded":"2024-09-11T00:14:24.883579+0000","last_fullsized":"2024-09-11T00:14:24.883579+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_clean_scrub_stamp":"2024-09-11T00:14:17.606538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:49:06.208715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:25.448556+0000","last_change":"2024-09-11T00:14:22.674116+0000","last_active":"2024-09-11T00:14:25.448556+0000","last_peered":"2024-09-11T00:14:25.448556+0000","last_clean":"2024-09-11T00:14:25.448556+0000","last_became_active":"2024-09-11T00:14:22.673701+0000","last_became_peered":"2024-09-11T00:14:22.673701+0000","last_unstale":"2024-09-11T00:14:25.448556+0000","last_undegraded":"2024-09-11T00:14:25.448556+0000","last_fullsized":"2024-09-11T00:14:25.448556+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:21.633629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:21.633629+0000","last_clean_scrub_stamp":"2024-09-11T00:14:21.633629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:22:35.167801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:23.648729+0000","last_change":"2024-09-11T00:14:17.632276+0000","last_active":"2024-09-11T00:14:23.648729+0000","last_peered":"2024-09-11T00:14:23.648729+0000","last_clean":"2024-09-11T00:14:23.648729+0000","last_became_active":"2024-09-11T00:14:17.631820+0000","last_became_peered":"2024-09-11T00:14:17.631820+0000","last_unstale":"2024-09-11T00:14:23.648729+0000","last_undegraded":"2024-09-11T00:14:23.648729+0000","last_fullsized":"2024-09-11T00:14:23.648729+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:16.598908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:16.598908+0000","last_clean_scrub_stamp":"2024-09-11T00:14:16.598908+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:20:56.408317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:23.650684+0000","last_change":"2024-09-11T00:14:18.631229+0000","last_active":"2024-09-11T00:14:23.650684+0000","last_peered":"2024-09-11T00:14:23.650684+0000","last_clean":"2024-09-11T00:14:23.650684+0000","last_became_active":"2024-09-11T00:14:18.630830+0000","last_became_peered":"2024-09-11T00:14:18.630830+0000","last_unstale":"2024-09-11T00:14:23.650684+0000","last_undegraded":"2024-09-11T00:14:23.650684+0000","last_fullsized":"2024-09-11T00:14:23.650684+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_clean_scrub_stamp":"2024-09-11T00:14:17.606538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:39:00.086315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:23.649013+0000","last_change":"2024-09-11T00:14:22.675138+0000","last_active":"2024-09-11T00:14:23.649013+0000","last_peered":"2024-09-11T00:14:23.649013+0000","last_clean":"2024-09-11T00:14:23.649013+0000","last_became_active":"2024-09-11T00:14:22.674701+0000","last_became_peered":"2024-09-11T00:14:22.674701+0000","last_unstale":"2024-09-11T00:14:23.649013+0000","last_undegraded":"2024-09-11T00:14:23.649013+0000","last_fullsized":"2024-09-11T00:14:23.649013+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:21.633629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:21.633629+0000","last_clean_scrub_stamp":"2024-09-11T00:14:21.633629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:16:25.651997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:24.934564+0000","last_change":"2024-09-11T00:14:18.639301+0000","last_active":"2024-09-11T00:14:24.934564+0000","last_peered":"2024-09-11T00:14:24.934564+0000","last_clean":"2024-09-11T00:14:24.934564+0000","last_became_active":"2024-09-11T00:14:18.639038+0000","last_became_peered":"2024-09-11T00:14:18.639038+0000","last_unstale":"2024-09-11T00:14:24.934564+0000","last_undegraded":"2024-09-11T00:14:24.934564+0000","last_fullsized":"2024-09-11T00:14:24.934564+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_clean_scrub_stamp":"2024-09-11T00:14:17.606538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:24:12.007225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:25.448031+0000","last_change":"2024-09-11T00:14:18.623623+0000","last_active":"2024-09-11T00:14:25.448031+0000","last_peered":"2024-09-11T00:14:25.448031+0000","last_clean":"2024-09-11T00:14:25.448031+0000","last_became_active":"2024-09-11T00:14:18.623328+0000","last_became_peered":"2024-09-11T00:14:18.623328+0000","last_unstale":"2024-09-11T00:14:25.448031+0000","last_undegraded":"2024-09-11T00:14:25.448031+0000","last_fullsized":"2024-09-11T00:14:25.448031+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_clean_scrub_stamp":"2024-09-11T00:14:17.606538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:00:51.172893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:23.652194+0000","last_change":"2024-09-11T00:14:18.628493+0000","last_active":"2024-09-11T00:14:23.652194+0000","last_peered":"2024-09-11T00:14:23.652194+0000","last_clean":"2024-09-11T00:14:23.652194+0000","last_became_active":"2024-09-11T00:14:18.628040+0000","last_became_peered":"2024-09-11T00:14:18.628040+0000","last_unstale":"2024-09-11T00:14:23.652194+0000","last_undegraded":"2024-09-11T00:14:23.652194+0000","last_fullsized":"2024-09-11T00:14:23.652194+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_clean_scrub_stamp":"2024-09-11T00:14:17.606538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:24:40.790020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:24.883499+0000","last_change":"2024-09-11T00:14:18.633950+0000","last_active":"2024-09-11T00:14:24.883499+0000","last_peered":"2024-09-11T00:14:24.883499+0000","last_clean":"2024-09-11T00:14:24.883499+0000","last_became_active":"2024-09-11T00:14:18.633147+0000","last_became_peered":"2024-09-11T00:14:18.633147+0000","last_unstale":"2024-09-11T00:14:24.883499+0000","last_undegraded":"2024-09-11T00:14:24.883499+0000","last_fullsized":"2024-09-11T00:14:24.883499+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_clean_scrub_stamp":"2024-09-11T00:14:17.606538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:46:52.007701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:23.648966+0000","last_change":"2024-09-11T00:14:18.626152+0000","last_active":"2024-09-11T00:14:23.648966+0000","last_peered":"2024-09-11T00:14:23.648966+0000","last_clean":"2024-09-11T00:14:23.648966+0000","last_became_active":"2024-09-11T00:14:18.625885+0000","last_became_peered":"2024-09-11T00:14:18.625885+0000","last_unstale":"2024-09-11T00:14:23.648966+0000","last_undegraded":"2024-09-11T00:14:23.648966+0000","last_fullsized":"2024-09-11T00:14:23.648966+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_clean_scrub_stamp":"2024-09-11T00:14:17.606538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:11:01.606959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:25.448276+0000","last_change":"2024-09-11T00:14:18.626762+0000","last_active":"2024-09-11T00:14:25.448276+0000","last_peered":"2024-09-11T00:14:25.448276+0000","last_clean":"2024-09-11T00:14:25.448276+0000","last_became_active":"2024-09-11T00:14:18.626537+0000","last_became_peered":"2024-09-11T00:14:18.626537+0000","last_unstale":"2024-09-11T00:14:25.448276+0000","last_undegraded":"2024-09-11T00:14:25.448276+0000","last_fullsized":"2024-09-11T00:14:25.448276+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_clean_scrub_stamp":"2024-09-11T00:14:17.606538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:03:25.203629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:24.935246+0000","last_change":"2024-09-11T00:14:18.642453+0000","last_active":"2024-09-11T00:14:24.935246+0000","last_peered":"2024-09-11T00:14:24.935246+0000","last_clean":"2024-09-11T00:14:24.935246+0000","last_became_active":"2024-09-11T00:14:18.642172+0000","last_became_peered":"2024-09-11T00:14:18.642172+0000","last_unstale":"2024-09-11T00:14:24.935246+0000","last_undegraded":"2024-09-11T00:14:24.935246+0000","last_fullsized":"2024-09-11T00:14:24.935246+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_clean_scrub_stamp":"2024-09-11T00:14:17.606538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:48:16.815773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:23.649246+0000","last_change":"2024-09-11T00:14:18.628632+0000","last_active":"2024-09-11T00:14:23.649246+0000","last_peered":"2024-09-11T00:14:23.649246+0000","last_clean":"2024-09-11T00:14:23.649246+0000","last_became_active":"2024-09-11T00:14:18.628308+0000","last_became_peered":"2024-09-11T00:14:18.628308+0000","last_unstale":"2024-09-11T00:14:23.649246+0000","last_undegraded":"2024-09-11T00:14:23.649246+0000","last_fullsized":"2024-09-11T00:14:23.649246+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_clean_scrub_stamp":"2024-09-11T00:14:17.606538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:24:40.790020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:23.650453+0000","last_change":"2024-09-11T00:14:18.630942+0000","last_active":"2024-09-11T00:14:23.650453+0000","last_peered":"2024-09-11T00:14:23.650453+0000","last_clean":"2024-09-11T00:14:23.650453+0000","last_became_active":"2024-09-11T00:14:18.630223+0000","last_became_peered":"2024-09-11T00:14:18.630223+0000","last_unstale":"2024-09-11T00:14:23.650453+0000","last_undegraded":"2024-09-11T00:14:23.650453+0000","last_fullsized":"2024-09-11T00:14:23.650453+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_clean_scrub_stamp":"2024-09-11T00:14:17.606538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:34:07.533694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:23.648607+0000","last_change":"2024-09-11T00:14:18.628072+0000","last_active":"2024-09-11T00:14:23.648607+0000","last_peered":"2024-09-11T00:14:23.648607+0000","last_clean":"2024-09-11T00:14:23.648607+0000","last_became_active":"2024-09-11T00:14:18.627801+0000","last_became_peered":"2024-09-11T00:14:18.627801+0000","last_unstale":"2024-09-11T00:14:23.648607+0000","last_undegraded":"2024-09-11T00:14:23.648607+0000","last_fullsized":"2024-09-11T00:14:23.648607+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_clean_scrub_stamp":"2024-09-11T00:14:17.606538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:27:57.991308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:23.652067+0000","last_change":"2024-09-11T00:14:18.633583+0000","last_active":"2024-09-11T00:14:23.652067+0000","last_peered":"2024-09-11T00:14:23.652067+0000","last_clean":"2024-09-11T00:14:23.652067+0000","last_became_active":"2024-09-11T00:14:18.633263+0000","last_became_peered":"2024-09-11T00:14:18.633263+0000","last_unstale":"2024-09-11T00:14:23.652067+0000","last_undegraded":"2024-09-11T00:14:23.652067+0000","last_fullsized":"2024-09-11T00:14:23.652067+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_clean_scrub_stamp":"2024-09-11T00:14:17.606538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:24:44.702294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:24.883238+0000","last_change":"2024-09-11T00:14:18.642759+0000","last_active":"2024-09-11T00:14:24.883238+0000","last_peered":"2024-09-11T00:14:24.883238+0000","last_clean":"2024-09-11T00:14:24.883238+0000","last_became_active":"2024-09-11T00:14:18.642466+0000","last_became_peered":"2024-09-11T00:14:18.642466+0000","last_unstale":"2024-09-11T00:14:24.883238+0000","last_undegraded":"2024-09-11T00:14:24.883238+0000","last_fullsized":"2024-09-11T00:14:24.883238+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_clean_scrub_stamp":"2024-09-11T00:14:17.606538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:54:15.924007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:24.934959+0000","last_change":"2024-09-11T00:14:18.647847+0000","last_active":"2024-09-11T00:14:24.934959+0000","last_peered":"2024-09-11T00:14:24.934959+0000","last_clean":"2024-09-11T00:14:24.934959+0000","last_became_active":"2024-09-11T00:14:18.647379+0000","last_became_peered":"2024-09-11T00:14:18.647379+0000","last_unstale":"2024-09-11T00:14:24.934959+0000","last_undegraded":"2024-09-11T00:14:24.934959+0000","last_fullsized":"2024-09-11T00:14:24.934959+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_clean_scrub_stamp":"2024-09-11T00:14:17.606538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:18:09.026105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:25.443565+0000","last_change":"2024-09-11T00:14:18.643993+0000","last_active":"2024-09-11T00:14:25.443565+0000","last_peered":"2024-09-11T00:14:25.443565+0000","last_clean":"2024-09-11T00:14:25.443565+0000","last_became_active":"2024-09-11T00:14:18.642576+0000","last_became_peered":"2024-09-11T00:14:18.642576+0000","last_unstale":"2024-09-11T00:14:25.443565+0000","last_undegraded":"2024-09-11T00:14:25.443565+0000","last_fullsized":"2024-09-11T00:14:25.443565+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_clean_scrub_stamp":"2024-09-11T00:14:17.606538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:49:46.087276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:25.448220+0000","last_change":"2024-09-11T00:14:18.634965+0000","last_active":"2024-09-11T00:14:25.448220+0000","last_peered":"2024-09-11T00:14:25.448220+0000","last_clean":"2024-09-11T00:14:25.448220+0000","last_became_active":"2024-09-11T00:14:18.634667+0000","last_became_peered":"2024-09-11T00:14:18.634667+0000","last_unstale":"2024-09-11T00:14:25.448220+0000","last_undegraded":"2024-09-11T00:14:25.448220+0000","last_fullsized":"2024-09-11T00:14:25.448220+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_clean_scrub_stamp":"2024-09-11T00:14:17.606538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:05:38.063905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:23.650745+0000","last_change":"2024-09-11T00:14:18.645434+0000","last_active":"2024-09-11T00:14:23.650745+0000","last_peered":"2024-09-11T00:14:23.650745+0000","last_clean":"2024-09-11T00:14:23.650745+0000","last_became_active":"2024-09-11T00:14:18.645012+0000","last_became_peered":"2024-09-11T00:14:18.645012+0000","last_unstale":"2024-09-11T00:14:23.650745+0000","last_undegraded":"2024-09-11T00:14:23.650745+0000","last_fullsized":"2024-09-11T00:14:23.650745+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_clean_scrub_stamp":"2024-09-11T00:14:17.606538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:07:37.621540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:23.650343+0000","last_change":"2024-09-11T00:14:18.635751+0000","last_active":"2024-09-11T00:14:23.650343+0000","last_peered":"2024-09-11T00:14:23.650343+0000","last_clean":"2024-09-11T00:14:23.650343+0000","last_became_active":"2024-09-11T00:14:18.635450+0000","last_became_peered":"2024-09-11T00:14:18.635450+0000","last_unstale":"2024-09-11T00:14:23.650343+0000","last_undegraded":"2024-09-11T00:14:23.650343+0000","last_fullsized":"2024-09-11T00:14:23.650343+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_clean_scrub_stamp":"2024-09-11T00:14:17.606538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:13:02.693352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:25.448536+0000","last_change":"2024-09-11T00:14:18.623006+0000","last_active":"2024-09-11T00:14:25.448536+0000","last_peered":"2024-09-11T00:14:25.448536+0000","last_clean":"2024-09-11T00:14:25.448536+0000","last_became_active":"2024-09-11T00:14:18.622744+0000","last_became_peered":"2024-09-11T00:14:18.622744+0000","last_unstale":"2024-09-11T00:14:25.448536+0000","last_undegraded":"2024-09-11T00:14:25.448536+0000","last_fullsized":"2024-09-11T00:14:25.448536+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_clean_scrub_stamp":"2024-09-11T00:14:17.606538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:25:01.082594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:24.883243+0000","last_change":"2024-09-11T00:14:18.631985+0000","last_active":"2024-09-11T00:14:24.883243+0000","last_peered":"2024-09-11T00:14:24.883243+0000","last_clean":"2024-09-11T00:14:24.883243+0000","last_became_active":"2024-09-11T00:14:18.631307+0000","last_became_peered":"2024-09-11T00:14:18.631307+0000","last_unstale":"2024-09-11T00:14:24.883243+0000","last_undegraded":"2024-09-11T00:14:24.883243+0000","last_fullsized":"2024-09-11T00:14:24.883243+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_clean_scrub_stamp":"2024-09-11T00:14:17.606538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:40:30.015285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:23.648594+0000","last_change":"2024-09-11T00:14:18.633438+0000","last_active":"2024-09-11T00:14:23.648594+0000","last_peered":"2024-09-11T00:14:23.648594+0000","last_clean":"2024-09-11T00:14:23.648594+0000","last_became_active":"2024-09-11T00:14:18.633192+0000","last_became_peered":"2024-09-11T00:14:18.633192+0000","last_unstale":"2024-09-11T00:14:23.648594+0000","last_undegraded":"2024-09-11T00:14:23.648594+0000","last_fullsized":"2024-09-11T00:14:23.648594+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_clean_scrub_stamp":"2024-09-11T00:14:17.606538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:13:02.693352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:23.652159+0000","last_change":"2024-09-11T00:14:18.640308+0000","last_active":"2024-09-11T00:14:23.652159+0000","last_peered":"2024-09-11T00:14:23.652159+0000","last_clean":"2024-09-11T00:14:23.652159+0000","last_became_active":"2024-09-11T00:14:18.640051+0000","last_became_peered":"2024-09-11T00:14:18.640051+0000","last_unstale":"2024-09-11T00:14:23.652159+0000","last_undegraded":"2024-09-11T00:14:23.652159+0000","last_fullsized":"2024-09-11T00:14:23.652159+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_clean_scrub_stamp":"2024-09-11T00:14:17.606538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:11:16.975202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:24.935109+0000","last_change":"2024-09-11T00:14:18.636880+0000","last_active":"2024-09-11T00:14:24.935109+0000","last_peered":"2024-09-11T00:14:24.935109+0000","last_clean":"2024-09-11T00:14:24.935109+0000","last_became_active":"2024-09-11T00:14:18.636592+0000","last_became_peered":"2024-09-11T00:14:18.636592+0000","last_unstale":"2024-09-11T00:14:24.935109+0000","last_undegraded":"2024-09-11T00:14:24.935109+0000","last_fullsized":"2024-09-11T00:14:24.935109+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_clean_scrub_stamp":"2024-09-11T00:14:17.606538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:05:21.082012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:24.935192+0000","last_change":"2024-09-11T00:14:18.638064+0000","last_active":"2024-09-11T00:14:24.935192+0000","last_peered":"2024-09-11T00:14:24.935192+0000","last_clean":"2024-09-11T00:14:24.935192+0000","last_became_active":"2024-09-11T00:14:18.637558+0000","last_became_peered":"2024-09-11T00:14:18.637558+0000","last_unstale":"2024-09-11T00:14:24.935192+0000","last_undegraded":"2024-09-11T00:14:24.935192+0000","last_fullsized":"2024-09-11T00:14:24.935192+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_clean_scrub_stamp":"2024-09-11T00:14:17.606538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:09:24.787612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:25.443755+0000","last_change":"2024-09-11T00:14:18.641166+0000","last_active":"2024-09-11T00:14:25.443755+0000","last_peered":"2024-09-11T00:14:25.443755+0000","last_clean":"2024-09-11T00:14:25.443755+0000","last_became_active":"2024-09-11T00:14:18.640456+0000","last_became_peered":"2024-09-11T00:14:18.640456+0000","last_unstale":"2024-09-11T00:14:25.443755+0000","last_undegraded":"2024-09-11T00:14:25.443755+0000","last_fullsized":"2024-09-11T00:14:25.443755+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_clean_scrub_stamp":"2024-09-11T00:14:17.606538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:12:52.415152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:23.648235+0000","last_change":"2024-09-11T00:14:18.626919+0000","last_active":"2024-09-11T00:14:23.648235+0000","last_peered":"2024-09-11T00:14:23.648235+0000","last_clean":"2024-09-11T00:14:23.648235+0000","last_became_active":"2024-09-11T00:14:18.626280+0000","last_became_peered":"2024-09-11T00:14:18.626280+0000","last_unstale":"2024-09-11T00:14:23.648235+0000","last_undegraded":"2024-09-11T00:14:23.648235+0000","last_fullsized":"2024-09-11T00:14:23.648235+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_clean_scrub_stamp":"2024-09-11T00:14:17.606538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:29:21.396079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:25.443235+0000","last_change":"2024-09-11T00:14:18.640550+0000","last_active":"2024-09-11T00:14:25.443235+0000","last_peered":"2024-09-11T00:14:25.443235+0000","last_clean":"2024-09-11T00:14:25.443235+0000","last_became_active":"2024-09-11T00:14:18.640248+0000","last_became_peered":"2024-09-11T00:14:18.640248+0000","last_unstale":"2024-09-11T00:14:25.443235+0000","last_undegraded":"2024-09-11T00:14:25.443235+0000","last_fullsized":"2024-09-11T00:14:25.443235+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_clean_scrub_stamp":"2024-09-11T00:14:17.606538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:51:39.692232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:23.651967+0000","last_change":"2024-09-11T00:14:18.631295+0000","last_active":"2024-09-11T00:14:23.651967+0000","last_peered":"2024-09-11T00:14:23.651967+0000","last_clean":"2024-09-11T00:14:23.651967+0000","last_became_active":"2024-09-11T00:14:18.630629+0000","last_became_peered":"2024-09-11T00:14:18.630629+0000","last_unstale":"2024-09-11T00:14:23.651967+0000","last_undegraded":"2024-09-11T00:14:23.651967+0000","last_fullsized":"2024-09-11T00:14:23.651967+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_clean_scrub_stamp":"2024-09-11T00:14:17.606538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:11:01.606959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:25.443198+0000","last_change":"2024-09-11T00:14:18.632354+0000","last_active":"2024-09-11T00:14:25.443198+0000","last_peered":"2024-09-11T00:14:25.443198+0000","last_clean":"2024-09-11T00:14:25.443198+0000","last_became_active":"2024-09-11T00:14:18.632105+0000","last_became_peered":"2024-09-11T00:14:18.632105+0000","last_unstale":"2024-09-11T00:14:25.443198+0000","last_undegraded":"2024-09-11T00:14:25.443198+0000","last_fullsized":"2024-09-11T00:14:25.443198+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_clean_scrub_stamp":"2024-09-11T00:14:17.606538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:28:22.300564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:23.650364+0000","last_change":"2024-09-11T00:14:18.630513+0000","last_active":"2024-09-11T00:14:23.650364+0000","last_peered":"2024-09-11T00:14:23.650364+0000","last_clean":"2024-09-11T00:14:23.650364+0000","last_became_active":"2024-09-11T00:14:18.629735+0000","last_became_peered":"2024-09-11T00:14:18.629735+0000","last_unstale":"2024-09-11T00:14:23.650364+0000","last_undegraded":"2024-09-11T00:14:23.650364+0000","last_fullsized":"2024-09-11T00:14:23.650364+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_clean_scrub_stamp":"2024-09-11T00:14:17.606538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:28:22.300564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:24.883388+0000","last_change":"2024-09-11T00:14:18.630607+0000","last_active":"2024-09-11T00:14:24.883388+0000","last_peered":"2024-09-11T00:14:24.883388+0000","last_clean":"2024-09-11T00:14:24.883388+0000","last_became_active":"2024-09-11T00:14:18.629273+0000","last_became_peered":"2024-09-11T00:14:18.629273+0000","last_unstale":"2024-09-11T00:14:24.883388+0000","last_undegraded":"2024-09-11T00:14:24.883388+0000","last_fullsized":"2024-09-11T00:14:24.883388+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_clean_scrub_stamp":"2024-09-11T00:14:17.606538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:41:33.040042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:25.448538+0000","last_change":"2024-09-11T00:14:18.628576+0000","last_active":"2024-09-11T00:14:25.448538+0000","last_peered":"2024-09-11T00:14:25.448538+0000","last_clean":"2024-09-11T00:14:25.448538+0000","last_became_active":"2024-09-11T00:14:18.628238+0000","last_became_peered":"2024-09-11T00:14:18.628238+0000","last_unstale":"2024-09-11T00:14:25.448538+0000","last_undegraded":"2024-09-11T00:14:25.448538+0000","last_fullsized":"2024-09-11T00:14:25.448538+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_clean_scrub_stamp":"2024-09-11T00:14:17.606538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:49:06.208715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:25.443654+0000","last_change":"2024-09-11T00:14:18.644648+0000","last_active":"2024-09-11T00:14:25.443654+0000","last_peered":"2024-09-11T00:14:25.443654+0000","last_clean":"2024-09-11T00:14:25.443654+0000","last_became_active":"2024-09-11T00:14:18.644076+0000","last_became_peered":"2024-09-11T00:14:18.644076+0000","last_unstale":"2024-09-11T00:14:25.443654+0000","last_undegraded":"2024-09-11T00:14:25.443654+0000","last_fullsized":"2024-09-11T00:14:25.443654+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_clean_scrub_stamp":"2024-09-11T00:14:17.606538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:07:37.621540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509450,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27864,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343976,"statfs":{"total":96636764160,"available":96608231424,"internally_reserved":0,"allocated":856064,"data_stored":693611,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509450,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":262144,"data_stored":102751,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509449,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":270336,"data_stored":102787,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509449,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":270336,"data_stored":106503,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509451,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":266240,"data_stored":102821,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509450,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27872,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343968,"statfs":{"total":96636764160,"available":96608223232,"internally_reserved":0,"allocated":864256,"data_stored":693667,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542155,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":258048,"data_stored":102661,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574859,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":270336,"data_stored":106503,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T00:14:43.263 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T00:14:43.400 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:43.398+0000 7f59794fe640 1 -- 172.21.15.92:0/77984602 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f59740d4af0 msgr2=0x7f59740d24e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:43.400 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:43.398+0000 7f59794fe640 1 --2- 172.21.15.92:0/77984602 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f59740d4af0 0x7f59740d24e0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f595c009860 tx=0x7f595c02a560 comp rx=0 tx=0).stop 2024-09-11T00:14:43.400 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:43.398+0000 7f59794fe640 1 -- 172.21.15.92:0/77984602 shutdown_connections 2024-09-11T00:14:43.400 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:43.398+0000 7f59794fe640 1 --2- 172.21.15.92:0/77984602 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f59740d4af0 0x7f59740d24e0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:43.400 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:43.398+0000 7f59794fe640 1 -- 172.21.15.92:0/77984602 >> 172.21.15.92:0/77984602 conn(0x7f59740d3f70 msgr2=0x7f59740d4350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:14:43.401 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:43.398+0000 7f59794fe640 1 -- 172.21.15.92:0/77984602 shutdown_connections 2024-09-11T00:14:43.401 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:43.398+0000 7f59794fe640 1 -- 172.21.15.92:0/77984602 wait complete. 2024-09-11T00:14:43.401 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:43.399+0000 7f59794fe640 1 Processor -- start 2024-09-11T00:14:43.401 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:43.399+0000 7f59794fe640 1 -- start start 2024-09-11T00:14:43.403 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:43.400+0000 7f59794fe640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f59740d2a20 0x7f59741f80e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:43.403 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:43.400+0000 7f59794fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f59740d4af0 0x7f59741f8620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:43.403 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:43.400+0000 7f59794fe640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f597415e060 0x7f59741582c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:43.403 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:43.400+0000 7f59794fe640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f59740cf2d0 con 0x7f59740d4af0 2024-09-11T00:14:43.403 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:43.400+0000 7f59794fe640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f59740cf150 con 0x7f59740d2a20 2024-09-11T00:14:43.403 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:43.400+0000 7f59794fe640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f59740cf450 con 0x7f597415e060 2024-09-11T00:14:43.403 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:43.400+0000 7f59727fc640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f59740d4af0 0x7f59741f8620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:43.403 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:43.400+0000 7f59727fc640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f59740d4af0 0x7f59741f8620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:50710/0 (socket says 172.21.15.92:50710) 2024-09-11T00:14:43.403 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:43.400+0000 7f59727fc640 1 -- 172.21.15.92:0/372207001 learned_addr learned my addr 172.21.15.92:0/372207001 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-11T00:14:43.404 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:43.400+0000 7f5972ffd640 1 --2- 172.21.15.92:0/372207001 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f59740d2a20 0x7f59741f80e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:43.404 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:43.400+0000 7f59737fe640 1 --2- 172.21.15.92:0/372207001 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f597415e060 0x7f59741582c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:43.404 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:43.401+0000 7f59727fc640 1 -- 172.21.15.92:0/372207001 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f597415e060 msgr2=0x7f59741582c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:43.404 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:43.401+0000 7f59727fc640 1 --2- 172.21.15.92:0/372207001 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f597415e060 0x7f59741582c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:43.404 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:43.401+0000 7f59727fc640 1 -- 172.21.15.92:0/372207001 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f59740d2a20 msgr2=0x7f59741f80e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:43.404 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:43.401+0000 7f59727fc640 1 --2- 172.21.15.92:0/372207001 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f59740d2a20 0x7f59741f80e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:43.404 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:43.401+0000 7f59727fc640 1 -- 172.21.15.92:0/372207001 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f597415e8e0 con 0x7f59740d4af0 2024-09-11T00:14:43.404 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:43.401+0000 7f59737fe640 1 --2- 172.21.15.92:0/372207001 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f597415e060 0x7f59741582c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:14:43.404 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:43.401+0000 7f59727fc640 1 --2- 172.21.15.92:0/372207001 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f59740d4af0 0x7f59741f8620 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f595c009980 tx=0x7f595c032b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:14:43.404 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:43.401+0000 7f596b7fe640 1 -- 172.21.15.92:0/372207001 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f595c040070 con 0x7f59740d4af0 2024-09-11T00:14:43.405 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:43.401+0000 7f596b7fe640 1 -- 172.21.15.92:0/372207001 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f595c0038e0 con 0x7f59740d4af0 2024-09-11T00:14:43.405 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:43.401+0000 7f596b7fe640 1 -- 172.21.15.92:0/372207001 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f595c003d30 con 0x7f59740d4af0 2024-09-11T00:14:43.405 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:43.401+0000 7f59794fe640 1 -- 172.21.15.92:0/372207001 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f597415ebc0 con 0x7f59740d4af0 2024-09-11T00:14:43.405 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:43.401+0000 7f59794fe640 1 -- 172.21.15.92:0/372207001 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5974159d20 con 0x7f59740d4af0 2024-09-11T00:14:43.406 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:43.402+0000 7f59794fe640 1 -- 172.21.15.92:0/372207001 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f597415e700 con 0x7f59740d4af0 2024-09-11T00:14:43.406 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:43.403+0000 7f596b7fe640 1 -- 172.21.15.92:0/372207001 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f595c04d030 con 0x7f59740d4af0 2024-09-11T00:14:43.406 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:43.403+0000 7f596b7fe640 1 --2- 172.21.15.92:0/372207001 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f5954077f70 0x7f595407a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:43.406 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:43.403+0000 7f596b7fe640 1 -- 172.21.15.92:0/372207001 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f595c0bb400 con 0x7f59740d4af0 2024-09-11T00:14:43.406 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:43.403+0000 7f5972ffd640 1 --2- 172.21.15.92:0/372207001 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f5954077f70 0x7f595407a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:43.406 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:43.404+0000 7f5972ffd640 1 --2- 172.21.15.92:0/372207001 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f5954077f70 0x7f595407a430 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f59640014a0 tx=0x7f5964009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:14:43.409 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:43.407+0000 7f596b7fe640 1 -- 172.21.15.92:0/372207001 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f597415e700 con 0x7f59740d4af0 2024-09-11T00:14:43.580 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:43.579+0000 7f59794fe640 1 -- 172.21.15.92:0/372207001 --> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f597415ed90 con 0x7f5954077f70 2024-09-11T00:14:43.586 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:43.584+0000 7f596b7fe640 1 -- 172.21.15.92:0/372207001 <== mgr.4100 v2:172.21.15.145:6800/325490785 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332523 (secure 0 0 0) 0x7f597415ed90 con 0x7f5954077f70 2024-09-11T00:14:43.589 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:14:43.591 INFO:teuthology.orchestra.run.smithi092.stderr:dumped all 2024-09-11T00:14:43.593 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:43.588+0000 7f59794fe640 1 -- 172.21.15.92:0/372207001 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f5954077f70 msgr2=0x7f595407a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:43.593 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:43.588+0000 7f59794fe640 1 --2- 172.21.15.92:0/372207001 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f5954077f70 0x7f595407a430 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f59640014a0 tx=0x7f5964009040 comp rx=0 tx=0).stop 2024-09-11T00:14:43.593 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:43.588+0000 7f59794fe640 1 -- 172.21.15.92:0/372207001 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f59740d4af0 msgr2=0x7f59741f8620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:43.593 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:43.588+0000 7f59794fe640 1 --2- 172.21.15.92:0/372207001 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f59740d4af0 0x7f59741f8620 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f595c009980 tx=0x7f595c032b90 comp rx=0 tx=0).stop 2024-09-11T00:14:43.593 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:43.588+0000 7f59794fe640 1 -- 172.21.15.92:0/372207001 shutdown_connections 2024-09-11T00:14:43.593 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:43.588+0000 7f59794fe640 1 --2- 172.21.15.92:0/372207001 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f5954077f70 0x7f595407a430 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:43.593 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:43.588+0000 7f59794fe640 1 --2- 172.21.15.92:0/372207001 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f597415e060 0x7f59741582c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:43.593 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:43.588+0000 7f59794fe640 1 --2- 172.21.15.92:0/372207001 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f59740d4af0 0x7f59741f8620 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:43.593 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:43.588+0000 7f59794fe640 1 --2- 172.21.15.92:0/372207001 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f59740d2a20 0x7f59741f80e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:43.594 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:43.588+0000 7f59794fe640 1 -- 172.21.15.92:0/372207001 >> 172.21.15.92:0/372207001 conn(0x7f59740d3f70 msgr2=0x7f59740cfb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:14:43.594 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:43.588+0000 7f59794fe640 1 -- 172.21.15.92:0/372207001 shutdown_connections 2024-09-11T00:14:43.594 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:43.588+0000 7f59794fe640 1 -- 172.21.15.92:0/372207001 wait complete. 2024-09-11T00:14:43.601 INFO:teuthology.orchestra.run.smithi092.stdout:{"pg_ready":true,"pg_map":{"version":37,"stamp":"2024-09-11T00:14:42.279272+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":149,"num_write_kb":1646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":114,"ondisk_log_size":114,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219464,"kb_used_data":3240,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755256,"statfs":{"total":773094113280,"available":772869382144,"internally_reserved":0,"allocated":3317760,"data_stored":2011304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2230,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003552"},"pg_stats":[{"pgid":"2.1f","version":"20'4","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:24.883591+0000","last_change":"2024-09-11T00:14:17.626124+0000","last_active":"2024-09-11T00:14:24.883591+0000","last_peered":"2024-09-11T00:14:24.883591+0000","last_clean":"2024-09-11T00:14:24.883591+0000","last_became_active":"2024-09-11T00:14:17.625641+0000","last_became_peered":"2024-09-11T00:14:17.625641+0000","last_unstale":"2024-09-11T00:14:24.883591+0000","last_undegraded":"2024-09-11T00:14:24.883591+0000","last_fullsized":"2024-09-11T00:14:24.883591+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:16.598908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:16.598908+0000","last_clean_scrub_stamp":"2024-09-11T00:14:16.598908+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:34:04.062752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:23.649065+0000","last_change":"2024-09-11T00:14:18.635793+0000","last_active":"2024-09-11T00:14:23.649065+0000","last_peered":"2024-09-11T00:14:23.649065+0000","last_clean":"2024-09-11T00:14:23.649065+0000","last_became_active":"2024-09-11T00:14:18.635544+0000","last_became_peered":"2024-09-11T00:14:18.635544+0000","last_unstale":"2024-09-11T00:14:23.649065+0000","last_undegraded":"2024-09-11T00:14:23.649065+0000","last_fullsized":"2024-09-11T00:14:23.649065+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_clean_scrub_stamp":"2024-09-11T00:14:17.606538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:24:44.702294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:23.648231+0000","last_change":"2024-09-11T00:14:22.691295+0000","last_active":"2024-09-11T00:14:23.648231+0000","last_peered":"2024-09-11T00:14:23.648231+0000","last_clean":"2024-09-11T00:14:23.648231+0000","last_became_active":"2024-09-11T00:14:22.690445+0000","last_became_peered":"2024-09-11T00:14:22.690445+0000","last_unstale":"2024-09-11T00:14:23.648231+0000","last_undegraded":"2024-09-11T00:14:23.648231+0000","last_fullsized":"2024-09-11T00:14:23.648231+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:21.633629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:21.633629+0000","last_clean_scrub_stamp":"2024-09-11T00:14:21.633629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:15:47.491554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:23.649169+0000","last_change":"2024-09-11T00:14:17.627802+0000","last_active":"2024-09-11T00:14:23.649169+0000","last_peered":"2024-09-11T00:14:23.649169+0000","last_clean":"2024-09-11T00:14:23.649169+0000","last_became_active":"2024-09-11T00:14:17.627530+0000","last_became_peered":"2024-09-11T00:14:17.627530+0000","last_unstale":"2024-09-11T00:14:23.649169+0000","last_undegraded":"2024-09-11T00:14:23.649169+0000","last_fullsized":"2024-09-11T00:14:23.649169+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:16.598908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:16.598908+0000","last_clean_scrub_stamp":"2024-09-11T00:14:16.598908+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:34:04.062752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:24.883447+0000","last_change":"2024-09-11T00:14:18.632474+0000","last_active":"2024-09-11T00:14:24.883447+0000","last_peered":"2024-09-11T00:14:24.883447+0000","last_clean":"2024-09-11T00:14:24.883447+0000","last_became_active":"2024-09-11T00:14:18.631284+0000","last_became_peered":"2024-09-11T00:14:18.631284+0000","last_unstale":"2024-09-11T00:14:24.883447+0000","last_undegraded":"2024-09-11T00:14:24.883447+0000","last_fullsized":"2024-09-11T00:14:24.883447+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_clean_scrub_stamp":"2024-09-11T00:14:17.606538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:25:01.082594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:23.650003+0000","last_change":"2024-09-11T00:14:22.677620+0000","last_active":"2024-09-11T00:14:23.650003+0000","last_peered":"2024-09-11T00:14:23.650003+0000","last_clean":"2024-09-11T00:14:23.650003+0000","last_became_active":"2024-09-11T00:14:22.677257+0000","last_became_peered":"2024-09-11T00:14:22.677257+0000","last_unstale":"2024-09-11T00:14:23.650003+0000","last_undegraded":"2024-09-11T00:14:23.650003+0000","last_fullsized":"2024-09-11T00:14:23.650003+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:21.633629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:21.633629+0000","last_clean_scrub_stamp":"2024-09-11T00:14:21.633629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:21:42.822631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:25.443495+0000","last_change":"2024-09-11T00:14:17.636163+0000","last_active":"2024-09-11T00:14:25.443495+0000","last_peered":"2024-09-11T00:14:25.443495+0000","last_clean":"2024-09-11T00:14:25.443495+0000","last_became_active":"2024-09-11T00:14:17.635781+0000","last_became_peered":"2024-09-11T00:14:17.635781+0000","last_unstale":"2024-09-11T00:14:25.443495+0000","last_undegraded":"2024-09-11T00:14:25.443495+0000","last_fullsized":"2024-09-11T00:14:25.443495+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:16.598908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:16.598908+0000","last_clean_scrub_stamp":"2024-09-11T00:14:16.598908+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:17:54.010379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:23.650820+0000","last_change":"2024-09-11T00:14:18.632344+0000","last_active":"2024-09-11T00:14:23.650820+0000","last_peered":"2024-09-11T00:14:23.650820+0000","last_clean":"2024-09-11T00:14:23.650820+0000","last_became_active":"2024-09-11T00:14:18.632058+0000","last_became_peered":"2024-09-11T00:14:18.632058+0000","last_unstale":"2024-09-11T00:14:23.650820+0000","last_undegraded":"2024-09-11T00:14:23.650820+0000","last_fullsized":"2024-09-11T00:14:23.650820+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_clean_scrub_stamp":"2024-09-11T00:14:17.606538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:41:28.876392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:23.650371+0000","last_change":"2024-09-11T00:14:22.675694+0000","last_active":"2024-09-11T00:14:23.650371+0000","last_peered":"2024-09-11T00:14:23.650371+0000","last_clean":"2024-09-11T00:14:23.650371+0000","last_became_active":"2024-09-11T00:14:22.675123+0000","last_became_peered":"2024-09-11T00:14:22.675123+0000","last_unstale":"2024-09-11T00:14:23.650371+0000","last_undegraded":"2024-09-11T00:14:23.650371+0000","last_fullsized":"2024-09-11T00:14:23.650371+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:21.633629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:21.633629+0000","last_clean_scrub_stamp":"2024-09-11T00:14:21.633629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:55:42.669376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:25.443208+0000","last_change":"2024-09-11T00:14:17.634109+0000","last_active":"2024-09-11T00:14:25.443208+0000","last_peered":"2024-09-11T00:14:25.443208+0000","last_clean":"2024-09-11T00:14:25.443208+0000","last_became_active":"2024-09-11T00:14:17.633815+0000","last_became_peered":"2024-09-11T00:14:17.633815+0000","last_unstale":"2024-09-11T00:14:25.443208+0000","last_undegraded":"2024-09-11T00:14:25.443208+0000","last_fullsized":"2024-09-11T00:14:25.443208+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:16.598908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:16.598908+0000","last_clean_scrub_stamp":"2024-09-11T00:14:16.598908+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:43:47.266406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:23.651249+0000","last_change":"2024-09-11T00:14:18.633804+0000","last_active":"2024-09-11T00:14:23.651249+0000","last_peered":"2024-09-11T00:14:23.651249+0000","last_clean":"2024-09-11T00:14:23.651249+0000","last_became_active":"2024-09-11T00:14:18.633530+0000","last_became_peered":"2024-09-11T00:14:18.633530+0000","last_unstale":"2024-09-11T00:14:23.651249+0000","last_undegraded":"2024-09-11T00:14:23.651249+0000","last_fullsized":"2024-09-11T00:14:23.651249+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_clean_scrub_stamp":"2024-09-11T00:14:17.606538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:28:10.132283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:23.650244+0000","last_change":"2024-09-11T00:14:22.674158+0000","last_active":"2024-09-11T00:14:23.650244+0000","last_peered":"2024-09-11T00:14:23.650244+0000","last_clean":"2024-09-11T00:14:23.650244+0000","last_became_active":"2024-09-11T00:14:22.673563+0000","last_became_peered":"2024-09-11T00:14:22.673563+0000","last_unstale":"2024-09-11T00:14:23.650244+0000","last_undegraded":"2024-09-11T00:14:23.650244+0000","last_fullsized":"2024-09-11T00:14:23.650244+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:21.633629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:21.633629+0000","last_clean_scrub_stamp":"2024-09-11T00:14:21.633629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:34:20.263638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:24.934581+0000","last_change":"2024-09-11T00:14:18.641584+0000","last_active":"2024-09-11T00:14:24.934581+0000","last_peered":"2024-09-11T00:14:24.934581+0000","last_clean":"2024-09-11T00:14:24.934581+0000","last_became_active":"2024-09-11T00:14:18.641317+0000","last_became_peered":"2024-09-11T00:14:18.641317+0000","last_unstale":"2024-09-11T00:14:24.934581+0000","last_undegraded":"2024-09-11T00:14:24.934581+0000","last_fullsized":"2024-09-11T00:14:24.934581+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_clean_scrub_stamp":"2024-09-11T00:14:17.606538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:44:05.910673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:25.443377+0000","last_change":"2024-09-11T00:14:17.636350+0000","last_active":"2024-09-11T00:14:25.443377+0000","last_peered":"2024-09-11T00:14:25.443377+0000","last_clean":"2024-09-11T00:14:25.443377+0000","last_became_active":"2024-09-11T00:14:17.636071+0000","last_became_peered":"2024-09-11T00:14:17.636071+0000","last_unstale":"2024-09-11T00:14:25.443377+0000","last_undegraded":"2024-09-11T00:14:25.443377+0000","last_fullsized":"2024-09-11T00:14:25.443377+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:16.598908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:16.598908+0000","last_clean_scrub_stamp":"2024-09-11T00:14:16.598908+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:01:31.822965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:23.651799+0000","last_change":"2024-09-11T00:14:22.669178+0000","last_active":"2024-09-11T00:14:23.651799+0000","last_peered":"2024-09-11T00:14:23.651799+0000","last_clean":"2024-09-11T00:14:23.651799+0000","last_became_active":"2024-09-11T00:14:22.668916+0000","last_became_peered":"2024-09-11T00:14:22.668916+0000","last_unstale":"2024-09-11T00:14:23.651799+0000","last_undegraded":"2024-09-11T00:14:23.651799+0000","last_fullsized":"2024-09-11T00:14:23.651799+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:21.633629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:21.633629+0000","last_clean_scrub_stamp":"2024-09-11T00:14:21.633629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:52:50.029560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:23.648642+0000","last_change":"2024-09-11T00:14:18.632035+0000","last_active":"2024-09-11T00:14:23.648642+0000","last_peered":"2024-09-11T00:14:23.648642+0000","last_clean":"2024-09-11T00:14:23.648642+0000","last_became_active":"2024-09-11T00:14:18.631678+0000","last_became_peered":"2024-09-11T00:14:18.631678+0000","last_unstale":"2024-09-11T00:14:23.648642+0000","last_undegraded":"2024-09-11T00:14:23.648642+0000","last_fullsized":"2024-09-11T00:14:23.648642+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_clean_scrub_stamp":"2024-09-11T00:14:17.606538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:19:35.541198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:25.448740+0000","last_change":"2024-09-11T00:14:17.632840+0000","last_active":"2024-09-11T00:14:25.448740+0000","last_peered":"2024-09-11T00:14:25.448740+0000","last_clean":"2024-09-11T00:14:25.448740+0000","last_became_active":"2024-09-11T00:14:17.632551+0000","last_became_peered":"2024-09-11T00:14:17.632551+0000","last_unstale":"2024-09-11T00:14:25.448740+0000","last_undegraded":"2024-09-11T00:14:25.448740+0000","last_fullsized":"2024-09-11T00:14:25.448740+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:16.598908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:16.598908+0000","last_clean_scrub_stamp":"2024-09-11T00:14:16.598908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:11:19.690215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:23.651772+0000","last_change":"2024-09-11T00:14:22.675212+0000","last_active":"2024-09-11T00:14:23.651772+0000","last_peered":"2024-09-11T00:14:23.651772+0000","last_clean":"2024-09-11T00:14:23.651772+0000","last_became_active":"2024-09-11T00:14:22.674046+0000","last_became_peered":"2024-09-11T00:14:22.674046+0000","last_unstale":"2024-09-11T00:14:23.651772+0000","last_undegraded":"2024-09-11T00:14:23.651772+0000","last_fullsized":"2024-09-11T00:14:23.651772+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:21.633629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:21.633629+0000","last_clean_scrub_stamp":"2024-09-11T00:14:21.633629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:58:10.766640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:23.648499+0000","last_change":"2024-09-11T00:14:18.625163+0000","last_active":"2024-09-11T00:14:23.648499+0000","last_peered":"2024-09-11T00:14:23.648499+0000","last_clean":"2024-09-11T00:14:23.648499+0000","last_became_active":"2024-09-11T00:14:18.624834+0000","last_became_peered":"2024-09-11T00:14:18.624834+0000","last_unstale":"2024-09-11T00:14:23.648499+0000","last_undegraded":"2024-09-11T00:14:23.648499+0000","last_fullsized":"2024-09-11T00:14:23.648499+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_clean_scrub_stamp":"2024-09-11T00:14:17.606538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:27:39.530704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:25.448769+0000","last_change":"2024-09-11T00:14:17.627946+0000","last_active":"2024-09-11T00:14:25.448769+0000","last_peered":"2024-09-11T00:14:25.448769+0000","last_clean":"2024-09-11T00:14:25.448769+0000","last_became_active":"2024-09-11T00:14:17.627667+0000","last_became_peered":"2024-09-11T00:14:17.627667+0000","last_unstale":"2024-09-11T00:14:25.448769+0000","last_undegraded":"2024-09-11T00:14:25.448769+0000","last_fullsized":"2024-09-11T00:14:25.448769+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:16.598908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:16.598908+0000","last_clean_scrub_stamp":"2024-09-11T00:14:16.598908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:01:31.822965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:25.448522+0000","last_change":"2024-09-11T00:14:22.692404+0000","last_active":"2024-09-11T00:14:25.448522+0000","last_peered":"2024-09-11T00:14:25.448522+0000","last_clean":"2024-09-11T00:14:25.448522+0000","last_became_active":"2024-09-11T00:14:22.691884+0000","last_became_peered":"2024-09-11T00:14:22.691884+0000","last_unstale":"2024-09-11T00:14:25.448522+0000","last_undegraded":"2024-09-11T00:14:25.448522+0000","last_fullsized":"2024-09-11T00:14:25.448522+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:21.633629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:21.633629+0000","last_clean_scrub_stamp":"2024-09-11T00:14:21.633629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:38:50.912075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:23.650767+0000","last_change":"2024-09-11T00:14:18.623840+0000","last_active":"2024-09-11T00:14:23.650767+0000","last_peered":"2024-09-11T00:14:23.650767+0000","last_clean":"2024-09-11T00:14:23.650767+0000","last_became_active":"2024-09-11T00:14:18.623528+0000","last_became_peered":"2024-09-11T00:14:18.623528+0000","last_unstale":"2024-09-11T00:14:23.650767+0000","last_undegraded":"2024-09-11T00:14:23.650767+0000","last_fullsized":"2024-09-11T00:14:23.650767+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_clean_scrub_stamp":"2024-09-11T00:14:17.606538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:22:17.854518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:25.442955+0000","last_change":"2024-09-11T00:14:17.633107+0000","last_active":"2024-09-11T00:14:25.442955+0000","last_peered":"2024-09-11T00:14:25.442955+0000","last_clean":"2024-09-11T00:14:25.442955+0000","last_became_active":"2024-09-11T00:14:17.632860+0000","last_became_peered":"2024-09-11T00:14:17.632860+0000","last_unstale":"2024-09-11T00:14:25.442955+0000","last_undegraded":"2024-09-11T00:14:25.442955+0000","last_fullsized":"2024-09-11T00:14:25.442955+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:16.598908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:16.598908+0000","last_clean_scrub_stamp":"2024-09-11T00:14:16.598908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:24:18.954419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:23.651684+0000","last_change":"2024-09-11T00:14:22.673902+0000","last_active":"2024-09-11T00:14:23.651684+0000","last_peered":"2024-09-11T00:14:23.651684+0000","last_clean":"2024-09-11T00:14:23.651684+0000","last_became_active":"2024-09-11T00:14:22.673397+0000","last_became_peered":"2024-09-11T00:14:22.673397+0000","last_unstale":"2024-09-11T00:14:23.651684+0000","last_undegraded":"2024-09-11T00:14:23.651684+0000","last_fullsized":"2024-09-11T00:14:23.651684+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:21.633629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:21.633629+0000","last_clean_scrub_stamp":"2024-09-11T00:14:21.633629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:24:27.330659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:24.883685+0000","last_change":"2024-09-11T00:14:18.632296+0000","last_active":"2024-09-11T00:14:24.883685+0000","last_peered":"2024-09-11T00:14:24.883685+0000","last_clean":"2024-09-11T00:14:24.883685+0000","last_became_active":"2024-09-11T00:14:18.632026+0000","last_became_peered":"2024-09-11T00:14:18.632026+0000","last_unstale":"2024-09-11T00:14:24.883685+0000","last_undegraded":"2024-09-11T00:14:24.883685+0000","last_fullsized":"2024-09-11T00:14:24.883685+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_clean_scrub_stamp":"2024-09-11T00:14:17.606538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:03:25.203629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:24.935388+0000","last_change":"2024-09-11T00:14:17.636547+0000","last_active":"2024-09-11T00:14:24.935388+0000","last_peered":"2024-09-11T00:14:24.935388+0000","last_clean":"2024-09-11T00:14:24.935388+0000","last_became_active":"2024-09-11T00:14:17.636264+0000","last_became_peered":"2024-09-11T00:14:17.636264+0000","last_unstale":"2024-09-11T00:14:24.935388+0000","last_undegraded":"2024-09-11T00:14:24.935388+0000","last_fullsized":"2024-09-11T00:14:24.935388+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:16.598908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:16.598908+0000","last_clean_scrub_stamp":"2024-09-11T00:14:16.598908+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:52:38.739834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:23.650267+0000","last_change":"2024-09-11T00:14:22.688870+0000","last_active":"2024-09-11T00:14:23.650267+0000","last_peered":"2024-09-11T00:14:23.650267+0000","last_clean":"2024-09-11T00:14:23.650267+0000","last_became_active":"2024-09-11T00:14:22.688144+0000","last_became_peered":"2024-09-11T00:14:22.688144+0000","last_unstale":"2024-09-11T00:14:23.650267+0000","last_undegraded":"2024-09-11T00:14:23.650267+0000","last_fullsized":"2024-09-11T00:14:23.650267+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:21.633629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:21.633629+0000","last_clean_scrub_stamp":"2024-09-11T00:14:21.633629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:47:00.821912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:23.649305+0000","last_change":"2024-09-11T00:14:18.644563+0000","last_active":"2024-09-11T00:14:23.649305+0000","last_peered":"2024-09-11T00:14:23.649305+0000","last_clean":"2024-09-11T00:14:23.649305+0000","last_became_active":"2024-09-11T00:14:18.644258+0000","last_became_peered":"2024-09-11T00:14:18.644258+0000","last_unstale":"2024-09-11T00:14:23.649305+0000","last_undegraded":"2024-09-11T00:14:23.649305+0000","last_fullsized":"2024-09-11T00:14:23.649305+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_clean_scrub_stamp":"2024-09-11T00:14:17.606538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:28:22.113765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:25.448636+0000","last_change":"2024-09-11T00:14:17.633279+0000","last_active":"2024-09-11T00:14:25.448636+0000","last_peered":"2024-09-11T00:14:25.448636+0000","last_clean":"2024-09-11T00:14:25.448636+0000","last_became_active":"2024-09-11T00:14:17.633023+0000","last_became_peered":"2024-09-11T00:14:17.633023+0000","last_unstale":"2024-09-11T00:14:25.448636+0000","last_undegraded":"2024-09-11T00:14:25.448636+0000","last_fullsized":"2024-09-11T00:14:25.448636+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:16.598908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:16.598908+0000","last_clean_scrub_stamp":"2024-09-11T00:14:16.598908+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:24:18.954419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:23.648131+0000","last_change":"2024-09-11T00:14:22.689579+0000","last_active":"2024-09-11T00:14:23.648131+0000","last_peered":"2024-09-11T00:14:23.648131+0000","last_clean":"2024-09-11T00:14:23.648131+0000","last_became_active":"2024-09-11T00:14:22.688060+0000","last_became_peered":"2024-09-11T00:14:22.688060+0000","last_unstale":"2024-09-11T00:14:23.648131+0000","last_undegraded":"2024-09-11T00:14:23.648131+0000","last_fullsized":"2024-09-11T00:14:23.648131+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:21.633629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:21.633629+0000","last_clean_scrub_stamp":"2024-09-11T00:14:21.633629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:02:04.039334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:25.448843+0000","last_change":"2024-09-11T00:14:18.622047+0000","last_active":"2024-09-11T00:14:25.448843+0000","last_peered":"2024-09-11T00:14:25.448843+0000","last_clean":"2024-09-11T00:14:25.448843+0000","last_became_active":"2024-09-11T00:14:18.621777+0000","last_became_peered":"2024-09-11T00:14:18.621777+0000","last_unstale":"2024-09-11T00:14:25.448843+0000","last_undegraded":"2024-09-11T00:14:25.448843+0000","last_fullsized":"2024-09-11T00:14:25.448843+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_clean_scrub_stamp":"2024-09-11T00:14:17.606538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:05:45.558170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:25.443646+0000","last_change":"2024-09-11T00:14:17.631489+0000","last_active":"2024-09-11T00:14:25.443646+0000","last_peered":"2024-09-11T00:14:25.443646+0000","last_clean":"2024-09-11T00:14:25.443646+0000","last_became_active":"2024-09-11T00:14:17.631206+0000","last_became_peered":"2024-09-11T00:14:17.631206+0000","last_unstale":"2024-09-11T00:14:25.443646+0000","last_undegraded":"2024-09-11T00:14:25.443646+0000","last_fullsized":"2024-09-11T00:14:25.443646+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:16.598908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:16.598908+0000","last_clean_scrub_stamp":"2024-09-11T00:14:16.598908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:51:33.532444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:24.883278+0000","last_change":"2024-09-11T00:14:22.689420+0000","last_active":"2024-09-11T00:14:24.883278+0000","last_peered":"2024-09-11T00:14:24.883278+0000","last_clean":"2024-09-11T00:14:24.883278+0000","last_became_active":"2024-09-11T00:14:22.689043+0000","last_became_peered":"2024-09-11T00:14:22.689043+0000","last_unstale":"2024-09-11T00:14:24.883278+0000","last_undegraded":"2024-09-11T00:14:24.883278+0000","last_fullsized":"2024-09-11T00:14:24.883278+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:21.633629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:21.633629+0000","last_clean_scrub_stamp":"2024-09-11T00:14:21.633629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:25:22.425586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:23.651349+0000","last_change":"2024-09-11T00:14:18.628564+0000","last_active":"2024-09-11T00:14:23.651349+0000","last_peered":"2024-09-11T00:14:23.651349+0000","last_clean":"2024-09-11T00:14:23.651349+0000","last_became_active":"2024-09-11T00:14:18.628095+0000","last_became_peered":"2024-09-11T00:14:18.628095+0000","last_unstale":"2024-09-11T00:14:23.651349+0000","last_undegraded":"2024-09-11T00:14:23.651349+0000","last_fullsized":"2024-09-11T00:14:23.651349+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_clean_scrub_stamp":"2024-09-11T00:14:17.606538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:51:25.519292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:25.448944+0000","last_change":"2024-09-11T00:14:17.629702+0000","last_active":"2024-09-11T00:14:25.448944+0000","last_peered":"2024-09-11T00:14:25.448944+0000","last_clean":"2024-09-11T00:14:25.448944+0000","last_became_active":"2024-09-11T00:14:17.629450+0000","last_became_peered":"2024-09-11T00:14:17.629450+0000","last_unstale":"2024-09-11T00:14:25.448944+0000","last_undegraded":"2024-09-11T00:14:25.448944+0000","last_fullsized":"2024-09-11T00:14:25.448944+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:16.598908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:16.598908+0000","last_clean_scrub_stamp":"2024-09-11T00:14:16.598908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:52:22.626375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:25.448461+0000","last_change":"2024-09-11T00:14:22.665536+0000","last_active":"2024-09-11T00:14:25.448461+0000","last_peered":"2024-09-11T00:14:25.448461+0000","last_clean":"2024-09-11T00:14:25.448461+0000","last_became_active":"2024-09-11T00:14:22.663100+0000","last_became_peered":"2024-09-11T00:14:22.663100+0000","last_unstale":"2024-09-11T00:14:25.448461+0000","last_undegraded":"2024-09-11T00:14:25.448461+0000","last_fullsized":"2024-09-11T00:14:25.448461+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:21.633629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:21.633629+0000","last_clean_scrub_stamp":"2024-09-11T00:14:21.633629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:28:14.159374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:23.650922+0000","last_change":"2024-09-11T00:14:18.642032+0000","last_active":"2024-09-11T00:14:23.650922+0000","last_peered":"2024-09-11T00:14:23.650922+0000","last_clean":"2024-09-11T00:14:23.650922+0000","last_became_active":"2024-09-11T00:14:18.641783+0000","last_became_peered":"2024-09-11T00:14:18.641783+0000","last_unstale":"2024-09-11T00:14:23.650922+0000","last_undegraded":"2024-09-11T00:14:23.650922+0000","last_fullsized":"2024-09-11T00:14:23.650922+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_clean_scrub_stamp":"2024-09-11T00:14:17.606538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:06:55.661773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:23.652407+0000","last_change":"2024-09-11T00:14:17.630077+0000","last_active":"2024-09-11T00:14:23.652407+0000","last_peered":"2024-09-11T00:14:23.652407+0000","last_clean":"2024-09-11T00:14:23.652407+0000","last_became_active":"2024-09-11T00:14:17.629668+0000","last_became_peered":"2024-09-11T00:14:17.629668+0000","last_unstale":"2024-09-11T00:14:23.652407+0000","last_undegraded":"2024-09-11T00:14:23.652407+0000","last_fullsized":"2024-09-11T00:14:23.652407+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:16.598908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:16.598908+0000","last_clean_scrub_stamp":"2024-09-11T00:14:16.598908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:43:47.266406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:25.448669+0000","last_change":"2024-09-11T00:14:22.674145+0000","last_active":"2024-09-11T00:14:25.448669+0000","last_peered":"2024-09-11T00:14:25.448669+0000","last_clean":"2024-09-11T00:14:25.448669+0000","last_became_active":"2024-09-11T00:14:22.673757+0000","last_became_peered":"2024-09-11T00:14:22.673757+0000","last_unstale":"2024-09-11T00:14:25.448669+0000","last_undegraded":"2024-09-11T00:14:25.448669+0000","last_fullsized":"2024-09-11T00:14:25.448669+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:21.633629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:21.633629+0000","last_clean_scrub_stamp":"2024-09-11T00:14:21.633629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:52:37.859110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:25.448150+0000","last_change":"2024-09-11T00:14:18.621350+0000","last_active":"2024-09-11T00:14:25.448150+0000","last_peered":"2024-09-11T00:14:25.448150+0000","last_clean":"2024-09-11T00:14:25.448150+0000","last_became_active":"2024-09-11T00:14:18.621079+0000","last_became_peered":"2024-09-11T00:14:18.621079+0000","last_unstale":"2024-09-11T00:14:25.448150+0000","last_undegraded":"2024-09-11T00:14:25.448150+0000","last_fullsized":"2024-09-11T00:14:25.448150+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_clean_scrub_stamp":"2024-09-11T00:14:17.606538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:46:52.007701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:25.448126+0000","last_change":"2024-09-11T00:14:17.623009+0000","last_active":"2024-09-11T00:14:25.448126+0000","last_peered":"2024-09-11T00:14:25.448126+0000","last_clean":"2024-09-11T00:14:25.448126+0000","last_became_active":"2024-09-11T00:14:17.622719+0000","last_became_peered":"2024-09-11T00:14:17.622719+0000","last_unstale":"2024-09-11T00:14:25.448126+0000","last_undegraded":"2024-09-11T00:14:25.448126+0000","last_fullsized":"2024-09-11T00:14:25.448126+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:16.598908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:16.598908+0000","last_clean_scrub_stamp":"2024-09-11T00:14:16.598908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:22:22.640376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:25.448720+0000","last_change":"2024-09-11T00:14:22.668160+0000","last_active":"2024-09-11T00:14:25.448720+0000","last_peered":"2024-09-11T00:14:25.448720+0000","last_clean":"2024-09-11T00:14:25.448720+0000","last_became_active":"2024-09-11T00:14:22.667750+0000","last_became_peered":"2024-09-11T00:14:22.667750+0000","last_unstale":"2024-09-11T00:14:25.448720+0000","last_undegraded":"2024-09-11T00:14:25.448720+0000","last_fullsized":"2024-09-11T00:14:25.448720+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:21.633629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:21.633629+0000","last_clean_scrub_stamp":"2024-09-11T00:14:21.633629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:51:29.546383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:24.883081+0000","last_change":"2024-09-11T00:14:18.642039+0000","last_active":"2024-09-11T00:14:24.883081+0000","last_peered":"2024-09-11T00:14:24.883081+0000","last_clean":"2024-09-11T00:14:24.883081+0000","last_became_active":"2024-09-11T00:14:18.641748+0000","last_became_peered":"2024-09-11T00:14:18.641748+0000","last_unstale":"2024-09-11T00:14:24.883081+0000","last_undegraded":"2024-09-11T00:14:24.883081+0000","last_fullsized":"2024-09-11T00:14:24.883081+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_clean_scrub_stamp":"2024-09-11T00:14:17.606538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:47:41.811458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:25.442962+0000","last_change":"2024-09-11T00:14:17.631555+0000","last_active":"2024-09-11T00:14:25.442962+0000","last_peered":"2024-09-11T00:14:25.442962+0000","last_clean":"2024-09-11T00:14:25.442962+0000","last_became_active":"2024-09-11T00:14:17.631295+0000","last_became_peered":"2024-09-11T00:14:17.631295+0000","last_unstale":"2024-09-11T00:14:25.442962+0000","last_undegraded":"2024-09-11T00:14:25.442962+0000","last_fullsized":"2024-09-11T00:14:25.442962+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:16.598908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:16.598908+0000","last_clean_scrub_stamp":"2024-09-11T00:14:16.598908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:31:48.757466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:24.883605+0000","last_change":"2024-09-11T00:14:22.688647+0000","last_active":"2024-09-11T00:14:24.883605+0000","last_peered":"2024-09-11T00:14:24.883605+0000","last_clean":"2024-09-11T00:14:24.883605+0000","last_became_active":"2024-09-11T00:14:22.688255+0000","last_became_peered":"2024-09-11T00:14:22.688255+0000","last_unstale":"2024-09-11T00:14:24.883605+0000","last_undegraded":"2024-09-11T00:14:24.883605+0000","last_fullsized":"2024-09-11T00:14:24.883605+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:21.633629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:21.633629+0000","last_clean_scrub_stamp":"2024-09-11T00:14:21.633629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:12:56.442243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:23.648452+0000","last_change":"2024-09-11T00:14:18.626265+0000","last_active":"2024-09-11T00:14:23.648452+0000","last_peered":"2024-09-11T00:14:23.648452+0000","last_clean":"2024-09-11T00:14:23.648452+0000","last_became_active":"2024-09-11T00:14:18.625997+0000","last_became_peered":"2024-09-11T00:14:18.625997+0000","last_unstale":"2024-09-11T00:14:23.648452+0000","last_undegraded":"2024-09-11T00:14:23.648452+0000","last_fullsized":"2024-09-11T00:14:23.648452+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_clean_scrub_stamp":"2024-09-11T00:14:17.606538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:34:07.533694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:23.651593+0000","last_change":"2024-09-11T00:14:17.627078+0000","last_active":"2024-09-11T00:14:23.651593+0000","last_peered":"2024-09-11T00:14:23.651593+0000","last_clean":"2024-09-11T00:14:23.651593+0000","last_became_active":"2024-09-11T00:14:17.626791+0000","last_became_peered":"2024-09-11T00:14:17.626791+0000","last_unstale":"2024-09-11T00:14:23.651593+0000","last_undegraded":"2024-09-11T00:14:23.651593+0000","last_fullsized":"2024-09-11T00:14:23.651593+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:16.598908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:16.598908+0000","last_clean_scrub_stamp":"2024-09-11T00:14:16.598908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:41:57.300139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":119,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:25.443097+0000","last_change":"2024-09-11T00:14:08.221813+0000","last_active":"2024-09-11T00:14:25.443097+0000","last_peered":"2024-09-11T00:14:25.443097+0000","last_clean":"2024-09-11T00:14:25.443097+0000","last_became_active":"2024-09-11T00:14:08.220663+0000","last_became_peered":"2024-09-11T00:14:08.220663+0000","last_unstale":"2024-09-11T00:14:25.443097+0000","last_undegraded":"2024-09-11T00:14:25.443097+0000","last_fullsized":"2024-09-11T00:14:25.443097+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:06.563107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:06.563107+0000","last_clean_scrub_stamp":"2024-09-11T00:14:06.563107+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:44:49.322583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:24.935219+0000","last_change":"2024-09-11T00:14:22.692059+0000","last_active":"2024-09-11T00:14:24.935219+0000","last_peered":"2024-09-11T00:14:24.935219+0000","last_clean":"2024-09-11T00:14:24.935219+0000","last_became_active":"2024-09-11T00:14:22.691622+0000","last_became_peered":"2024-09-11T00:14:22.691622+0000","last_unstale":"2024-09-11T00:14:24.935219+0000","last_undegraded":"2024-09-11T00:14:24.935219+0000","last_fullsized":"2024-09-11T00:14:24.935219+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:21.633629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:21.633629+0000","last_clean_scrub_stamp":"2024-09-11T00:14:21.633629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:17:20.492407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:25.443365+0000","last_change":"2024-09-11T00:14:18.643287+0000","last_active":"2024-09-11T00:14:25.443365+0000","last_peered":"2024-09-11T00:14:25.443365+0000","last_clean":"2024-09-11T00:14:25.443365+0000","last_became_active":"2024-09-11T00:14:18.642274+0000","last_became_peered":"2024-09-11T00:14:18.642274+0000","last_unstale":"2024-09-11T00:14:25.443365+0000","last_undegraded":"2024-09-11T00:14:25.443365+0000","last_fullsized":"2024-09-11T00:14:25.443365+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_clean_scrub_stamp":"2024-09-11T00:14:17.606538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:28:22.113765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:25.448581+0000","last_change":"2024-09-11T00:14:17.633759+0000","last_active":"2024-09-11T00:14:25.448581+0000","last_peered":"2024-09-11T00:14:25.448581+0000","last_clean":"2024-09-11T00:14:25.448581+0000","last_became_active":"2024-09-11T00:14:17.633445+0000","last_became_peered":"2024-09-11T00:14:17.633445+0000","last_unstale":"2024-09-11T00:14:25.448581+0000","last_undegraded":"2024-09-11T00:14:25.448581+0000","last_fullsized":"2024-09-11T00:14:25.448581+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:16.598908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:16.598908+0000","last_clean_scrub_stamp":"2024-09-11T00:14:16.598908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:52:38.739834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:24.934823+0000","last_change":"2024-09-11T00:14:22.688646+0000","last_active":"2024-09-11T00:14:24.934823+0000","last_peered":"2024-09-11T00:14:24.934823+0000","last_clean":"2024-09-11T00:14:24.934823+0000","last_became_active":"2024-09-11T00:14:22.688254+0000","last_became_peered":"2024-09-11T00:14:22.688254+0000","last_unstale":"2024-09-11T00:14:24.934823+0000","last_undegraded":"2024-09-11T00:14:24.934823+0000","last_fullsized":"2024-09-11T00:14:24.934823+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:21.633629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:21.633629+0000","last_clean_scrub_stamp":"2024-09-11T00:14:21.633629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:12:15.928177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:23.650905+0000","last_change":"2024-09-11T00:14:18.629290+0000","last_active":"2024-09-11T00:14:23.650905+0000","last_peered":"2024-09-11T00:14:23.650905+0000","last_clean":"2024-09-11T00:14:23.650905+0000","last_became_active":"2024-09-11T00:14:18.629028+0000","last_became_peered":"2024-09-11T00:14:18.629028+0000","last_unstale":"2024-09-11T00:14:23.650905+0000","last_undegraded":"2024-09-11T00:14:23.650905+0000","last_fullsized":"2024-09-11T00:14:23.650905+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_clean_scrub_stamp":"2024-09-11T00:14:17.606538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:49:46.087276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:25.448972+0000","last_change":"2024-09-11T00:14:17.634168+0000","last_active":"2024-09-11T00:14:25.448972+0000","last_peered":"2024-09-11T00:14:25.448972+0000","last_clean":"2024-09-11T00:14:25.448972+0000","last_became_active":"2024-09-11T00:14:17.633920+0000","last_became_peered":"2024-09-11T00:14:17.633920+0000","last_unstale":"2024-09-11T00:14:25.448972+0000","last_undegraded":"2024-09-11T00:14:25.448972+0000","last_fullsized":"2024-09-11T00:14:25.448972+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:16.598908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:16.598908+0000","last_clean_scrub_stamp":"2024-09-11T00:14:16.598908+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:31:48.757466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:24.883419+0000","last_change":"2024-09-11T00:14:22.669596+0000","last_active":"2024-09-11T00:14:24.883419+0000","last_peered":"2024-09-11T00:14:24.883419+0000","last_clean":"2024-09-11T00:14:24.883419+0000","last_became_active":"2024-09-11T00:14:22.669123+0000","last_became_peered":"2024-09-11T00:14:22.669123+0000","last_unstale":"2024-09-11T00:14:24.883419+0000","last_undegraded":"2024-09-11T00:14:24.883419+0000","last_fullsized":"2024-09-11T00:14:24.883419+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:21.633629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:21.633629+0000","last_clean_scrub_stamp":"2024-09-11T00:14:21.633629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:07:41.648631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:25.443770+0000","last_change":"2024-09-11T00:14:18.647802+0000","last_active":"2024-09-11T00:14:25.443770+0000","last_peered":"2024-09-11T00:14:25.443770+0000","last_clean":"2024-09-11T00:14:25.443770+0000","last_became_active":"2024-09-11T00:14:18.647512+0000","last_became_peered":"2024-09-11T00:14:18.647512+0000","last_unstale":"2024-09-11T00:14:25.443770+0000","last_undegraded":"2024-09-11T00:14:25.443770+0000","last_fullsized":"2024-09-11T00:14:25.443770+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_clean_scrub_stamp":"2024-09-11T00:14:17.606538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:04:59.988406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:25.448274+0000","last_change":"2024-09-11T00:14:17.624944+0000","last_active":"2024-09-11T00:14:25.448274+0000","last_peered":"2024-09-11T00:14:25.448274+0000","last_clean":"2024-09-11T00:14:25.448274+0000","last_became_active":"2024-09-11T00:14:17.624613+0000","last_became_peered":"2024-09-11T00:14:17.624613+0000","last_unstale":"2024-09-11T00:14:25.448274+0000","last_undegraded":"2024-09-11T00:14:25.448274+0000","last_fullsized":"2024-09-11T00:14:25.448274+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:16.598908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:16.598908+0000","last_clean_scrub_stamp":"2024-09-11T00:14:16.598908+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:30:53.963229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:23.650179+0000","last_change":"2024-09-11T00:14:22.689788+0000","last_active":"2024-09-11T00:14:23.650179+0000","last_peered":"2024-09-11T00:14:23.650179+0000","last_clean":"2024-09-11T00:14:23.650179+0000","last_became_active":"2024-09-11T00:14:22.689360+0000","last_became_peered":"2024-09-11T00:14:22.689360+0000","last_unstale":"2024-09-11T00:14:23.650179+0000","last_undegraded":"2024-09-11T00:14:23.650179+0000","last_fullsized":"2024-09-11T00:14:23.650179+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:21.633629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:21.633629+0000","last_clean_scrub_stamp":"2024-09-11T00:14:21.633629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:07:21.973974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:25.443628+0000","last_change":"2024-09-11T00:14:18.645675+0000","last_active":"2024-09-11T00:14:25.443628+0000","last_peered":"2024-09-11T00:14:25.443628+0000","last_clean":"2024-09-11T00:14:25.443628+0000","last_became_active":"2024-09-11T00:14:18.645400+0000","last_became_peered":"2024-09-11T00:14:18.645400+0000","last_unstale":"2024-09-11T00:14:25.443628+0000","last_undegraded":"2024-09-11T00:14:25.443628+0000","last_fullsized":"2024-09-11T00:14:25.443628+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_clean_scrub_stamp":"2024-09-11T00:14:17.606538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:18:45.202473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:23.652104+0000","last_change":"2024-09-11T00:14:17.634002+0000","last_active":"2024-09-11T00:14:23.652104+0000","last_peered":"2024-09-11T00:14:23.652104+0000","last_clean":"2024-09-11T00:14:23.652104+0000","last_became_active":"2024-09-11T00:14:17.633722+0000","last_became_peered":"2024-09-11T00:14:17.633722+0000","last_unstale":"2024-09-11T00:14:23.652104+0000","last_undegraded":"2024-09-11T00:14:23.652104+0000","last_fullsized":"2024-09-11T00:14:23.652104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:16.598908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:16.598908+0000","last_clean_scrub_stamp":"2024-09-11T00:14:16.598908+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:38:48.805212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:23.649985+0000","last_change":"2024-09-11T00:14:22.674989+0000","last_active":"2024-09-11T00:14:23.649985+0000","last_peered":"2024-09-11T00:14:23.649985+0000","last_clean":"2024-09-11T00:14:23.649985+0000","last_became_active":"2024-09-11T00:14:22.674093+0000","last_became_peered":"2024-09-11T00:14:22.674093+0000","last_unstale":"2024-09-11T00:14:23.649985+0000","last_undegraded":"2024-09-11T00:14:23.649985+0000","last_fullsized":"2024-09-11T00:14:23.649985+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:21.633629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:21.633629+0000","last_clean_scrub_stamp":"2024-09-11T00:14:21.633629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:51:34.161600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:25.443210+0000","last_change":"2024-09-11T00:14:18.645760+0000","last_active":"2024-09-11T00:14:25.443210+0000","last_peered":"2024-09-11T00:14:25.443210+0000","last_clean":"2024-09-11T00:14:25.443210+0000","last_became_active":"2024-09-11T00:14:18.645462+0000","last_became_peered":"2024-09-11T00:14:18.645462+0000","last_unstale":"2024-09-11T00:14:25.443210+0000","last_undegraded":"2024-09-11T00:14:25.443210+0000","last_fullsized":"2024-09-11T00:14:25.443210+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_clean_scrub_stamp":"2024-09-11T00:14:17.606538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:05:22.680084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":31,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:25.447934+0000","last_change":"2024-09-11T00:14:17.628485+0000","last_active":"2024-09-11T00:14:25.447934+0000","last_peered":"2024-09-11T00:14:25.447934+0000","last_clean":"2024-09-11T00:14:25.447934+0000","last_became_active":"2024-09-11T00:14:17.628222+0000","last_became_peered":"2024-09-11T00:14:17.628222+0000","last_unstale":"2024-09-11T00:14:25.447934+0000","last_undegraded":"2024-09-11T00:14:25.447934+0000","last_fullsized":"2024-09-11T00:14:25.447934+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:16.598908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:16.598908+0000","last_clean_scrub_stamp":"2024-09-11T00:14:16.598908+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:10:29.159080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:24.883394+0000","last_change":"2024-09-11T00:14:22.667660+0000","last_active":"2024-09-11T00:14:24.883394+0000","last_peered":"2024-09-11T00:14:24.883394+0000","last_clean":"2024-09-11T00:14:24.883394+0000","last_became_active":"2024-09-11T00:14:22.667251+0000","last_became_peered":"2024-09-11T00:14:22.667251+0000","last_unstale":"2024-09-11T00:14:24.883394+0000","last_undegraded":"2024-09-11T00:14:24.883394+0000","last_fullsized":"2024-09-11T00:14:24.883394+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:21.633629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:21.633629+0000","last_clean_scrub_stamp":"2024-09-11T00:14:21.633629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:49:50.114367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:24.934702+0000","last_change":"2024-09-11T00:14:18.638920+0000","last_active":"2024-09-11T00:14:24.934702+0000","last_peered":"2024-09-11T00:14:24.934702+0000","last_clean":"2024-09-11T00:14:24.934702+0000","last_became_active":"2024-09-11T00:14:18.638610+0000","last_became_peered":"2024-09-11T00:14:18.638610+0000","last_unstale":"2024-09-11T00:14:24.934702+0000","last_undegraded":"2024-09-11T00:14:24.934702+0000","last_fullsized":"2024-09-11T00:14:24.934702+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_clean_scrub_stamp":"2024-09-11T00:14:17.606538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:54:59.724551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:24.934755+0000","last_change":"2024-09-11T00:14:17.637068+0000","last_active":"2024-09-11T00:14:24.934755+0000","last_peered":"2024-09-11T00:14:24.934755+0000","last_clean":"2024-09-11T00:14:24.934755+0000","last_became_active":"2024-09-11T00:14:17.636624+0000","last_became_peered":"2024-09-11T00:14:17.636624+0000","last_unstale":"2024-09-11T00:14:24.934755+0000","last_undegraded":"2024-09-11T00:14:24.934755+0000","last_fullsized":"2024-09-11T00:14:24.934755+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:16.598908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:16.598908+0000","last_clean_scrub_stamp":"2024-09-11T00:14:16.598908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:10:29.159080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:23.649270+0000","last_change":"2024-09-11T00:14:22.690799+0000","last_active":"2024-09-11T00:14:23.649270+0000","last_peered":"2024-09-11T00:14:23.649270+0000","last_clean":"2024-09-11T00:14:23.649270+0000","last_became_active":"2024-09-11T00:14:22.690297+0000","last_became_peered":"2024-09-11T00:14:22.690297+0000","last_unstale":"2024-09-11T00:14:23.649270+0000","last_undegraded":"2024-09-11T00:14:23.649270+0000","last_fullsized":"2024-09-11T00:14:23.649270+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:21.633629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:21.633629+0000","last_clean_scrub_stamp":"2024-09-11T00:14:21.633629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:22:53.801030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:25.443367+0000","last_change":"2024-09-11T00:14:18.642784+0000","last_active":"2024-09-11T00:14:25.443367+0000","last_peered":"2024-09-11T00:14:25.443367+0000","last_clean":"2024-09-11T00:14:25.443367+0000","last_became_active":"2024-09-11T00:14:18.642508+0000","last_became_peered":"2024-09-11T00:14:18.642508+0000","last_unstale":"2024-09-11T00:14:25.443367+0000","last_undegraded":"2024-09-11T00:14:25.443367+0000","last_fullsized":"2024-09-11T00:14:25.443367+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_clean_scrub_stamp":"2024-09-11T00:14:17.606538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:25:18.398495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:23.652298+0000","last_change":"2024-09-11T00:14:17.623667+0000","last_active":"2024-09-11T00:14:23.652298+0000","last_peered":"2024-09-11T00:14:23.652298+0000","last_clean":"2024-09-11T00:14:23.652298+0000","last_became_active":"2024-09-11T00:14:17.623380+0000","last_became_peered":"2024-09-11T00:14:17.623380+0000","last_unstale":"2024-09-11T00:14:23.652298+0000","last_undegraded":"2024-09-11T00:14:23.652298+0000","last_fullsized":"2024-09-11T00:14:23.652298+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:16.598908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:16.598908+0000","last_clean_scrub_stamp":"2024-09-11T00:14:16.598908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:42:38.574433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:23.648776+0000","last_change":"2024-09-11T00:14:22.688511+0000","last_active":"2024-09-11T00:14:23.648776+0000","last_peered":"2024-09-11T00:14:23.648776+0000","last_clean":"2024-09-11T00:14:23.648776+0000","last_became_active":"2024-09-11T00:14:22.688105+0000","last_became_peered":"2024-09-11T00:14:22.688105+0000","last_unstale":"2024-09-11T00:14:23.648776+0000","last_undegraded":"2024-09-11T00:14:23.648776+0000","last_fullsized":"2024-09-11T00:14:23.648776+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:21.633629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:21.633629+0000","last_clean_scrub_stamp":"2024-09-11T00:14:21.633629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:23:20.020672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:24.883270+0000","last_change":"2024-09-11T00:14:18.641786+0000","last_active":"2024-09-11T00:14:24.883270+0000","last_peered":"2024-09-11T00:14:24.883270+0000","last_clean":"2024-09-11T00:14:24.883270+0000","last_became_active":"2024-09-11T00:14:18.641529+0000","last_became_peered":"2024-09-11T00:14:18.641529+0000","last_unstale":"2024-09-11T00:14:24.883270+0000","last_undegraded":"2024-09-11T00:14:24.883270+0000","last_fullsized":"2024-09-11T00:14:24.883270+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_clean_scrub_stamp":"2024-09-11T00:14:17.606538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:35:44.502418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:24.883594+0000","last_change":"2024-09-11T00:14:17.635250+0000","last_active":"2024-09-11T00:14:24.883594+0000","last_peered":"2024-09-11T00:14:24.883594+0000","last_clean":"2024-09-11T00:14:24.883594+0000","last_became_active":"2024-09-11T00:14:17.634962+0000","last_became_peered":"2024-09-11T00:14:17.634962+0000","last_unstale":"2024-09-11T00:14:24.883594+0000","last_undegraded":"2024-09-11T00:14:24.883594+0000","last_fullsized":"2024-09-11T00:14:24.883594+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:16.598908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:16.598908+0000","last_clean_scrub_stamp":"2024-09-11T00:14:16.598908+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:02:04.954945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:23.651089+0000","last_change":"2024-09-11T00:14:22.688665+0000","last_active":"2024-09-11T00:14:23.651089+0000","last_peered":"2024-09-11T00:14:23.651089+0000","last_clean":"2024-09-11T00:14:23.651089+0000","last_became_active":"2024-09-11T00:14:22.688285+0000","last_became_peered":"2024-09-11T00:14:22.688285+0000","last_unstale":"2024-09-11T00:14:23.651089+0000","last_undegraded":"2024-09-11T00:14:23.651089+0000","last_fullsized":"2024-09-11T00:14:23.651089+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:21.633629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:21.633629+0000","last_clean_scrub_stamp":"2024-09-11T00:14:21.633629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:14:32.578348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:25.443331+0000","last_change":"2024-09-11T00:14:18.644136+0000","last_active":"2024-09-11T00:14:25.443331+0000","last_peered":"2024-09-11T00:14:25.443331+0000","last_clean":"2024-09-11T00:14:25.443331+0000","last_became_active":"2024-09-11T00:14:18.642976+0000","last_became_peered":"2024-09-11T00:14:18.642976+0000","last_unstale":"2024-09-11T00:14:25.443331+0000","last_undegraded":"2024-09-11T00:14:25.443331+0000","last_fullsized":"2024-09-11T00:14:25.443331+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_clean_scrub_stamp":"2024-09-11T00:14:17.606538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:58:16.831016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"25'9","reported_seq":32,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:28.050349+0000","last_change":"2024-09-11T00:14:17.633618+0000","last_active":"2024-09-11T00:14:28.050349+0000","last_peered":"2024-09-11T00:14:28.050349+0000","last_clean":"2024-09-11T00:14:28.050349+0000","last_became_active":"2024-09-11T00:14:17.632701+0000","last_became_peered":"2024-09-11T00:14:17.632701+0000","last_unstale":"2024-09-11T00:14:28.050349+0000","last_undegraded":"2024-09-11T00:14:28.050349+0000","last_fullsized":"2024-09-11T00:14:28.050349+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:16.598908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:16.598908+0000","last_clean_scrub_stamp":"2024-09-11T00:14:16.598908+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:10:37.852358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:25.448757+0000","last_change":"2024-09-11T00:14:22.664837+0000","last_active":"2024-09-11T00:14:25.448757+0000","last_peered":"2024-09-11T00:14:25.448757+0000","last_clean":"2024-09-11T00:14:25.448757+0000","last_became_active":"2024-09-11T00:14:22.663868+0000","last_became_peered":"2024-09-11T00:14:22.663868+0000","last_unstale":"2024-09-11T00:14:25.448757+0000","last_undegraded":"2024-09-11T00:14:25.448757+0000","last_fullsized":"2024-09-11T00:14:25.448757+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:21.633629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:21.633629+0000","last_clean_scrub_stamp":"2024-09-11T00:14:21.633629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:51:23.630707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:23.652267+0000","last_change":"2024-09-11T00:14:18.641013+0000","last_active":"2024-09-11T00:14:23.652267+0000","last_peered":"2024-09-11T00:14:23.652267+0000","last_clean":"2024-09-11T00:14:23.652267+0000","last_became_active":"2024-09-11T00:14:18.640690+0000","last_became_peered":"2024-09-11T00:14:18.640690+0000","last_unstale":"2024-09-11T00:14:23.652267+0000","last_undegraded":"2024-09-11T00:14:23.652267+0000","last_fullsized":"2024-09-11T00:14:23.652267+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_clean_scrub_stamp":"2024-09-11T00:14:17.606538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:22:59.454003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:25.448873+0000","last_change":"2024-09-11T00:14:17.637712+0000","last_active":"2024-09-11T00:14:25.448873+0000","last_peered":"2024-09-11T00:14:25.448873+0000","last_clean":"2024-09-11T00:14:25.448873+0000","last_became_active":"2024-09-11T00:14:17.637463+0000","last_became_peered":"2024-09-11T00:14:17.637463+0000","last_unstale":"2024-09-11T00:14:25.448873+0000","last_undegraded":"2024-09-11T00:14:25.448873+0000","last_fullsized":"2024-09-11T00:14:25.448873+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:16.598908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:16.598908+0000","last_clean_scrub_stamp":"2024-09-11T00:14:16.598908+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:43:47.266406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:23.650677+0000","last_change":"2024-09-11T00:14:22.664447+0000","last_active":"2024-09-11T00:14:23.650677+0000","last_peered":"2024-09-11T00:14:23.650677+0000","last_clean":"2024-09-11T00:14:23.650677+0000","last_became_active":"2024-09-11T00:14:22.663920+0000","last_became_peered":"2024-09-11T00:14:22.663920+0000","last_unstale":"2024-09-11T00:14:23.650677+0000","last_undegraded":"2024-09-11T00:14:23.650677+0000","last_fullsized":"2024-09-11T00:14:23.650677+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:21.633629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:21.633629+0000","last_clean_scrub_stamp":"2024-09-11T00:14:21.633629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:55:56.768777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:24.883554+0000","last_change":"2024-09-11T00:14:18.630232+0000","last_active":"2024-09-11T00:14:24.883554+0000","last_peered":"2024-09-11T00:14:24.883554+0000","last_clean":"2024-09-11T00:14:24.883554+0000","last_became_active":"2024-09-11T00:14:18.629885+0000","last_became_peered":"2024-09-11T00:14:18.629885+0000","last_unstale":"2024-09-11T00:14:24.883554+0000","last_undegraded":"2024-09-11T00:14:24.883554+0000","last_fullsized":"2024-09-11T00:14:24.883554+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_clean_scrub_stamp":"2024-09-11T00:14:17.606538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:05:45.558170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:23.650676+0000","last_change":"2024-09-11T00:14:17.632228+0000","last_active":"2024-09-11T00:14:23.650676+0000","last_peered":"2024-09-11T00:14:23.650676+0000","last_clean":"2024-09-11T00:14:23.650676+0000","last_became_active":"2024-09-11T00:14:17.631908+0000","last_became_peered":"2024-09-11T00:14:17.631908+0000","last_unstale":"2024-09-11T00:14:23.650676+0000","last_undegraded":"2024-09-11T00:14:23.650676+0000","last_fullsized":"2024-09-11T00:14:23.650676+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:16.598908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:16.598908+0000","last_clean_scrub_stamp":"2024-09-11T00:14:16.598908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:11:19.690215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:23.648399+0000","last_change":"2024-09-11T00:14:22.671970+0000","last_active":"2024-09-11T00:14:23.648399+0000","last_peered":"2024-09-11T00:14:23.648399+0000","last_clean":"2024-09-11T00:14:23.648399+0000","last_became_active":"2024-09-11T00:14:22.671536+0000","last_became_peered":"2024-09-11T00:14:22.671536+0000","last_unstale":"2024-09-11T00:14:23.648399+0000","last_undegraded":"2024-09-11T00:14:23.648399+0000","last_fullsized":"2024-09-11T00:14:23.648399+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:21.633629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:21.633629+0000","last_clean_scrub_stamp":"2024-09-11T00:14:21.633629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:42:10.576151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:23.650561+0000","last_change":"2024-09-11T00:14:18.639664+0000","last_active":"2024-09-11T00:14:23.650561+0000","last_peered":"2024-09-11T00:14:23.650561+0000","last_clean":"2024-09-11T00:14:23.650561+0000","last_became_active":"2024-09-11T00:14:18.639215+0000","last_became_peered":"2024-09-11T00:14:18.639215+0000","last_unstale":"2024-09-11T00:14:23.650561+0000","last_undegraded":"2024-09-11T00:14:23.650561+0000","last_fullsized":"2024-09-11T00:14:23.650561+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_clean_scrub_stamp":"2024-09-11T00:14:17.606538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:38:46.884984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:24.935237+0000","last_change":"2024-09-11T00:14:17.638296+0000","last_active":"2024-09-11T00:14:24.935237+0000","last_peered":"2024-09-11T00:14:24.935237+0000","last_clean":"2024-09-11T00:14:24.935237+0000","last_became_active":"2024-09-11T00:14:17.637629+0000","last_became_peered":"2024-09-11T00:14:17.637629+0000","last_unstale":"2024-09-11T00:14:24.935237+0000","last_undegraded":"2024-09-11T00:14:24.935237+0000","last_fullsized":"2024-09-11T00:14:24.935237+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:16.598908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:16.598908+0000","last_clean_scrub_stamp":"2024-09-11T00:14:16.598908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:30:53.963229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:23.648342+0000","last_change":"2024-09-11T00:14:22.692320+0000","last_active":"2024-09-11T00:14:23.648342+0000","last_peered":"2024-09-11T00:14:23.648342+0000","last_clean":"2024-09-11T00:14:23.648342+0000","last_became_active":"2024-09-11T00:14:22.691110+0000","last_became_peered":"2024-09-11T00:14:22.691110+0000","last_unstale":"2024-09-11T00:14:23.648342+0000","last_undegraded":"2024-09-11T00:14:23.648342+0000","last_fullsized":"2024-09-11T00:14:23.648342+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:21.633629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:21.633629+0000","last_clean_scrub_stamp":"2024-09-11T00:14:21.633629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:19:13.639166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:24.883414+0000","last_change":"2024-09-11T00:14:22.692131+0000","last_active":"2024-09-11T00:14:24.883414+0000","last_peered":"2024-09-11T00:14:24.883414+0000","last_clean":"2024-09-11T00:14:24.883414+0000","last_became_active":"2024-09-11T00:14:22.691743+0000","last_became_peered":"2024-09-11T00:14:22.691743+0000","last_unstale":"2024-09-11T00:14:24.883414+0000","last_undegraded":"2024-09-11T00:14:24.883414+0000","last_fullsized":"2024-09-11T00:14:24.883414+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:21.633629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:21.633629+0000","last_clean_scrub_stamp":"2024-09-11T00:14:21.633629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:18:49.229564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:25.448449+0000","last_change":"2024-09-11T00:14:18.627489+0000","last_active":"2024-09-11T00:14:25.448449+0000","last_peered":"2024-09-11T00:14:25.448449+0000","last_clean":"2024-09-11T00:14:25.448449+0000","last_became_active":"2024-09-11T00:14:18.627227+0000","last_became_peered":"2024-09-11T00:14:18.627227+0000","last_unstale":"2024-09-11T00:14:25.448449+0000","last_undegraded":"2024-09-11T00:14:25.448449+0000","last_fullsized":"2024-09-11T00:14:25.448449+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_clean_scrub_stamp":"2024-09-11T00:14:17.606538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:20:59.721295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:23.650568+0000","last_change":"2024-09-11T00:14:17.633563+0000","last_active":"2024-09-11T00:14:23.650568+0000","last_peered":"2024-09-11T00:14:23.650568+0000","last_clean":"2024-09-11T00:14:23.650568+0000","last_became_active":"2024-09-11T00:14:17.633316+0000","last_became_peered":"2024-09-11T00:14:17.633316+0000","last_unstale":"2024-09-11T00:14:23.650568+0000","last_undegraded":"2024-09-11T00:14:23.650568+0000","last_fullsized":"2024-09-11T00:14:23.650568+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:16.598908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:16.598908+0000","last_clean_scrub_stamp":"2024-09-11T00:14:16.598908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:52:22.626375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:24.935339+0000","last_change":"2024-09-11T00:14:22.670666+0000","last_active":"2024-09-11T00:14:24.935339+0000","last_peered":"2024-09-11T00:14:24.935339+0000","last_clean":"2024-09-11T00:14:24.935339+0000","last_became_active":"2024-09-11T00:14:22.670286+0000","last_became_peered":"2024-09-11T00:14:22.670286+0000","last_unstale":"2024-09-11T00:14:24.935339+0000","last_undegraded":"2024-09-11T00:14:24.935339+0000","last_fullsized":"2024-09-11T00:14:24.935339+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:21.633629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:21.633629+0000","last_clean_scrub_stamp":"2024-09-11T00:14:21.633629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:53:06.573918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:23.648370+0000","last_change":"2024-09-11T00:14:18.634072+0000","last_active":"2024-09-11T00:14:23.648370+0000","last_peered":"2024-09-11T00:14:23.648370+0000","last_clean":"2024-09-11T00:14:23.648370+0000","last_became_active":"2024-09-11T00:14:18.633811+0000","last_became_peered":"2024-09-11T00:14:18.633811+0000","last_unstale":"2024-09-11T00:14:23.648370+0000","last_undegraded":"2024-09-11T00:14:23.648370+0000","last_fullsized":"2024-09-11T00:14:23.648370+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_clean_scrub_stamp":"2024-09-11T00:14:17.606538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:35:44.502418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:23.648649+0000","last_change":"2024-09-11T00:14:17.631993+0000","last_active":"2024-09-11T00:14:23.648649+0000","last_peered":"2024-09-11T00:14:23.648649+0000","last_clean":"2024-09-11T00:14:23.648649+0000","last_became_active":"2024-09-11T00:14:17.631645+0000","last_became_peered":"2024-09-11T00:14:17.631645+0000","last_unstale":"2024-09-11T00:14:23.648649+0000","last_undegraded":"2024-09-11T00:14:23.648649+0000","last_fullsized":"2024-09-11T00:14:23.648649+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:16.598908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:16.598908+0000","last_clean_scrub_stamp":"2024-09-11T00:14:16.598908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:55:22.582535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:24.934838+0000","last_change":"2024-09-11T00:14:17.634075+0000","last_active":"2024-09-11T00:14:24.934838+0000","last_peered":"2024-09-11T00:14:24.934838+0000","last_clean":"2024-09-11T00:14:24.934838+0000","last_became_active":"2024-09-11T00:14:17.633595+0000","last_became_peered":"2024-09-11T00:14:17.633595+0000","last_unstale":"2024-09-11T00:14:24.934838+0000","last_undegraded":"2024-09-11T00:14:24.934838+0000","last_fullsized":"2024-09-11T00:14:24.934838+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:16.598908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:16.598908+0000","last_clean_scrub_stamp":"2024-09-11T00:14:16.598908+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:51:02.481656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:24.883579+0000","last_change":"2024-09-11T00:14:18.642731+0000","last_active":"2024-09-11T00:14:24.883579+0000","last_peered":"2024-09-11T00:14:24.883579+0000","last_clean":"2024-09-11T00:14:24.883579+0000","last_became_active":"2024-09-11T00:14:18.642296+0000","last_became_peered":"2024-09-11T00:14:18.642296+0000","last_unstale":"2024-09-11T00:14:24.883579+0000","last_undegraded":"2024-09-11T00:14:24.883579+0000","last_fullsized":"2024-09-11T00:14:24.883579+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_clean_scrub_stamp":"2024-09-11T00:14:17.606538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:49:06.208715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:25.448556+0000","last_change":"2024-09-11T00:14:22.674116+0000","last_active":"2024-09-11T00:14:25.448556+0000","last_peered":"2024-09-11T00:14:25.448556+0000","last_clean":"2024-09-11T00:14:25.448556+0000","last_became_active":"2024-09-11T00:14:22.673701+0000","last_became_peered":"2024-09-11T00:14:22.673701+0000","last_unstale":"2024-09-11T00:14:25.448556+0000","last_undegraded":"2024-09-11T00:14:25.448556+0000","last_fullsized":"2024-09-11T00:14:25.448556+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:21.633629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:21.633629+0000","last_clean_scrub_stamp":"2024-09-11T00:14:21.633629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:22:35.167801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:23.648729+0000","last_change":"2024-09-11T00:14:17.632276+0000","last_active":"2024-09-11T00:14:23.648729+0000","last_peered":"2024-09-11T00:14:23.648729+0000","last_clean":"2024-09-11T00:14:23.648729+0000","last_became_active":"2024-09-11T00:14:17.631820+0000","last_became_peered":"2024-09-11T00:14:17.631820+0000","last_unstale":"2024-09-11T00:14:23.648729+0000","last_undegraded":"2024-09-11T00:14:23.648729+0000","last_fullsized":"2024-09-11T00:14:23.648729+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:16.598908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:16.598908+0000","last_clean_scrub_stamp":"2024-09-11T00:14:16.598908+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:20:56.408317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:23.650684+0000","last_change":"2024-09-11T00:14:18.631229+0000","last_active":"2024-09-11T00:14:23.650684+0000","last_peered":"2024-09-11T00:14:23.650684+0000","last_clean":"2024-09-11T00:14:23.650684+0000","last_became_active":"2024-09-11T00:14:18.630830+0000","last_became_peered":"2024-09-11T00:14:18.630830+0000","last_unstale":"2024-09-11T00:14:23.650684+0000","last_undegraded":"2024-09-11T00:14:23.650684+0000","last_fullsized":"2024-09-11T00:14:23.650684+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_clean_scrub_stamp":"2024-09-11T00:14:17.606538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:39:00.086315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:23.649013+0000","last_change":"2024-09-11T00:14:22.675138+0000","last_active":"2024-09-11T00:14:23.649013+0000","last_peered":"2024-09-11T00:14:23.649013+0000","last_clean":"2024-09-11T00:14:23.649013+0000","last_became_active":"2024-09-11T00:14:22.674701+0000","last_became_peered":"2024-09-11T00:14:22.674701+0000","last_unstale":"2024-09-11T00:14:23.649013+0000","last_undegraded":"2024-09-11T00:14:23.649013+0000","last_fullsized":"2024-09-11T00:14:23.649013+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:21.633629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:21.633629+0000","last_clean_scrub_stamp":"2024-09-11T00:14:21.633629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:16:25.651997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:24.934564+0000","last_change":"2024-09-11T00:14:18.639301+0000","last_active":"2024-09-11T00:14:24.934564+0000","last_peered":"2024-09-11T00:14:24.934564+0000","last_clean":"2024-09-11T00:14:24.934564+0000","last_became_active":"2024-09-11T00:14:18.639038+0000","last_became_peered":"2024-09-11T00:14:18.639038+0000","last_unstale":"2024-09-11T00:14:24.934564+0000","last_undegraded":"2024-09-11T00:14:24.934564+0000","last_fullsized":"2024-09-11T00:14:24.934564+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_clean_scrub_stamp":"2024-09-11T00:14:17.606538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:24:12.007225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:25.448031+0000","last_change":"2024-09-11T00:14:18.623623+0000","last_active":"2024-09-11T00:14:25.448031+0000","last_peered":"2024-09-11T00:14:25.448031+0000","last_clean":"2024-09-11T00:14:25.448031+0000","last_became_active":"2024-09-11T00:14:18.623328+0000","last_became_peered":"2024-09-11T00:14:18.623328+0000","last_unstale":"2024-09-11T00:14:25.448031+0000","last_undegraded":"2024-09-11T00:14:25.448031+0000","last_fullsized":"2024-09-11T00:14:25.448031+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_clean_scrub_stamp":"2024-09-11T00:14:17.606538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:00:51.172893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:23.652194+0000","last_change":"2024-09-11T00:14:18.628493+0000","last_active":"2024-09-11T00:14:23.652194+0000","last_peered":"2024-09-11T00:14:23.652194+0000","last_clean":"2024-09-11T00:14:23.652194+0000","last_became_active":"2024-09-11T00:14:18.628040+0000","last_became_peered":"2024-09-11T00:14:18.628040+0000","last_unstale":"2024-09-11T00:14:23.652194+0000","last_undegraded":"2024-09-11T00:14:23.652194+0000","last_fullsized":"2024-09-11T00:14:23.652194+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_clean_scrub_stamp":"2024-09-11T00:14:17.606538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:24:40.790020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:24.883499+0000","last_change":"2024-09-11T00:14:18.633950+0000","last_active":"2024-09-11T00:14:24.883499+0000","last_peered":"2024-09-11T00:14:24.883499+0000","last_clean":"2024-09-11T00:14:24.883499+0000","last_became_active":"2024-09-11T00:14:18.633147+0000","last_became_peered":"2024-09-11T00:14:18.633147+0000","last_unstale":"2024-09-11T00:14:24.883499+0000","last_undegraded":"2024-09-11T00:14:24.883499+0000","last_fullsized":"2024-09-11T00:14:24.883499+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_clean_scrub_stamp":"2024-09-11T00:14:17.606538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:46:52.007701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:23.648966+0000","last_change":"2024-09-11T00:14:18.626152+0000","last_active":"2024-09-11T00:14:23.648966+0000","last_peered":"2024-09-11T00:14:23.648966+0000","last_clean":"2024-09-11T00:14:23.648966+0000","last_became_active":"2024-09-11T00:14:18.625885+0000","last_became_peered":"2024-09-11T00:14:18.625885+0000","last_unstale":"2024-09-11T00:14:23.648966+0000","last_undegraded":"2024-09-11T00:14:23.648966+0000","last_fullsized":"2024-09-11T00:14:23.648966+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_clean_scrub_stamp":"2024-09-11T00:14:17.606538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:11:01.606959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:25.448276+0000","last_change":"2024-09-11T00:14:18.626762+0000","last_active":"2024-09-11T00:14:25.448276+0000","last_peered":"2024-09-11T00:14:25.448276+0000","last_clean":"2024-09-11T00:14:25.448276+0000","last_became_active":"2024-09-11T00:14:18.626537+0000","last_became_peered":"2024-09-11T00:14:18.626537+0000","last_unstale":"2024-09-11T00:14:25.448276+0000","last_undegraded":"2024-09-11T00:14:25.448276+0000","last_fullsized":"2024-09-11T00:14:25.448276+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_clean_scrub_stamp":"2024-09-11T00:14:17.606538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:03:25.203629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:24.935246+0000","last_change":"2024-09-11T00:14:18.642453+0000","last_active":"2024-09-11T00:14:24.935246+0000","last_peered":"2024-09-11T00:14:24.935246+0000","last_clean":"2024-09-11T00:14:24.935246+0000","last_became_active":"2024-09-11T00:14:18.642172+0000","last_became_peered":"2024-09-11T00:14:18.642172+0000","last_unstale":"2024-09-11T00:14:24.935246+0000","last_undegraded":"2024-09-11T00:14:24.935246+0000","last_fullsized":"2024-09-11T00:14:24.935246+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_clean_scrub_stamp":"2024-09-11T00:14:17.606538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:48:16.815773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:23.649246+0000","last_change":"2024-09-11T00:14:18.628632+0000","last_active":"2024-09-11T00:14:23.649246+0000","last_peered":"2024-09-11T00:14:23.649246+0000","last_clean":"2024-09-11T00:14:23.649246+0000","last_became_active":"2024-09-11T00:14:18.628308+0000","last_became_peered":"2024-09-11T00:14:18.628308+0000","last_unstale":"2024-09-11T00:14:23.649246+0000","last_undegraded":"2024-09-11T00:14:23.649246+0000","last_fullsized":"2024-09-11T00:14:23.649246+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_clean_scrub_stamp":"2024-09-11T00:14:17.606538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:24:40.790020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:23.650453+0000","last_change":"2024-09-11T00:14:18.630942+0000","last_active":"2024-09-11T00:14:23.650453+0000","last_peered":"2024-09-11T00:14:23.650453+0000","last_clean":"2024-09-11T00:14:23.650453+0000","last_became_active":"2024-09-11T00:14:18.630223+0000","last_became_peered":"2024-09-11T00:14:18.630223+0000","last_unstale":"2024-09-11T00:14:23.650453+0000","last_undegraded":"2024-09-11T00:14:23.650453+0000","last_fullsized":"2024-09-11T00:14:23.650453+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_clean_scrub_stamp":"2024-09-11T00:14:17.606538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:34:07.533694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:23.648607+0000","last_change":"2024-09-11T00:14:18.628072+0000","last_active":"2024-09-11T00:14:23.648607+0000","last_peered":"2024-09-11T00:14:23.648607+0000","last_clean":"2024-09-11T00:14:23.648607+0000","last_became_active":"2024-09-11T00:14:18.627801+0000","last_became_peered":"2024-09-11T00:14:18.627801+0000","last_unstale":"2024-09-11T00:14:23.648607+0000","last_undegraded":"2024-09-11T00:14:23.648607+0000","last_fullsized":"2024-09-11T00:14:23.648607+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_clean_scrub_stamp":"2024-09-11T00:14:17.606538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:27:57.991308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:23.652067+0000","last_change":"2024-09-11T00:14:18.633583+0000","last_active":"2024-09-11T00:14:23.652067+0000","last_peered":"2024-09-11T00:14:23.652067+0000","last_clean":"2024-09-11T00:14:23.652067+0000","last_became_active":"2024-09-11T00:14:18.633263+0000","last_became_peered":"2024-09-11T00:14:18.633263+0000","last_unstale":"2024-09-11T00:14:23.652067+0000","last_undegraded":"2024-09-11T00:14:23.652067+0000","last_fullsized":"2024-09-11T00:14:23.652067+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_clean_scrub_stamp":"2024-09-11T00:14:17.606538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:24:44.702294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:24.883238+0000","last_change":"2024-09-11T00:14:18.642759+0000","last_active":"2024-09-11T00:14:24.883238+0000","last_peered":"2024-09-11T00:14:24.883238+0000","last_clean":"2024-09-11T00:14:24.883238+0000","last_became_active":"2024-09-11T00:14:18.642466+0000","last_became_peered":"2024-09-11T00:14:18.642466+0000","last_unstale":"2024-09-11T00:14:24.883238+0000","last_undegraded":"2024-09-11T00:14:24.883238+0000","last_fullsized":"2024-09-11T00:14:24.883238+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_clean_scrub_stamp":"2024-09-11T00:14:17.606538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:54:15.924007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:24.934959+0000","last_change":"2024-09-11T00:14:18.647847+0000","last_active":"2024-09-11T00:14:24.934959+0000","last_peered":"2024-09-11T00:14:24.934959+0000","last_clean":"2024-09-11T00:14:24.934959+0000","last_became_active":"2024-09-11T00:14:18.647379+0000","last_became_peered":"2024-09-11T00:14:18.647379+0000","last_unstale":"2024-09-11T00:14:24.934959+0000","last_undegraded":"2024-09-11T00:14:24.934959+0000","last_fullsized":"2024-09-11T00:14:24.934959+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_clean_scrub_stamp":"2024-09-11T00:14:17.606538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:18:09.026105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:25.443565+0000","last_change":"2024-09-11T00:14:18.643993+0000","last_active":"2024-09-11T00:14:25.443565+0000","last_peered":"2024-09-11T00:14:25.443565+0000","last_clean":"2024-09-11T00:14:25.443565+0000","last_became_active":"2024-09-11T00:14:18.642576+0000","last_became_peered":"2024-09-11T00:14:18.642576+0000","last_unstale":"2024-09-11T00:14:25.443565+0000","last_undegraded":"2024-09-11T00:14:25.443565+0000","last_fullsized":"2024-09-11T00:14:25.443565+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_clean_scrub_stamp":"2024-09-11T00:14:17.606538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:49:46.087276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:25.448220+0000","last_change":"2024-09-11T00:14:18.634965+0000","last_active":"2024-09-11T00:14:25.448220+0000","last_peered":"2024-09-11T00:14:25.448220+0000","last_clean":"2024-09-11T00:14:25.448220+0000","last_became_active":"2024-09-11T00:14:18.634667+0000","last_became_peered":"2024-09-11T00:14:18.634667+0000","last_unstale":"2024-09-11T00:14:25.448220+0000","last_undegraded":"2024-09-11T00:14:25.448220+0000","last_fullsized":"2024-09-11T00:14:25.448220+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_clean_scrub_stamp":"2024-09-11T00:14:17.606538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:05:38.063905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:23.650745+0000","last_change":"2024-09-11T00:14:18.645434+0000","last_active":"2024-09-11T00:14:23.650745+0000","last_peered":"2024-09-11T00:14:23.650745+0000","last_clean":"2024-09-11T00:14:23.650745+0000","last_became_active":"2024-09-11T00:14:18.645012+0000","last_became_peered":"2024-09-11T00:14:18.645012+0000","last_unstale":"2024-09-11T00:14:23.650745+0000","last_undegraded":"2024-09-11T00:14:23.650745+0000","last_fullsized":"2024-09-11T00:14:23.650745+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_clean_scrub_stamp":"2024-09-11T00:14:17.606538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:07:37.621540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:23.650343+0000","last_change":"2024-09-11T00:14:18.635751+0000","last_active":"2024-09-11T00:14:23.650343+0000","last_peered":"2024-09-11T00:14:23.650343+0000","last_clean":"2024-09-11T00:14:23.650343+0000","last_became_active":"2024-09-11T00:14:18.635450+0000","last_became_peered":"2024-09-11T00:14:18.635450+0000","last_unstale":"2024-09-11T00:14:23.650343+0000","last_undegraded":"2024-09-11T00:14:23.650343+0000","last_fullsized":"2024-09-11T00:14:23.650343+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_clean_scrub_stamp":"2024-09-11T00:14:17.606538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:13:02.693352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:25.448536+0000","last_change":"2024-09-11T00:14:18.623006+0000","last_active":"2024-09-11T00:14:25.448536+0000","last_peered":"2024-09-11T00:14:25.448536+0000","last_clean":"2024-09-11T00:14:25.448536+0000","last_became_active":"2024-09-11T00:14:18.622744+0000","last_became_peered":"2024-09-11T00:14:18.622744+0000","last_unstale":"2024-09-11T00:14:25.448536+0000","last_undegraded":"2024-09-11T00:14:25.448536+0000","last_fullsized":"2024-09-11T00:14:25.448536+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_clean_scrub_stamp":"2024-09-11T00:14:17.606538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:25:01.082594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:24.883243+0000","last_change":"2024-09-11T00:14:18.631985+0000","last_active":"2024-09-11T00:14:24.883243+0000","last_peered":"2024-09-11T00:14:24.883243+0000","last_clean":"2024-09-11T00:14:24.883243+0000","last_became_active":"2024-09-11T00:14:18.631307+0000","last_became_peered":"2024-09-11T00:14:18.631307+0000","last_unstale":"2024-09-11T00:14:24.883243+0000","last_undegraded":"2024-09-11T00:14:24.883243+0000","last_fullsized":"2024-09-11T00:14:24.883243+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_clean_scrub_stamp":"2024-09-11T00:14:17.606538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:40:30.015285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:23.648594+0000","last_change":"2024-09-11T00:14:18.633438+0000","last_active":"2024-09-11T00:14:23.648594+0000","last_peered":"2024-09-11T00:14:23.648594+0000","last_clean":"2024-09-11T00:14:23.648594+0000","last_became_active":"2024-09-11T00:14:18.633192+0000","last_became_peered":"2024-09-11T00:14:18.633192+0000","last_unstale":"2024-09-11T00:14:23.648594+0000","last_undegraded":"2024-09-11T00:14:23.648594+0000","last_fullsized":"2024-09-11T00:14:23.648594+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_clean_scrub_stamp":"2024-09-11T00:14:17.606538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:13:02.693352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:23.652159+0000","last_change":"2024-09-11T00:14:18.640308+0000","last_active":"2024-09-11T00:14:23.652159+0000","last_peered":"2024-09-11T00:14:23.652159+0000","last_clean":"2024-09-11T00:14:23.652159+0000","last_became_active":"2024-09-11T00:14:18.640051+0000","last_became_peered":"2024-09-11T00:14:18.640051+0000","last_unstale":"2024-09-11T00:14:23.652159+0000","last_undegraded":"2024-09-11T00:14:23.652159+0000","last_fullsized":"2024-09-11T00:14:23.652159+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_clean_scrub_stamp":"2024-09-11T00:14:17.606538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:11:16.975202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:24.935109+0000","last_change":"2024-09-11T00:14:18.636880+0000","last_active":"2024-09-11T00:14:24.935109+0000","last_peered":"2024-09-11T00:14:24.935109+0000","last_clean":"2024-09-11T00:14:24.935109+0000","last_became_active":"2024-09-11T00:14:18.636592+0000","last_became_peered":"2024-09-11T00:14:18.636592+0000","last_unstale":"2024-09-11T00:14:24.935109+0000","last_undegraded":"2024-09-11T00:14:24.935109+0000","last_fullsized":"2024-09-11T00:14:24.935109+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_clean_scrub_stamp":"2024-09-11T00:14:17.606538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:05:21.082012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:24.935192+0000","last_change":"2024-09-11T00:14:18.638064+0000","last_active":"2024-09-11T00:14:24.935192+0000","last_peered":"2024-09-11T00:14:24.935192+0000","last_clean":"2024-09-11T00:14:24.935192+0000","last_became_active":"2024-09-11T00:14:18.637558+0000","last_became_peered":"2024-09-11T00:14:18.637558+0000","last_unstale":"2024-09-11T00:14:24.935192+0000","last_undegraded":"2024-09-11T00:14:24.935192+0000","last_fullsized":"2024-09-11T00:14:24.935192+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_clean_scrub_stamp":"2024-09-11T00:14:17.606538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:09:24.787612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:25.443755+0000","last_change":"2024-09-11T00:14:18.641166+0000","last_active":"2024-09-11T00:14:25.443755+0000","last_peered":"2024-09-11T00:14:25.443755+0000","last_clean":"2024-09-11T00:14:25.443755+0000","last_became_active":"2024-09-11T00:14:18.640456+0000","last_became_peered":"2024-09-11T00:14:18.640456+0000","last_unstale":"2024-09-11T00:14:25.443755+0000","last_undegraded":"2024-09-11T00:14:25.443755+0000","last_fullsized":"2024-09-11T00:14:25.443755+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_clean_scrub_stamp":"2024-09-11T00:14:17.606538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:12:52.415152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:23.648235+0000","last_change":"2024-09-11T00:14:18.626919+0000","last_active":"2024-09-11T00:14:23.648235+0000","last_peered":"2024-09-11T00:14:23.648235+0000","last_clean":"2024-09-11T00:14:23.648235+0000","last_became_active":"2024-09-11T00:14:18.626280+0000","last_became_peered":"2024-09-11T00:14:18.626280+0000","last_unstale":"2024-09-11T00:14:23.648235+0000","last_undegraded":"2024-09-11T00:14:23.648235+0000","last_fullsized":"2024-09-11T00:14:23.648235+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_clean_scrub_stamp":"2024-09-11T00:14:17.606538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:29:21.396079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:25.443235+0000","last_change":"2024-09-11T00:14:18.640550+0000","last_active":"2024-09-11T00:14:25.443235+0000","last_peered":"2024-09-11T00:14:25.443235+0000","last_clean":"2024-09-11T00:14:25.443235+0000","last_became_active":"2024-09-11T00:14:18.640248+0000","last_became_peered":"2024-09-11T00:14:18.640248+0000","last_unstale":"2024-09-11T00:14:25.443235+0000","last_undegraded":"2024-09-11T00:14:25.443235+0000","last_fullsized":"2024-09-11T00:14:25.443235+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_clean_scrub_stamp":"2024-09-11T00:14:17.606538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:51:39.692232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:23.651967+0000","last_change":"2024-09-11T00:14:18.631295+0000","last_active":"2024-09-11T00:14:23.651967+0000","last_peered":"2024-09-11T00:14:23.651967+0000","last_clean":"2024-09-11T00:14:23.651967+0000","last_became_active":"2024-09-11T00:14:18.630629+0000","last_became_peered":"2024-09-11T00:14:18.630629+0000","last_unstale":"2024-09-11T00:14:23.651967+0000","last_undegraded":"2024-09-11T00:14:23.651967+0000","last_fullsized":"2024-09-11T00:14:23.651967+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_clean_scrub_stamp":"2024-09-11T00:14:17.606538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:11:01.606959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:25.443198+0000","last_change":"2024-09-11T00:14:18.632354+0000","last_active":"2024-09-11T00:14:25.443198+0000","last_peered":"2024-09-11T00:14:25.443198+0000","last_clean":"2024-09-11T00:14:25.443198+0000","last_became_active":"2024-09-11T00:14:18.632105+0000","last_became_peered":"2024-09-11T00:14:18.632105+0000","last_unstale":"2024-09-11T00:14:25.443198+0000","last_undegraded":"2024-09-11T00:14:25.443198+0000","last_fullsized":"2024-09-11T00:14:25.443198+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_clean_scrub_stamp":"2024-09-11T00:14:17.606538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:28:22.300564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:23.650364+0000","last_change":"2024-09-11T00:14:18.630513+0000","last_active":"2024-09-11T00:14:23.650364+0000","last_peered":"2024-09-11T00:14:23.650364+0000","last_clean":"2024-09-11T00:14:23.650364+0000","last_became_active":"2024-09-11T00:14:18.629735+0000","last_became_peered":"2024-09-11T00:14:18.629735+0000","last_unstale":"2024-09-11T00:14:23.650364+0000","last_undegraded":"2024-09-11T00:14:23.650364+0000","last_fullsized":"2024-09-11T00:14:23.650364+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_clean_scrub_stamp":"2024-09-11T00:14:17.606538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:28:22.300564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:24.883388+0000","last_change":"2024-09-11T00:14:18.630607+0000","last_active":"2024-09-11T00:14:24.883388+0000","last_peered":"2024-09-11T00:14:24.883388+0000","last_clean":"2024-09-11T00:14:24.883388+0000","last_became_active":"2024-09-11T00:14:18.629273+0000","last_became_peered":"2024-09-11T00:14:18.629273+0000","last_unstale":"2024-09-11T00:14:24.883388+0000","last_undegraded":"2024-09-11T00:14:24.883388+0000","last_fullsized":"2024-09-11T00:14:24.883388+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_clean_scrub_stamp":"2024-09-11T00:14:17.606538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:41:33.040042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:25.448538+0000","last_change":"2024-09-11T00:14:18.628576+0000","last_active":"2024-09-11T00:14:25.448538+0000","last_peered":"2024-09-11T00:14:25.448538+0000","last_clean":"2024-09-11T00:14:25.448538+0000","last_became_active":"2024-09-11T00:14:18.628238+0000","last_became_peered":"2024-09-11T00:14:18.628238+0000","last_unstale":"2024-09-11T00:14:25.448538+0000","last_undegraded":"2024-09-11T00:14:25.448538+0000","last_fullsized":"2024-09-11T00:14:25.448538+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_clean_scrub_stamp":"2024-09-11T00:14:17.606538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:49:06.208715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T00:14:25.443654+0000","last_change":"2024-09-11T00:14:18.644648+0000","last_active":"2024-09-11T00:14:25.443654+0000","last_peered":"2024-09-11T00:14:25.443654+0000","last_clean":"2024-09-11T00:14:25.443654+0000","last_became_active":"2024-09-11T00:14:18.644076+0000","last_became_peered":"2024-09-11T00:14:18.644076+0000","last_unstale":"2024-09-11T00:14:25.443654+0000","last_undegraded":"2024-09-11T00:14:25.443654+0000","last_fullsized":"2024-09-11T00:14:25.443654+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:17.606538+0000","last_clean_scrub_stamp":"2024-09-11T00:14:17.606538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:07:37.621540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509450,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27864,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343976,"statfs":{"total":96636764160,"available":96608231424,"internally_reserved":0,"allocated":856064,"data_stored":693611,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509450,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":262144,"data_stored":102751,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509449,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":270336,"data_stored":102787,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509449,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":270336,"data_stored":106503,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509451,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":266240,"data_stored":102821,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509450,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27872,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343968,"statfs":{"total":96636764160,"available":96608223232,"internally_reserved":0,"allocated":864256,"data_stored":693667,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542155,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":258048,"data_stored":102661,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574859,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":270336,"data_stored":106503,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T00:14:43.608 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-11T00:14:43.609 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-11T00:14:43.609 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-09-11T00:14:43.609 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-11T00:14:43.746 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:43.740+0000 7f8c022e6640 1 -- 172.21.15.92:0/1324298828 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8be4004800 msgr2=0x7f8be4004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:43.746 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:43.740+0000 7f8c022e6640 1 --2- 172.21.15.92:0/1324298828 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8be4004800 0x7f8be4004c80 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f8bf0009b50 tx=0x7f8be4005830 comp rx=0 tx=0).stop 2024-09-11T00:14:43.746 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:43.741+0000 7f8c022e6640 1 -- 172.21.15.92:0/1324298828 shutdown_connections 2024-09-11T00:14:43.746 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:43.741+0000 7f8c022e6640 1 --2- 172.21.15.92:0/1324298828 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8be4004800 0x7f8be4004c80 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:43.746 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:43.741+0000 7f8c022e6640 1 -- 172.21.15.92:0/1324298828 >> 172.21.15.92:0/1324298828 conn(0x7f8bfc074150 msgr2=0x7f8bfc074560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:14:43.746 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:43.741+0000 7f8c022e6640 1 -- 172.21.15.92:0/1324298828 shutdown_connections 2024-09-11T00:14:43.746 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:43.741+0000 7f8c022e6640 1 -- 172.21.15.92:0/1324298828 wait complete. 2024-09-11T00:14:43.747 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:43.742+0000 7f8c022e6640 1 Processor -- start 2024-09-11T00:14:43.747 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:43.742+0000 7f8c022e6640 1 -- start start 2024-09-11T00:14:43.747 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:43.743+0000 7f8c022e6640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8be4004800 0x7f8bfc1564e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:43.747 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:43.743+0000 7f8c022e6640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8bfc159900 0x7f8bfc155d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:43.747 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:43.743+0000 7f8c022e6640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8bfc1e6010 0x7f8bfc1e64a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:43.747 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:43.743+0000 7f8c022e6640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f8bfc0b1cd0 con 0x7f8bfc159900 2024-09-11T00:14:43.747 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:43.743+0000 7f8c022e6640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f8bfc0b1b50 con 0x7f8bfc1e6010 2024-09-11T00:14:43.747 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:43.743+0000 7f8c022e6640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f8bfc06cec0 con 0x7f8be4004800 2024-09-11T00:14:43.747 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:43.743+0000 7f8bfb7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8bfc159900 0x7f8bfc155d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:43.747 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:43.743+0000 7f8bfb7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8bfc159900 0x7f8bfc155d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:50728/0 (socket says 172.21.15.92:50728) 2024-09-11T00:14:43.747 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:43.743+0000 7f8bfb7fe640 1 -- 172.21.15.92:0/3893381393 learned_addr learned my addr 172.21.15.92:0/3893381393 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-11T00:14:43.747 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:43.743+0000 7f8bfb7fe640 1 -- 172.21.15.92:0/3893381393 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8be4004800 msgr2=0x7f8bfc1564e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:43.747 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:43.743+0000 7f8bfb7fe640 1 --2- 172.21.15.92:0/3893381393 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8be4004800 0x7f8bfc1564e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:43.748 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:43.743+0000 7f8bfb7fe640 1 -- 172.21.15.92:0/3893381393 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8bfc1e6010 msgr2=0x7f8bfc1e64a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:43.748 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:43.743+0000 7f8bfb7fe640 1 --2- 172.21.15.92:0/3893381393 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8bfc1e6010 0x7f8bfc1e64a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:43.748 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:43.743+0000 7f8bfb7fe640 1 -- 172.21.15.92:0/3893381393 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8bfc159d80 con 0x7f8bfc159900 2024-09-11T00:14:43.748 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:43.743+0000 7f8bfb7fe640 1 --2- 172.21.15.92:0/3893381393 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8bfc159900 0x7f8bfc155d50 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f8bf0009a70 tx=0x7f8bf00336f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:14:43.748 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:43.743+0000 7f8bf8ff9640 1 -- 172.21.15.92:0/3893381393 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bf0038040 con 0x7f8bfc159900 2024-09-11T00:14:43.748 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:43.743+0000 7f8bf8ff9640 1 -- 172.21.15.92:0/3893381393 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8bf00339d0 con 0x7f8bfc159900 2024-09-11T00:14:43.748 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:43.743+0000 7f8c022e6640 1 -- 172.21.15.92:0/3893381393 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8bfc156290 con 0x7f8bfc159900 2024-09-11T00:14:43.748 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:43.743+0000 7f8bf8ff9640 1 -- 172.21.15.92:0/3893381393 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bf0033e20 con 0x7f8bfc159900 2024-09-11T00:14:43.748 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:43.743+0000 7f8c022e6640 1 -- 172.21.15.92:0/3893381393 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8bfc0c48c0 con 0x7f8bfc159900 2024-09-11T00:14:43.748 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:43.745+0000 7f8c022e6640 1 -- 172.21.15.92:0/3893381393 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8bfc069a50 con 0x7f8bfc159900 2024-09-11T00:14:43.749 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:43.745+0000 7f8bf8ff9640 1 -- 172.21.15.92:0/3893381393 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f8bf003b070 con 0x7f8bfc159900 2024-09-11T00:14:43.749 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:43.745+0000 7f8bf8ff9640 1 --2- 172.21.15.92:0/3893381393 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f8be8077f70 0x7f8be807a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:43.749 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:43.745+0000 7f8bf8ff9640 1 -- 172.21.15.92:0/3893381393 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f8bf00ba130 con 0x7f8bfc159900 2024-09-11T00:14:43.749 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:43.746+0000 7f8bfbfff640 1 --2- 172.21.15.92:0/3893381393 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f8be8077f70 0x7f8be807a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:43.749 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:43.746+0000 7f8bfbfff640 1 --2- 172.21.15.92:0/3893381393 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f8be8077f70 0x7f8be807a430 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f8bfc0cc850 tx=0x7f8bec006ac0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:14:43.751 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:43.749+0000 7f8bf8ff9640 1 -- 172.21.15.92:0/3893381393 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f8bfc069a50 con 0x7f8bfc159900 2024-09-11T00:14:43.963 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:43.961+0000 7f8c022e6640 1 -- 172.21.15.92:0/3893381393 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f8bfc0b1620 con 0x7f8bfc159900 2024-09-11T00:14:43.963 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:43.961+0000 7f8bf8ff9640 1 -- 172.21.15.92:0/3893381393 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f8bfc0b1620 con 0x7f8bfc159900 2024-09-11T00:14:43.963 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:14:43.963 INFO:teuthology.orchestra.run.smithi092.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-11T00:14:43.965 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:43.964+0000 7f8c022e6640 1 -- 172.21.15.92:0/3893381393 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f8be8077f70 msgr2=0x7f8be807a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:43.965 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:43.964+0000 7f8c022e6640 1 --2- 172.21.15.92:0/3893381393 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f8be8077f70 0x7f8be807a430 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f8bfc0cc850 tx=0x7f8bec006ac0 comp rx=0 tx=0).stop 2024-09-11T00:14:43.966 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:43.964+0000 7f8c022e6640 1 -- 172.21.15.92:0/3893381393 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8bfc159900 msgr2=0x7f8bfc155d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:43.966 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:43.964+0000 7f8c022e6640 1 --2- 172.21.15.92:0/3893381393 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8bfc159900 0x7f8bfc155d50 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f8bf0009a70 tx=0x7f8bf00336f0 comp rx=0 tx=0).stop 2024-09-11T00:14:43.966 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:43.964+0000 7f8c022e6640 1 -- 172.21.15.92:0/3893381393 shutdown_connections 2024-09-11T00:14:43.966 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:43.964+0000 7f8c022e6640 1 --2- 172.21.15.92:0/3893381393 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f8be8077f70 0x7f8be807a430 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:43.966 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:43.964+0000 7f8c022e6640 1 --2- 172.21.15.92:0/3893381393 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8bfc1e6010 0x7f8bfc1e64a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:43.966 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:43.964+0000 7f8c022e6640 1 --2- 172.21.15.92:0/3893381393 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8bfc159900 0x7f8bfc155d50 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:43.966 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:43.964+0000 7f8c022e6640 1 --2- 172.21.15.92:0/3893381393 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8be4004800 0x7f8bfc1564e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:43.966 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:43.964+0000 7f8c022e6640 1 -- 172.21.15.92:0/3893381393 >> 172.21.15.92:0/3893381393 conn(0x7f8bfc074150 msgr2=0x7f8bfc0706b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:14:43.966 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:43.964+0000 7f8c022e6640 1 -- 172.21.15.92:0/3893381393 shutdown_connections 2024-09-11T00:14:43.966 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:43.964+0000 7f8c022e6640 1 -- 172.21.15.92:0/3893381393 wait complete. 2024-09-11T00:14:43.976 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-09-11T00:14:43.976 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T00:14:44.077 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:44.075+0000 7f5e13953640 1 -- 172.21.15.92:0/670276832 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5e0c06e0a0 msgr2=0x7f5e0c0ca970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:44.077 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:44.075+0000 7f5e13953640 1 --2- 172.21.15.92:0/670276832 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5e0c06e0a0 0x7f5e0c0ca970 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f5e0c073230 tx=0x7f5e0002a4d0 comp rx=0 tx=0).stop 2024-09-11T00:14:44.077 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:44.075+0000 7f5e13953640 1 -- 172.21.15.92:0/670276832 shutdown_connections 2024-09-11T00:14:44.077 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:44.075+0000 7f5e13953640 1 --2- 172.21.15.92:0/670276832 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5e0c06e0a0 0x7f5e0c0ca970 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:44.077 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:44.075+0000 7f5e13953640 1 --2- 172.21.15.92:0/670276832 >> v2:172.21.15.145:3300/0 conn(0x7f5e0c06dcc0 0x7f5e0c0b1740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:44.077 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:44.075+0000 7f5e13953640 1 -- 172.21.15.92:0/670276832 >> 172.21.15.92:0/670276832 conn(0x7f5e0c074150 msgr2=0x7f5e0c074560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:14:44.077 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:44.075+0000 7f5e13953640 1 -- 172.21.15.92:0/670276832 shutdown_connections 2024-09-11T00:14:44.078 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:44.075+0000 7f5e13953640 1 -- 172.21.15.92:0/670276832 wait complete. 2024-09-11T00:14:44.080 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:44.076+0000 7f5e13953640 1 Processor -- start 2024-09-11T00:14:44.080 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:44.076+0000 7f5e13953640 1 -- start start 2024-09-11T00:14:44.080 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:44.077+0000 7f5e13953640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f5e0c06cb70 0x7f5e0c15af60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:44.080 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:44.077+0000 7f5e13953640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5e0c06dcc0 0x7f5e0c099520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:44.080 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:44.077+0000 7f5e13953640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5e0c06e0a0 0x7f5e0c156220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:44.081 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:44.077+0000 7f5e13953640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f5e0c0d0320 con 0x7f5e0c06e0a0 2024-09-11T00:14:44.081 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:44.077+0000 7f5e13953640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f5e0c0cb5c0 con 0x7f5e0c06dcc0 2024-09-11T00:14:44.081 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:44.077+0000 7f5e13953640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f5e0c0d04a0 con 0x7f5e0c06cb70 2024-09-11T00:14:44.081 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:44.077+0000 7f5e11ef0640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5e0c06e0a0 0x7f5e0c156220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:44.081 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:44.077+0000 7f5e11ef0640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5e0c06e0a0 0x7f5e0c156220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:50738/0 (socket says 172.21.15.92:50738) 2024-09-11T00:14:44.081 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:44.077+0000 7f5e11ef0640 1 -- 172.21.15.92:0/4057492627 learned_addr learned my addr 172.21.15.92:0/4057492627 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-11T00:14:44.081 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:44.077+0000 7f5e10eee640 1 --2- 172.21.15.92:0/4057492627 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5e0c06dcc0 0x7f5e0c099520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:44.081 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:44.077+0000 7f5e116ef640 1 --2- 172.21.15.92:0/4057492627 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f5e0c06cb70 0x7f5e0c15af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:44.082 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:44.077+0000 7f5e11ef0640 1 -- 172.21.15.92:0/4057492627 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f5e0c06cb70 msgr2=0x7f5e0c15af60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:44.082 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:44.077+0000 7f5e11ef0640 1 --2- 172.21.15.92:0/4057492627 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f5e0c06cb70 0x7f5e0c15af60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:44.082 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:44.077+0000 7f5e11ef0640 1 -- 172.21.15.92:0/4057492627 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5e0c06dcc0 msgr2=0x7f5e0c099520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:44.082 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:44.077+0000 7f5e11ef0640 1 --2- 172.21.15.92:0/4057492627 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5e0c06dcc0 0x7f5e0c099520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:44.082 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:44.077+0000 7f5e11ef0640 1 -- 172.21.15.92:0/4057492627 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e0c154fc0 con 0x7f5e0c06e0a0 2024-09-11T00:14:44.082 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:44.077+0000 7f5e10eee640 1 --2- 172.21.15.92:0/4057492627 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5e0c06dcc0 0x7f5e0c099520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:14:44.082 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:44.077+0000 7f5e116ef640 1 --2- 172.21.15.92:0/4057492627 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f5e0c06cb70 0x7f5e0c15af60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:14:44.082 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:44.077+0000 7f5e11ef0640 1 --2- 172.21.15.92:0/4057492627 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5e0c06e0a0 0x7f5e0c156220 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f5dfc00c770 tx=0x7f5dfc00cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:14:44.082 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:44.078+0000 7f5e09ffb640 1 -- 172.21.15.92:0/4057492627 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dfc017070 con 0x7f5e0c06e0a0 2024-09-11T00:14:44.082 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:44.078+0000 7f5e09ffb640 1 -- 172.21.15.92:0/4057492627 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5dfc005070 con 0x7f5e0c06e0a0 2024-09-11T00:14:44.082 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:44.078+0000 7f5e13953640 1 -- 172.21.15.92:0/4057492627 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e0c154a00 con 0x7f5e0c06e0a0 2024-09-11T00:14:44.083 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:44.078+0000 7f5e09ffb640 1 -- 172.21.15.92:0/4057492627 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dfc0054c0 con 0x7f5e0c06e0a0 2024-09-11T00:14:44.083 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:44.078+0000 7f5e13953640 1 -- 172.21.15.92:0/4057492627 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e0c152770 con 0x7f5e0c06e0a0 2024-09-11T00:14:44.083 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:44.079+0000 7f5e13953640 1 -- 172.21.15.92:0/4057492627 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5e0c0b1740 con 0x7f5e0c06e0a0 2024-09-11T00:14:44.083 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:44.079+0000 7f5e09ffb640 1 -- 172.21.15.92:0/4057492627 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f5dfc005660 con 0x7f5e0c06e0a0 2024-09-11T00:14:44.083 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:44.080+0000 7f5e09ffb640 1 --2- 172.21.15.92:0/4057492627 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f5df8077f70 0x7f5df807a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:44.084 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:44.080+0000 7f5e09ffb640 1 -- 172.21.15.92:0/4057492627 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f5dfc099a30 con 0x7f5e0c06e0a0 2024-09-11T00:14:44.084 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:44.080+0000 7f5e116ef640 1 --2- 172.21.15.92:0/4057492627 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f5df8077f70 0x7f5df807a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:44.084 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:44.080+0000 7f5e116ef640 1 --2- 172.21.15.92:0/4057492627 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f5df8077f70 0x7f5df807a430 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f5e0c0ce380 tx=0x7f5e04005db0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:14:44.085 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:44.084+0000 7f5e09ffb640 1 -- 172.21.15.92:0/4057492627 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f5dfc062200 con 0x7f5e0c06e0a0 2024-09-11T00:14:44.297 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:44.296+0000 7f5e13953640 1 -- 172.21.15.92:0/4057492627 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5e0c0d1140 con 0x7f5e0c06e0a0 2024-09-11T00:14:44.298 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:44.296+0000 7f5e09ffb640 1 -- 172.21.15.92:0/4057492627 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5225 (secure 0 0 0) 0x7f5dfc061b00 con 0x7f5e0c06e0a0 2024-09-11T00:14:44.298 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:14:44.298 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":8,"btime":"2024-09-11T00:14:37:675941+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4286,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/2051794804","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":2051794804},{"type":"v1","addr":"172.21.15.92:6835","nonce":2051794804}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4295,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6835/1341143168","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6834","nonce":1341143168},{"type":"v1","addr":"172.21.15.145:6835","nonce":1341143168}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4356,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6833/3149311196","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":3149311196},{"type":"v1","addr":"172.21.15.92:6833","nonce":3149311196}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T00:14:17.969166+0000","modified":"2024-09-11T00:14:37.019981+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4374},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4374":{"gid":4374,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.145:6837/3236563974","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6836","nonce":3236563974},{"type":"v1","addr":"172.21.15.145:6837","nonce":3236563974}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4374,"qdb_cluster":[4374]},"id":1}]} 2024-09-11T00:14:44.298 INFO:teuthology.orchestra.run.smithi092.stderr:dumped fsmap epoch 8 2024-09-11T00:14:44.300 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:44.298+0000 7f5e13953640 1 -- 172.21.15.92:0/4057492627 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f5df8077f70 msgr2=0x7f5df807a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:44.300 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:44.298+0000 7f5e13953640 1 --2- 172.21.15.92:0/4057492627 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f5df8077f70 0x7f5df807a430 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f5e0c0ce380 tx=0x7f5e04005db0 comp rx=0 tx=0).stop 2024-09-11T00:14:44.300 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:44.298+0000 7f5e13953640 1 -- 172.21.15.92:0/4057492627 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5e0c06e0a0 msgr2=0x7f5e0c156220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:44.300 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:44.298+0000 7f5e13953640 1 --2- 172.21.15.92:0/4057492627 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5e0c06e0a0 0x7f5e0c156220 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f5dfc00c770 tx=0x7f5dfc00cc30 comp rx=0 tx=0).stop 2024-09-11T00:14:44.301 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:44.298+0000 7f5e13953640 1 -- 172.21.15.92:0/4057492627 shutdown_connections 2024-09-11T00:14:44.301 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:44.298+0000 7f5e13953640 1 --2- 172.21.15.92:0/4057492627 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f5df8077f70 0x7f5df807a430 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:44.301 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:44.298+0000 7f5e13953640 1 --2- 172.21.15.92:0/4057492627 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5e0c06e0a0 0x7f5e0c156220 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:44.301 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:44.298+0000 7f5e13953640 1 --2- 172.21.15.92:0/4057492627 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5e0c06dcc0 0x7f5e0c099520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:44.301 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:44.298+0000 7f5e13953640 1 --2- 172.21.15.92:0/4057492627 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f5e0c06cb70 0x7f5e0c15af60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:44.301 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:44.298+0000 7f5e13953640 1 -- 172.21.15.92:0/4057492627 >> 172.21.15.92:0/4057492627 conn(0x7f5e0c074150 msgr2=0x7f5e0c0cb740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:14:44.301 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:44.298+0000 7f5e13953640 1 -- 172.21.15.92:0/4057492627 shutdown_connections 2024-09-11T00:14:44.301 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:44.298+0000 7f5e13953640 1 -- 172.21.15.92:0/4057492627 wait complete. 2024-09-11T00:14:44.311 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T00:14:44.411 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:44.409+0000 7f472d917640 1 -- 172.21.15.92:0/2378859264 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4710004d40 msgr2=0x7f47100051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:44.411 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:44.409+0000 7f472d917640 1 --2- 172.21.15.92:0/2378859264 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4710004d40 0x7f47100051c0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f4718006f90 tx=0x7f4710005830 comp rx=0 tx=0).stop 2024-09-11T00:14:44.411 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:44.409+0000 7f47277fe640 1 -- 172.21.15.92:0/2378859264 reap_dead start 2024-09-11T00:14:44.411 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:44.409+0000 7f472d917640 1 -- 172.21.15.92:0/2378859264 shutdown_connections 2024-09-11T00:14:44.411 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:44.409+0000 7f472d917640 1 -- 172.21.15.92:0/2378859264 >> 172.21.15.92:0/2378859264 conn(0x7f47280d3f70 msgr2=0x7f47280d4350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:14:44.411 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:44.409+0000 7f472d917640 1 -- 172.21.15.92:0/2378859264 shutdown_connections 2024-09-11T00:14:44.411 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:44.409+0000 7f472d917640 1 -- 172.21.15.92:0/2378859264 wait complete. 2024-09-11T00:14:44.412 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:44.410+0000 7f472d917640 1 Processor -- start 2024-09-11T00:14:44.412 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:44.410+0000 7f472d917640 1 -- start start 2024-09-11T00:14:44.414 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:44.411+0000 7f472d917640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4710004d40 0x7f472815f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:44.414 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:44.411+0000 7f472d917640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f47281f5610 0x7f47281f8260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:44.414 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:44.411+0000 7f472d917640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f47281f87a0 0x7f4728160c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:44.414 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:44.411+0000 7f472d917640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f47280b6dc0 con 0x7f47281f87a0 2024-09-11T00:14:44.414 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:44.411+0000 7f472d917640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f47280d2f70 con 0x7f47281f5610 2024-09-11T00:14:44.414 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:44.411+0000 7f472d917640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f47280b6f40 con 0x7f4710004d40 2024-09-11T00:14:44.414 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:44.411+0000 7f47277fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f47281f87a0 0x7f4728160c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:44.414 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:44.411+0000 7f47277fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f47281f87a0 0x7f4728160c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:39426/0 (socket says 172.21.15.92:39426) 2024-09-11T00:14:44.414 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:44.411+0000 7f47277fe640 1 -- 172.21.15.92:0/446873443 learned_addr learned my addr 172.21.15.92:0/446873443 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-11T00:14:44.415 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:44.411+0000 7f4726ffd640 1 --2- 172.21.15.92:0/446873443 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4710004d40 0x7f472815f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:44.415 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:44.411+0000 7f47267fc640 1 --2- 172.21.15.92:0/446873443 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f47281f5610 0x7f47281f8260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:44.415 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:44.411+0000 7f47277fe640 1 -- 172.21.15.92:0/446873443 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4710004d40 msgr2=0x7f472815f310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:44.415 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:44.411+0000 7f47277fe640 1 --2- 172.21.15.92:0/446873443 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4710004d40 0x7f472815f310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:44.415 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:44.411+0000 7f47277fe640 1 -- 172.21.15.92:0/446873443 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f47281f5610 msgr2=0x7f47281f8260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:44.415 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:44.411+0000 7f47277fe640 1 --2- 172.21.15.92:0/446873443 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f47281f5610 0x7f47281f8260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:44.415 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:44.411+0000 7f47277fe640 1 -- 172.21.15.92:0/446873443 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47281f8c20 con 0x7f47281f87a0 2024-09-11T00:14:44.415 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:44.411+0000 7f47277fe640 1 --2- 172.21.15.92:0/446873443 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f47281f87a0 0x7f4728160c50 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f4718006f90 tx=0x7f4718006bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:14:44.415 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:44.412+0000 7f470ffff640 1 -- 172.21.15.92:0/446873443 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4718032030 con 0x7f47281f87a0 2024-09-11T00:14:44.415 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:44.412+0000 7f470ffff640 1 -- 172.21.15.92:0/446873443 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4718003900 con 0x7f47281f87a0 2024-09-11T00:14:44.415 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:44.412+0000 7f472d917640 1 -- 172.21.15.92:0/446873443 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47281f8f00 con 0x7f47281f87a0 2024-09-11T00:14:44.415 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:44.412+0000 7f470ffff640 1 -- 172.21.15.92:0/446873443 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4718003d50 con 0x7f47281f87a0 2024-09-11T00:14:44.415 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:44.412+0000 7f472d917640 1 -- 172.21.15.92:0/446873443 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47281f50f0 con 0x7f47281f87a0 2024-09-11T00:14:44.416 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:44.413+0000 7f472d917640 1 -- 172.21.15.92:0/446873443 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f47281f4c20 con 0x7f47281f87a0 2024-09-11T00:14:44.416 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:44.413+0000 7f470ffff640 1 -- 172.21.15.92:0/446873443 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f471802e460 con 0x7f47281f87a0 2024-09-11T00:14:44.416 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:44.414+0000 7f470ffff640 1 --2- 172.21.15.92:0/446873443 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f4714077f70 0x7f471407a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:44.417 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:44.414+0000 7f470ffff640 1 -- 172.21.15.92:0/446873443 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f47180ba2d0 con 0x7f47281f87a0 2024-09-11T00:14:44.417 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:44.414+0000 7f4726ffd640 1 --2- 172.21.15.92:0/446873443 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f4714077f70 0x7f471407a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:44.417 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:44.414+0000 7f4726ffd640 1 --2- 172.21.15.92:0/446873443 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f4714077f70 0x7f471407a430 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f4720005fd0 tx=0x7f4720009500 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:14:44.420 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:44.418+0000 7f470ffff640 1 -- 172.21.15.92:0/446873443 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f4718082440 con 0x7f47281f87a0 2024-09-11T00:14:44.627 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:44.625+0000 7f472d917640 1 -- 172.21.15.92:0/446873443 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f47280d24e0 con 0x7f47281f87a0 2024-09-11T00:14:44.627 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:44.626+0000 7f470ffff640 1 -- 172.21.15.92:0/446873443 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5225 (secure 0 0 0) 0x7f471808b1b0 con 0x7f47281f87a0 2024-09-11T00:14:44.628 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:14:44.628 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":8,"btime":"2024-09-11T00:14:37:675941+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4286,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/2051794804","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":2051794804},{"type":"v1","addr":"172.21.15.92:6835","nonce":2051794804}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4295,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6835/1341143168","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6834","nonce":1341143168},{"type":"v1","addr":"172.21.15.145:6835","nonce":1341143168}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4356,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6833/3149311196","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":3149311196},{"type":"v1","addr":"172.21.15.92:6833","nonce":3149311196}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T00:14:17.969166+0000","modified":"2024-09-11T00:14:37.019981+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4374},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4374":{"gid":4374,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.145:6837/3236563974","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6836","nonce":3236563974},{"type":"v1","addr":"172.21.15.145:6837","nonce":3236563974}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4374,"qdb_cluster":[4374]},"id":1}]} 2024-09-11T00:14:44.628 INFO:teuthology.orchestra.run.smithi092.stderr:dumped fsmap epoch 8 2024-09-11T00:14:44.630 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:44.628+0000 7f472d917640 1 -- 172.21.15.92:0/446873443 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f4714077f70 msgr2=0x7f471407a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:44.630 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:44.628+0000 7f472d917640 1 --2- 172.21.15.92:0/446873443 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f4714077f70 0x7f471407a430 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f4720005fd0 tx=0x7f4720009500 comp rx=0 tx=0).stop 2024-09-11T00:14:44.630 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:44.628+0000 7f472d917640 1 -- 172.21.15.92:0/446873443 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f47281f87a0 msgr2=0x7f4728160c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:44.630 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:44.628+0000 7f472d917640 1 --2- 172.21.15.92:0/446873443 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f47281f87a0 0x7f4728160c50 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f4718006f90 tx=0x7f4718006bb0 comp rx=0 tx=0).stop 2024-09-11T00:14:44.630 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:44.628+0000 7f472d917640 1 -- 172.21.15.92:0/446873443 shutdown_connections 2024-09-11T00:14:44.630 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:44.628+0000 7f472d917640 1 --2- 172.21.15.92:0/446873443 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f4714077f70 0x7f471407a430 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:44.630 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:44.628+0000 7f472d917640 1 --2- 172.21.15.92:0/446873443 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f47281f87a0 0x7f4728160c50 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:44.630 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:44.628+0000 7f472d917640 1 --2- 172.21.15.92:0/446873443 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f47281f5610 0x7f47281f8260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:44.630 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:44.628+0000 7f472d917640 1 --2- 172.21.15.92:0/446873443 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4710004d40 0x7f472815f310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:44.631 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:44.628+0000 7f472d917640 1 -- 172.21.15.92:0/446873443 >> 172.21.15.92:0/446873443 conn(0x7f47280d3f70 msgr2=0x7f47280cea40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:14:44.631 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:44.628+0000 7f472d917640 1 -- 172.21.15.92:0/446873443 shutdown_connections 2024-09-11T00:14:44.631 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:44.628+0000 7f472d917640 1 -- 172.21.15.92:0/446873443 wait complete. 2024-09-11T00:14:44.640 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T00:14:44.743 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:44.741+0000 7fc70e7f3640 1 -- 172.21.15.92:0/2912036303 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc70815e150 msgr2=0x7fc70815e530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:44.743 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:44.741+0000 7fc70e7f3640 1 --2- 172.21.15.92:0/2912036303 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc70815e150 0x7fc70815e530 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fc6f800a940 tx=0x7fc6f802b850 comp rx=0 tx=0).stop 2024-09-11T00:14:44.743 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:44.741+0000 7fc70e7f3640 1 -- 172.21.15.92:0/2912036303 shutdown_connections 2024-09-11T00:14:44.743 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:44.741+0000 7fc70e7f3640 1 --2- 172.21.15.92:0/2912036303 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc70815e150 0x7fc70815e530 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:44.743 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:44.741+0000 7fc70e7f3640 1 -- 172.21.15.92:0/2912036303 >> 172.21.15.92:0/2912036303 conn(0x7fc7080b1760 msgr2=0x7fc7080b1b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:14:44.743 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:44.741+0000 7fc70e7f3640 1 -- 172.21.15.92:0/2912036303 shutdown_connections 2024-09-11T00:14:44.743 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:44.741+0000 7fc70e7f3640 1 -- 172.21.15.92:0/2912036303 wait complete. 2024-09-11T00:14:44.744 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:44.742+0000 7fc70e7f3640 1 Processor -- start 2024-09-11T00:14:44.744 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:44.742+0000 7fc70e7f3640 1 -- start start 2024-09-11T00:14:44.746 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:44.743+0000 7fc70e7f3640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc70806e2e0 0x7fc70815c810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:44.747 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:44.743+0000 7fc70e7f3640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc7080cf110 0x7fc708139ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:44.748 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:44.743+0000 7fc70e7f3640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc70815e150 0x7fc708137e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:44.748 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:44.743+0000 7fc70e7f3640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fc7080b4930 con 0x7fc7080cf110 2024-09-11T00:14:44.748 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:44.743+0000 7fc70e7f3640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fc7080b47b0 con 0x7fc70815e150 2024-09-11T00:14:44.748 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:44.743+0000 7fc70e7f3640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7fc7080b4ab0 con 0x7fc70806e2e0 2024-09-11T00:14:44.748 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:44.743+0000 7fc7077fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc7080cf110 0x7fc708139ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:44.748 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:44.743+0000 7fc7077fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc7080cf110 0x7fc708139ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:39454/0 (socket says 172.21.15.92:39454) 2024-09-11T00:14:44.748 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:44.743+0000 7fc7077fe640 1 -- 172.21.15.92:0/989426818 learned_addr learned my addr 172.21.15.92:0/989426818 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-11T00:14:44.748 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:44.743+0000 7fc7077fe640 1 -- 172.21.15.92:0/989426818 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc70806e2e0 msgr2=0x7fc70815c810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:44.748 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:44.743+0000 7fc7077fe640 1 --2- 172.21.15.92:0/989426818 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc70806e2e0 0x7fc70815c810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:44.748 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:44.743+0000 7fc7077fe640 1 -- 172.21.15.92:0/989426818 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc70815e150 msgr2=0x7fc708137e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:44.748 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:44.743+0000 7fc7077fe640 1 --2- 172.21.15.92:0/989426818 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc70815e150 0x7fc708137e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:44.749 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:44.743+0000 7fc7077fe640 1 -- 172.21.15.92:0/989426818 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc708138e30 con 0x7fc7080cf110 2024-09-11T00:14:44.749 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:44.743+0000 7fc7077fe640 1 --2- 172.21.15.92:0/989426818 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc7080cf110 0x7fc708139ed0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fc6fc00c430 tx=0x7fc6fc00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:14:44.749 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:44.744+0000 7fc704ff9640 1 -- 172.21.15.92:0/989426818 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6fc011790 con 0x7fc7080cf110 2024-09-11T00:14:44.749 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:44.744+0000 7fc704ff9640 1 -- 172.21.15.92:0/989426818 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc6fc017070 con 0x7fc7080cf110 2024-09-11T00:14:44.749 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:44.744+0000 7fc70e7f3640 1 -- 172.21.15.92:0/989426818 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc708139110 con 0x7fc7080cf110 2024-09-11T00:14:44.749 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:44.744+0000 7fc704ff9640 1 -- 172.21.15.92:0/989426818 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6fc011d00 con 0x7fc7080cf110 2024-09-11T00:14:44.749 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:44.744+0000 7fc70e7f3640 1 -- 172.21.15.92:0/989426818 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7081396d0 con 0x7fc7080cf110 2024-09-11T00:14:44.749 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:44.745+0000 7fc70e7f3640 1 -- 172.21.15.92:0/989426818 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc70815e530 con 0x7fc7080cf110 2024-09-11T00:14:44.750 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:44.745+0000 7fc704ff9640 1 -- 172.21.15.92:0/989426818 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fc6fc01c460 con 0x7fc7080cf110 2024-09-11T00:14:44.750 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:44.746+0000 7fc704ff9640 1 --2- 172.21.15.92:0/989426818 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7fc6f4077f70 0x7fc6f407a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:44.750 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:44.746+0000 7fc704ff9640 1 -- 172.21.15.92:0/989426818 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fc6fc099df0 con 0x7fc7080cf110 2024-09-11T00:14:44.750 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:44.746+0000 7fc707fff640 1 --2- 172.21.15.92:0/989426818 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7fc6f4077f70 0x7fc6f407a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:44.750 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:44.747+0000 7fc707fff640 1 --2- 172.21.15.92:0/989426818 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7fc6f4077f70 0x7fc6f407a430 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fc6f8036000 tx=0x7fc6f80046c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:14:44.752 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:44.750+0000 7fc704ff9640 1 -- 172.21.15.92:0/989426818 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fc6fc062640 con 0x7fc7080cf110 2024-09-11T00:14:44.927 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:44.926+0000 7fc70e7f3640 1 -- 172.21.15.92:0/989426818 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc708076070 con 0x7fc7080cf110 2024-09-11T00:14:44.928 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:44.927+0000 7fc704ff9640 1 -- 172.21.15.92:0/989426818 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18622 (secure 0 0 0) 0x7fc6fc061f40 con 0x7fc7080cf110 2024-09-11T00:14:44.929 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:14:44.929 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":25,"fsid":"47039cb3-5d2a-46bf-9066-8055b5dfc583","created":"2024-09-11T00:13:53.889939+0000","modified":"2024-09-11T00:14:23.001261+0000","last_up_change":"2024-09-11T00:14:06.563107+0000","last_in_change":"2024-09-11T00:13:56.982537+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T00:14:06.287223+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-11T00:14:15.739528+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-11T00:14:16.925480+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-11T00:14:20.639419+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"538af0ea-96c9-4999-9ccc-bee55f80ff76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":2860560077},{"type":"v1","addr":"172.21.15.92:6801","nonce":2860560077}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":2860560077},{"type":"v1","addr":"172.21.15.92:6803","nonce":2860560077}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":2860560077},{"type":"v1","addr":"172.21.15.92:6807","nonce":2860560077}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":2860560077},{"type":"v1","addr":"172.21.15.92:6805","nonce":2860560077}]},"public_addr":"172.21.15.92:6801/2860560077","cluster_addr":"172.21.15.92:6803/2860560077","heartbeat_back_addr":"172.21.15.92:6807/2860560077","heartbeat_front_addr":"172.21.15.92:6805/2860560077","state":["exists","up"]},{"osd":1,"uuid":"f9214f2c-ffe6-4447-9a13-9549a36e0537","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":2600417443},{"type":"v1","addr":"172.21.15.92:6817","nonce":2600417443}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6818","nonce":2600417443},{"type":"v1","addr":"172.21.15.92:6819","nonce":2600417443}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6822","nonce":2600417443},{"type":"v1","addr":"172.21.15.92:6823","nonce":2600417443}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":2600417443},{"type":"v1","addr":"172.21.15.92:6821","nonce":2600417443}]},"public_addr":"172.21.15.92:6817/2600417443","cluster_addr":"172.21.15.92:6819/2600417443","heartbeat_back_addr":"172.21.15.92:6823/2600417443","heartbeat_front_addr":"172.21.15.92:6821/2600417443","state":["exists","up"]},{"osd":2,"uuid":"b44dd849-fb85-42b1-8a1a-b6681bb1f467","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":3143892898},{"type":"v1","addr":"172.21.15.92:6809","nonce":3143892898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":3143892898},{"type":"v1","addr":"172.21.15.92:6811","nonce":3143892898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":3143892898},{"type":"v1","addr":"172.21.15.92:6815","nonce":3143892898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":3143892898},{"type":"v1","addr":"172.21.15.92:6813","nonce":3143892898}]},"public_addr":"172.21.15.92:6809/3143892898","cluster_addr":"172.21.15.92:6811/3143892898","heartbeat_back_addr":"172.21.15.92:6815/3143892898","heartbeat_front_addr":"172.21.15.92:6813/3143892898","state":["exists","up"]},{"osd":3,"uuid":"05a49d87-23b9-48dd-962c-d5c2686e7a32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":3913961488},{"type":"v1","addr":"172.21.15.92:6825","nonce":3913961488}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6826","nonce":3913961488},{"type":"v1","addr":"172.21.15.92:6827","nonce":3913961488}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":3913961488},{"type":"v1","addr":"172.21.15.92:6831","nonce":3913961488}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":3913961488},{"type":"v1","addr":"172.21.15.92:6829","nonce":3913961488}]},"public_addr":"172.21.15.92:6825/3913961488","cluster_addr":"172.21.15.92:6827/3913961488","heartbeat_back_addr":"172.21.15.92:6831/3913961488","heartbeat_front_addr":"172.21.15.92:6829/3913961488","state":["exists","up"]},{"osd":4,"uuid":"cf52b087-afe0-4f43-a4e7-db2ebc158815","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6826","nonce":2206798907},{"type":"v1","addr":"172.21.15.145:6827","nonce":2206798907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6828","nonce":2206798907},{"type":"v1","addr":"172.21.15.145:6829","nonce":2206798907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6832","nonce":2206798907},{"type":"v1","addr":"172.21.15.145:6833","nonce":2206798907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6830","nonce":2206798907},{"type":"v1","addr":"172.21.15.145:6831","nonce":2206798907}]},"public_addr":"172.21.15.145:6827/2206798907","cluster_addr":"172.21.15.145:6829/2206798907","heartbeat_back_addr":"172.21.15.145:6833/2206798907","heartbeat_front_addr":"172.21.15.145:6831/2206798907","state":["exists","up"]},{"osd":5,"uuid":"0e54adcd-2d1d-49fb-bf97-3dd7e9addd30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6810","nonce":2599548493},{"type":"v1","addr":"172.21.15.145:6811","nonce":2599548493}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6812","nonce":2599548493},{"type":"v1","addr":"172.21.15.145:6813","nonce":2599548493}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6816","nonce":2599548493},{"type":"v1","addr":"172.21.15.145:6817","nonce":2599548493}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6814","nonce":2599548493},{"type":"v1","addr":"172.21.15.145:6815","nonce":2599548493}]},"public_addr":"172.21.15.145:6811/2599548493","cluster_addr":"172.21.15.145:6813/2599548493","heartbeat_back_addr":"172.21.15.145:6817/2599548493","heartbeat_front_addr":"172.21.15.145:6815/2599548493","state":["exists","up"]},{"osd":6,"uuid":"4d5ae7a8-b3df-4c7a-9124-290f239f5b57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6802","nonce":4192380792},{"type":"v1","addr":"172.21.15.145:6803","nonce":4192380792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6804","nonce":4192380792},{"type":"v1","addr":"172.21.15.145:6805","nonce":4192380792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6808","nonce":4192380792},{"type":"v1","addr":"172.21.15.145:6809","nonce":4192380792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6806","nonce":4192380792},{"type":"v1","addr":"172.21.15.145:6807","nonce":4192380792}]},"public_addr":"172.21.15.145:6803/4192380792","cluster_addr":"172.21.15.145:6805/4192380792","heartbeat_back_addr":"172.21.15.145:6809/4192380792","heartbeat_front_addr":"172.21.15.145:6807/4192380792","state":["exists","up"]},{"osd":7,"uuid":"d7e36444-6e3f-4372-81d3-88e7b4e993f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6818","nonce":3010598400},{"type":"v1","addr":"172.21.15.145:6819","nonce":3010598400}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6820","nonce":3010598400},{"type":"v1","addr":"172.21.15.145:6821","nonce":3010598400}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6824","nonce":3010598400},{"type":"v1","addr":"172.21.15.145:6825","nonce":3010598400}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6822","nonce":3010598400},{"type":"v1","addr":"172.21.15.145:6823","nonce":3010598400}]},"public_addr":"172.21.15.145:6819/3010598400","cluster_addr":"172.21.15.145:6821/3010598400","heartbeat_back_addr":"172.21.15.145:6825/3010598400","heartbeat_front_addr":"172.21.15.145:6823/3010598400","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:14:03.281892+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:14:04.039021+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:14:03.045775+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:14:03.708856+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:14:04.425520+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:14:03.839369+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:14:03.029834+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:14:03.707529+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T00:14:44.931 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:44.929+0000 7fc70e7f3640 1 -- 172.21.15.92:0/989426818 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7fc6f4077f70 msgr2=0x7fc6f407a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:44.931 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:44.929+0000 7fc70e7f3640 1 --2- 172.21.15.92:0/989426818 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7fc6f4077f70 0x7fc6f407a430 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fc6f8036000 tx=0x7fc6f80046c0 comp rx=0 tx=0).stop 2024-09-11T00:14:44.931 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:44.929+0000 7fc70e7f3640 1 -- 172.21.15.92:0/989426818 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc7080cf110 msgr2=0x7fc708139ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:44.931 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:44.929+0000 7fc70e7f3640 1 --2- 172.21.15.92:0/989426818 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc7080cf110 0x7fc708139ed0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fc6fc00c430 tx=0x7fc6fc00c8f0 comp rx=0 tx=0).stop 2024-09-11T00:14:44.931 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:44.929+0000 7fc70e7f3640 1 -- 172.21.15.92:0/989426818 shutdown_connections 2024-09-11T00:14:44.931 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:44.929+0000 7fc70e7f3640 1 --2- 172.21.15.92:0/989426818 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7fc6f4077f70 0x7fc6f407a430 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:44.931 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:44.929+0000 7fc70e7f3640 1 --2- 172.21.15.92:0/989426818 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc70815e150 0x7fc708137e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:44.932 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:44.929+0000 7fc70e7f3640 1 --2- 172.21.15.92:0/989426818 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc7080cf110 0x7fc708139ed0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:44.932 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:44.929+0000 7fc70e7f3640 1 --2- 172.21.15.92:0/989426818 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc70806e2e0 0x7fc70815c810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:44.932 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:44.929+0000 7fc70e7f3640 1 -- 172.21.15.92:0/989426818 >> 172.21.15.92:0/989426818 conn(0x7fc7080b1760 msgr2=0x7fc70806e6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:14:44.932 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:44.929+0000 7fc70e7f3640 1 -- 172.21.15.92:0/989426818 shutdown_connections 2024-09-11T00:14:44.932 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:44.929+0000 7fc70e7f3640 1 -- 172.21.15.92:0/989426818 wait complete. 2024-09-11T00:14:44.943 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T00:14:45.044 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:45.042+0000 7fa55ee47640 1 -- 172.21.15.92:0/3069327792 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa5580b4000 msgr2=0x7fa5580cf040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:45.044 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:45.042+0000 7fa55ee47640 1 --2- 172.21.15.92:0/3069327792 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa5580b4000 0x7fa5580cf040 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fa558075110 tx=0x7fa55002a5f0 comp rx=0 tx=0).stop 2024-09-11T00:14:45.044 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:45.042+0000 7fa55ee47640 1 -- 172.21.15.92:0/3069327792 shutdown_connections 2024-09-11T00:14:45.044 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:45.042+0000 7fa55ee47640 1 --2- 172.21.15.92:0/3069327792 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa5580b4000 0x7fa5580cf040 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:45.045 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:45.042+0000 7fa55ee47640 1 --2- 172.21.15.92:0/3069327792 >> v2:172.21.15.145:3300/0 conn(0x7fa5580b3b70 0x7fa5580ceb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:45.045 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:45.042+0000 7fa55ee47640 1 -- 172.21.15.92:0/3069327792 >> 172.21.15.92:0/3069327792 conn(0x7fa5580d0c00 msgr2=0x7fa5580d0fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:14:45.045 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:45.042+0000 7fa55ee47640 1 -- 172.21.15.92:0/3069327792 shutdown_connections 2024-09-11T00:14:45.045 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:45.042+0000 7fa55ee47640 1 -- 172.21.15.92:0/3069327792 wait complete. 2024-09-11T00:14:45.047 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:45.043+0000 7fa55ee47640 1 Processor -- start 2024-09-11T00:14:45.047 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:45.043+0000 7fa55ee47640 1 -- start start 2024-09-11T00:14:45.047 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:45.044+0000 7fa55ee47640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa5580b3b70 0x7fa558152e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:45.047 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:45.044+0000 7fa55ee47640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa5580b4000 0x7fa55814a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:45.047 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:45.044+0000 7fa55ee47640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa55815e6d0 0x7fa55815d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:45.047 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:45.044+0000 7fa55ee47640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fa5580cf700 con 0x7fa5580b4000 2024-09-11T00:14:45.047 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:45.044+0000 7fa55ee47640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fa5580cf580 con 0x7fa5580b3b70 2024-09-11T00:14:45.047 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:45.044+0000 7fa55ee47640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7fa5580cf880 con 0x7fa55815e6d0 2024-09-11T00:14:45.048 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:45.044+0000 7fa557fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa5580b4000 0x7fa55814a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:45.048 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:45.044+0000 7fa557fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa5580b4000 0x7fa55814a6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:39468/0 (socket says 172.21.15.92:39468) 2024-09-11T00:14:45.048 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:45.044+0000 7fa557fff640 1 -- 172.21.15.92:0/1374983767 learned_addr learned my addr 172.21.15.92:0/1374983767 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-11T00:14:45.048 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:45.044+0000 7fa55cbe3640 1 --2- 172.21.15.92:0/1374983767 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa5580b3b70 0x7fa558152e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:45.048 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:45.044+0000 7fa55d3e4640 1 --2- 172.21.15.92:0/1374983767 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa55815e6d0 0x7fa55815d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:45.048 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:45.044+0000 7fa557fff640 1 -- 172.21.15.92:0/1374983767 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa55815e6d0 msgr2=0x7fa55815d190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:45.048 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:45.044+0000 7fa557fff640 1 --2- 172.21.15.92:0/1374983767 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa55815e6d0 0x7fa55815d190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:45.048 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:45.044+0000 7fa557fff640 1 -- 172.21.15.92:0/1374983767 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa5580b3b70 msgr2=0x7fa558152e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:45.048 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:45.044+0000 7fa557fff640 1 --2- 172.21.15.92:0/1374983767 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa5580b3b70 0x7fa558152e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:45.048 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:45.044+0000 7fa557fff640 1 -- 172.21.15.92:0/1374983767 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5581f9060 con 0x7fa5580b4000 2024-09-11T00:14:45.048 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:45.044+0000 7fa55d3e4640 1 --2- 172.21.15.92:0/1374983767 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa55815e6d0 0x7fa55815d190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:14:45.048 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:45.044+0000 7fa557fff640 1 --2- 172.21.15.92:0/1374983767 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa5580b4000 0x7fa55814a6c0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fa54c00eab0 tx=0x7fa54c00ef70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:14:45.048 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:45.045+0000 7fa5557fa640 1 -- 172.21.15.92:0/1374983767 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa54c00ce40 con 0x7fa5580b4000 2024-09-11T00:14:45.049 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:45.045+0000 7fa5557fa640 1 -- 172.21.15.92:0/1374983767 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa54c004c10 con 0x7fa5580b4000 2024-09-11T00:14:45.049 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:45.045+0000 7fa55ee47640 1 -- 172.21.15.92:0/1374983767 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa5581523a0 con 0x7fa5580b4000 2024-09-11T00:14:45.049 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:45.045+0000 7fa5557fa640 1 -- 172.21.15.92:0/1374983767 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa54c005020 con 0x7fa5580b4000 2024-09-11T00:14:45.049 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:45.045+0000 7fa55ee47640 1 -- 172.21.15.92:0/1374983767 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa558152960 con 0x7fa5580b4000 2024-09-11T00:14:45.049 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:45.046+0000 7fa55ee47640 1 -- 172.21.15.92:0/1374983767 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa5580cfd50 con 0x7fa5580b4000 2024-09-11T00:14:45.050 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:45.046+0000 7fa5557fa640 1 -- 172.21.15.92:0/1374983767 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fa54c00f040 con 0x7fa5580b4000 2024-09-11T00:14:45.050 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:45.046+0000 7fa5557fa640 1 --2- 172.21.15.92:0/1374983767 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7fa544077f70 0x7fa54407a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:45.050 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:45.047+0000 7fa5557fa640 1 -- 172.21.15.92:0/1374983767 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fa54c09a6a0 con 0x7fa5580b4000 2024-09-11T00:14:45.050 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:45.047+0000 7fa55cbe3640 1 --2- 172.21.15.92:0/1374983767 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7fa544077f70 0x7fa54407a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:45.050 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:45.047+0000 7fa55cbe3640 1 --2- 172.21.15.92:0/1374983767 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7fa544077f70 0x7fa54407a430 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fa548001720 tx=0x7fa548009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:14:45.052 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:45.051+0000 7fa5557fa640 1 -- 172.21.15.92:0/1374983767 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fa54c016030 con 0x7fa5580b4000 2024-09-11T00:14:45.260 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:45.258+0000 7fa55ee47640 1 -- 172.21.15.92:0/1374983767 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa558151fe0 con 0x7fa5580b4000 2024-09-11T00:14:45.260 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:45.259+0000 7fa5557fa640 1 -- 172.21.15.92:0/1374983767 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5225 (secure 0 0 0) 0x7fa54c0628a0 con 0x7fa5580b4000 2024-09-11T00:14:45.260 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:14:45.261 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":8,"btime":"2024-09-11T00:14:37:675941+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4286,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/2051794804","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":2051794804},{"type":"v1","addr":"172.21.15.92:6835","nonce":2051794804}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4295,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6835/1341143168","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6834","nonce":1341143168},{"type":"v1","addr":"172.21.15.145:6835","nonce":1341143168}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4356,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6833/3149311196","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":3149311196},{"type":"v1","addr":"172.21.15.92:6833","nonce":3149311196}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T00:14:17.969166+0000","modified":"2024-09-11T00:14:37.019981+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4374},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4374":{"gid":4374,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.145:6837/3236563974","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6836","nonce":3236563974},{"type":"v1","addr":"172.21.15.145:6837","nonce":3236563974}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4374,"qdb_cluster":[4374]},"id":1}]} 2024-09-11T00:14:45.261 INFO:teuthology.orchestra.run.smithi092.stderr:dumped fsmap epoch 8 2024-09-11T00:14:45.263 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:45.261+0000 7fa55ee47640 1 -- 172.21.15.92:0/1374983767 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7fa544077f70 msgr2=0x7fa54407a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:45.263 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:45.261+0000 7fa55ee47640 1 --2- 172.21.15.92:0/1374983767 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7fa544077f70 0x7fa54407a430 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fa548001720 tx=0x7fa548009040 comp rx=0 tx=0).stop 2024-09-11T00:14:45.263 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:45.261+0000 7fa55ee47640 1 -- 172.21.15.92:0/1374983767 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa5580b4000 msgr2=0x7fa55814a6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:45.263 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:45.261+0000 7fa55ee47640 1 --2- 172.21.15.92:0/1374983767 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa5580b4000 0x7fa55814a6c0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fa54c00eab0 tx=0x7fa54c00ef70 comp rx=0 tx=0).stop 2024-09-11T00:14:45.263 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:45.261+0000 7fa55ee47640 1 -- 172.21.15.92:0/1374983767 shutdown_connections 2024-09-11T00:14:45.263 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:45.261+0000 7fa55ee47640 1 --2- 172.21.15.92:0/1374983767 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7fa544077f70 0x7fa54407a430 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:45.263 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:45.261+0000 7fa55ee47640 1 --2- 172.21.15.92:0/1374983767 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa55815e6d0 0x7fa55815d190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:45.263 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:45.261+0000 7fa55ee47640 1 --2- 172.21.15.92:0/1374983767 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa5580b4000 0x7fa55814a6c0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:45.263 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:45.261+0000 7fa55ee47640 1 --2- 172.21.15.92:0/1374983767 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa5580b3b70 0x7fa558152e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:45.264 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:45.261+0000 7fa55ee47640 1 -- 172.21.15.92:0/1374983767 >> 172.21.15.92:0/1374983767 conn(0x7fa5580d0c00 msgr2=0x7fa5580cd520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:14:45.264 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:45.261+0000 7fa55ee47640 1 -- 172.21.15.92:0/1374983767 shutdown_connections 2024-09-11T00:14:45.264 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:45.261+0000 7fa55ee47640 1 -- 172.21.15.92:0/1374983767 wait complete. 2024-09-11T00:14:45.676 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 8, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-11T00:14:17.969166+0000', 'modified': '2024-09-11T00:14:37.019981+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4374}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4374': {'gid': 4374, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.145:6837/3236563974', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.145:6836', 'nonce': 3236563974}, {'type': 'v1', 'addr': '172.21.15.145:6837', 'nonce': 3236563974}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4374, 'qdb_cluster': [4374]} 2024-09-11T00:14:45.676 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-11T00:14:45.676 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-09-11T00:14:45.781 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:45.778+0000 7f7040984640 1 -- 172.21.15.92:0/1688494655 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f703c0b4a60 msgr2=0x7f703c072f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:45.781 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:45.778+0000 7f7040984640 1 --2- 172.21.15.92:0/1688494655 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f703c0b4a60 0x7f703c072f00 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f7034005fd0 tx=0x7f703402a540 comp rx=0 tx=0).stop 2024-09-11T00:14:45.781 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:45.778+0000 7f7040984640 1 -- 172.21.15.92:0/1688494655 shutdown_connections 2024-09-11T00:14:45.781 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:45.778+0000 7f7040984640 1 --2- 172.21.15.92:0/1688494655 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f703c0b4a60 0x7f703c072f00 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:45.781 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:45.778+0000 7f7040984640 1 -- 172.21.15.92:0/1688494655 >> 172.21.15.92:0/1688494655 conn(0x7f703c0b1c80 msgr2=0x7f703c0b2060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:14:45.782 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:45.778+0000 7f7040984640 1 -- 172.21.15.92:0/1688494655 shutdown_connections 2024-09-11T00:14:45.782 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:45.778+0000 7f7040984640 1 -- 172.21.15.92:0/1688494655 wait complete. 2024-09-11T00:14:45.802 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:45.779+0000 7f7040984640 1 Processor -- start 2024-09-11T00:14:45.803 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:45.780+0000 7f7040984640 1 -- start start 2024-09-11T00:14:45.803 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:45.780+0000 7f7040984640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f703c073cf0 0x7f703c0cb9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:45.803 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:45.780+0000 7f7040984640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f703c0b4a60 0x7f703c1542c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:45.803 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:45.780+0000 7f7040984640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f703c15a920 0x7f703c1f4800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:45.803 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:45.780+0000 7f7040984640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f703c15bbb0 con 0x7f703c073cf0 2024-09-11T00:14:45.803 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:45.780+0000 7f7040984640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f703c15ba30 con 0x7f703c0b4a60 2024-09-11T00:14:45.803 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:45.780+0000 7f7040984640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f703c15bd30 con 0x7f703c15a920 2024-09-11T00:14:45.803 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:45.780+0000 7f703a59c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f703c073cf0 0x7f703c0cb9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:45.803 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:45.780+0000 7f703a59c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f703c073cf0 0x7f703c0cb9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:39482/0 (socket says 172.21.15.92:39482) 2024-09-11T00:14:45.803 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:45.780+0000 7f703a59c640 1 -- 172.21.15.92:0/3326560630 learned_addr learned my addr 172.21.15.92:0/3326560630 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-11T00:14:45.803 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:45.781+0000 7f703ad9d640 1 --2- 172.21.15.92:0/3326560630 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f703c15a920 0x7f703c1f4800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:45.803 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:45.781+0000 7f7039d9b640 1 --2- 172.21.15.92:0/3326560630 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f703c0b4a60 0x7f703c1542c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:45.804 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:45.781+0000 7f703a59c640 1 -- 172.21.15.92:0/3326560630 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f703c15a920 msgr2=0x7f703c1f4800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:45.804 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:45.781+0000 7f703a59c640 1 --2- 172.21.15.92:0/3326560630 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f703c15a920 0x7f703c1f4800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:45.804 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:45.781+0000 7f703a59c640 1 -- 172.21.15.92:0/3326560630 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f703c0b4a60 msgr2=0x7f703c1542c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:45.804 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:45.781+0000 7f703a59c640 1 --2- 172.21.15.92:0/3326560630 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f703c0b4a60 0x7f703c1542c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:45.804 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:45.781+0000 7f703a59c640 1 -- 172.21.15.92:0/3326560630 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f703c154bc0 con 0x7f703c073cf0 2024-09-11T00:14:45.804 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:45.781+0000 7f703ad9d640 1 --2- 172.21.15.92:0/3326560630 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f703c15a920 0x7f703c1f4800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:14:45.804 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:45.781+0000 7f7039d9b640 1 --2- 172.21.15.92:0/3326560630 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f703c0b4a60 0x7f703c1542c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:14:45.804 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:45.781+0000 7f703a59c640 1 --2- 172.21.15.92:0/3326560630 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f703c073cf0 0x7f703c0cb9d0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f702c00ba50 tx=0x7f702c00bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:14:45.804 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:45.781+0000 7f702affd640 1 -- 172.21.15.92:0/3326560630 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f702c019070 con 0x7f703c073cf0 2024-09-11T00:14:45.804 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:45.781+0000 7f702affd640 1 -- 172.21.15.92:0/3326560630 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f702c00ccb0 con 0x7f703c073cf0 2024-09-11T00:14:45.804 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:45.781+0000 7f7040984640 1 -- 172.21.15.92:0/3326560630 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f703c154ea0 con 0x7f703c073cf0 2024-09-11T00:14:45.804 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:45.781+0000 7f702affd640 1 -- 172.21.15.92:0/3326560630 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f702c0146a0 con 0x7f703c073cf0 2024-09-11T00:14:45.805 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:45.781+0000 7f7040984640 1 -- 172.21.15.92:0/3326560630 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f703c155460 con 0x7f703c073cf0 2024-09-11T00:14:45.805 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:45.783+0000 7f702affd640 1 -- 172.21.15.92:0/3326560630 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f702c014840 con 0x7f703c073cf0 2024-09-11T00:14:45.805 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:45.783+0000 7f702affd640 1 --2- 172.21.15.92:0/3326560630 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f701c077fa0 0x7f701c07a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:45.805 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:45.783+0000 7f702affd640 1 -- 172.21.15.92:0/3326560630 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f702c099f90 con 0x7f703c073cf0 2024-09-11T00:14:45.805 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:45.783+0000 7f7039d9b640 1 --2- 172.21.15.92:0/3326560630 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f701c077fa0 0x7f701c07a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:45.805 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:45.784+0000 7f7043827740 1 Processor -- start 2024-09-11T00:14:45.805 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:45.784+0000 7f7043827740 1 -- start start 2024-09-11T00:14:45.805 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:45.784+0000 7f7039d9b640 1 --2- 172.21.15.92:0/3326560630 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f701c077fa0 0x7f701c07a460 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f7030007fd0 tx=0x7f7030009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:14:45.805 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:45.785+0000 7f7043827740 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x563d48792ef0 0x563d4876b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:45.805 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:45.785+0000 7f7043827740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x563d48771310 0x563d487932d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:45.805 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:45.785+0000 7f7043827740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563d487b5df0 0x563d487b6260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:45.805 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:45.785+0000 7f7043827740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x563d486e2820 con 0x563d487b5df0 2024-09-11T00:14:45.805 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:45.785+0000 7f7043827740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x563d486d1c50 con 0x563d48771310 2024-09-11T00:14:45.806 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:45.785+0000 7f7043827740 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x563d486d5a60 con 0x563d48792ef0 2024-09-11T00:14:45.806 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:45.785+0000 7f703ad9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563d487b5df0 0x563d487b6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:45.806 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:45.785+0000 7f703ad9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563d487b5df0 0x563d487b6260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:39494/0 (socket says 172.21.15.92:39494) 2024-09-11T00:14:45.806 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:45.785+0000 7f703ad9d640 1 -- 172.21.15.92:0/2905759395 learned_addr learned my addr 172.21.15.92:0/2905759395 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-11T00:14:45.806 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:45.785+0000 7f7039d9b640 1 --2- 172.21.15.92:0/2905759395 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x563d48771310 0x563d487932d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:45.806 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:45.785+0000 7f703a59c640 1 --2- 172.21.15.92:0/2905759395 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x563d48792ef0 0x563d4876b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:45.806 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:45.785+0000 7f703ad9d640 1 -- 172.21.15.92:0/2905759395 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x563d48792ef0 msgr2=0x563d4876b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:14:45.806 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:45.785+0000 7f703ad9d640 1 --2- 172.21.15.92:0/2905759395 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x563d48792ef0 0x563d4876b090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:45.806 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:45.785+0000 7f703ad9d640 1 -- 172.21.15.92:0/2905759395 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x563d48771310 msgr2=0x563d487932d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:14:45.806 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:45.785+0000 7f703ad9d640 1 --2- 172.21.15.92:0/2905759395 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x563d48771310 0x563d487932d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:45.806 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:45.785+0000 7f703ad9d640 1 -- 172.21.15.92:0/2905759395 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563d48433850 con 0x563d487b5df0 2024-09-11T00:14:45.806 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:45.785+0000 7f703a59c640 1 --2- 172.21.15.92:0/2905759395 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x563d48792ef0 0x563d4876b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:14:45.806 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:45.785+0000 7f703ad9d640 1 --2- 172.21.15.92:0/2905759395 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563d487b5df0 0x563d487b6260 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f703402ab30 tx=0x7f70340046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d41d5f285844571 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:14:45.807 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:45.785+0000 7f701bfff640 1 -- 172.21.15.92:0/2905759395 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f703403f070 con 0x563d487b5df0 2024-09-11T00:14:45.807 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:45.785+0000 7f701bfff640 1 -- 172.21.15.92:0/2905759395 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7034005310 con 0x563d487b5df0 2024-09-11T00:14:45.807 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:45.785+0000 7f701bfff640 1 -- 172.21.15.92:0/2905759395 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7034035070 con 0x563d487b5df0 2024-09-11T00:14:45.807 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:45.786+0000 7f7043827740 1 -- 172.21.15.92:0/2905759395 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563d487b5df0 msgr2=0x563d487b6260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:45.807 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:45.786+0000 7f7043827740 1 --2- 172.21.15.92:0/2905759395 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563d487b5df0 0x563d487b6260 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f703402ab30 tx=0x7f70340046c0 comp rx=0 tx=0).stop 2024-09-11T00:14:45.807 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:45.786+0000 7f7043827740 1 -- 172.21.15.92:0/2905759395 shutdown_connections 2024-09-11T00:14:45.807 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:45.786+0000 7f7043827740 1 --2- 172.21.15.92:0/2905759395 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563d487b5df0 0x563d487b6260 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:45.807 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:45.786+0000 7f7043827740 1 --2- 172.21.15.92:0/2905759395 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x563d48771310 0x563d487932d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:45.807 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:45.786+0000 7f7043827740 1 --2- 172.21.15.92:0/2905759395 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x563d48792ef0 0x563d4876b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:45.807 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:45.786+0000 7f7043827740 1 -- 172.21.15.92:0/2905759395 >> 172.21.15.92:0/2905759395 conn(0x563d4876c6a0 msgr2=0x563d487700c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:14:45.807 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:45.786+0000 7f7043827740 1 -- 172.21.15.92:0/2905759395 shutdown_connections 2024-09-11T00:14:45.807 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:45.786+0000 7f7043827740 1 -- 172.21.15.92:0/2905759395 wait complete. 2024-09-11T00:14:45.807 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:45.787+0000 7f7043827740 1 -- start start 2024-09-11T00:14:45.807 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:45.787+0000 7f7043827740 1 Processor -- start 2024-09-11T00:14:45.808 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:45.788+0000 7f7043827740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x563d48792ef0 0x563d487ccfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:45.808 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:45.788+0000 7f7043827740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563d487b5df0 0x563d487912d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:45.808 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:45.788+0000 7f7043827740 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x563d487b0a20 0x563d487b0ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:45.808 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:45.788+0000 7f7043827740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x563d48442620 con 0x563d487b5df0 2024-09-11T00:14:45.808 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:45.788+0000 7f7043827740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x563d486775f0 con 0x563d48792ef0 2024-09-11T00:14:45.808 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:45.788+0000 7f7043827740 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x563d4876b5d0 con 0x563d487b0a20 2024-09-11T00:14:45.808 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:45.788+0000 7f7043827740 10 client.0 _ll_register_callbacks cb 0x563d4867b0a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:14:45.808 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:45.788+0000 7f7039d9b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563d487b5df0 0x563d487912d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:45.808 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:45.788+0000 7f7039d9b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563d487b5df0 0x563d487912d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:39506/0 (socket says 172.21.15.92:39506) 2024-09-11T00:14:45.809 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:45.788+0000 7f7039d9b640 1 -- 172.21.15.92:0/1220976062 learned_addr learned my addr 172.21.15.92:0/1220976062 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-11T00:14:45.809 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:45.788+0000 7f703a59c640 1 --2- 172.21.15.92:0/1220976062 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x563d48792ef0 0x563d487ccfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:45.809 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:45.788+0000 7f703ad9d640 1 --2- 172.21.15.92:0/1220976062 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x563d487b0a20 0x563d487b0ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:45.809 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:45.788+0000 7f7039d9b640 1 -- 172.21.15.92:0/1220976062 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x563d487b0a20 msgr2=0x563d487b0ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:14:45.809 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:45.788+0000 7f7039d9b640 1 --2- 172.21.15.92:0/1220976062 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x563d487b0a20 0x563d487b0ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:45.809 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:45.788+0000 7f7039d9b640 1 -- 172.21.15.92:0/1220976062 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x563d48792ef0 msgr2=0x563d487ccfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:14:45.809 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:45.788+0000 7f7039d9b640 1 --2- 172.21.15.92:0/1220976062 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x563d48792ef0 0x563d487ccfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:45.809 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:45.788+0000 7f7039d9b640 1 -- 172.21.15.92:0/1220976062 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563d484aa6b0 con 0x563d487b5df0 2024-09-11T00:14:45.809 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:45.788+0000 7f7039d9b640 1 --2- 172.21.15.92:0/1220976062 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563d487b5df0 0x563d487912d0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f703000e7c0 tx=0x7f7030000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=325d89a76c7b37e1 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:14:45.809 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:45.788+0000 7f70197fa640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-11T00:14:45.809 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:45.788+0000 7f70197fa640 1 -- 172.21.15.92:0/1220976062 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7030027060 con 0x563d487b5df0 2024-09-11T00:14:45.810 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:45.788+0000 7f70197fa640 1 -- 172.21.15.92:0/1220976062 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f7030010040 con 0x563d487b5df0 2024-09-11T00:14:45.810 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:45.788+0000 7f7043827740 1 -- 172.21.15.92:0/1220976062 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7034005310 con 0x563d487b5df0 2024-09-11T00:14:45.810 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:45.789+0000 7f70197fa640 1 -- 172.21.15.92:0/1220976062 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) ==== 24+0+0 (secure 0 0 0) 0x7f7030003b70 con 0x563d487b5df0 2024-09-11T00:14:45.810 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:45.789+0000 7f7043827740 10 client.4779 fetch_fsmap learned FSMap version 8 2024-09-11T00:14:45.810 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:45.789+0000 7f7043827740 1 -- 172.21.15.92:0/1220976062 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) -- 0x563d487c9640 con 0x563d487b5df0 2024-09-11T00:14:45.810 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:45.789+0000 7f70197fa640 1 -- 172.21.15.92:0/1220976062 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7034005310 con 0x563d487b5df0 2024-09-11T00:14:45.810 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:45.789+0000 7f70197fa640 1 -- 172.21.15.92:0/1220976062 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 8) ==== 3510+0+0 (secure 0 0 0) 0x7f7030013420 con 0x563d487b5df0 2024-09-11T00:14:45.810 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:45.789+0000 7f7043827740 10 client.4779 fetch_fsmap finished waiting for FSMap version 8 2024-09-11T00:14:45.810 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:45.789+0000 7f7043827740 10 client.4779 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-11T00:14:45.810 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:45.789+0000 7f7043827740 20 client.4779 populate_metadata read hostname 'smithi092' 2024-09-11T00:14:45.810 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:45.789+0000 7f7043827740 1 --2- 172.21.15.92:0/1220976062 >> [v2:172.21.15.145:6836/3236563974,v1:172.21.15.145:6837/3236563974] conn(0x563d487b2b20 0x563d487b2f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:45.810 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:45.789+0000 7f7043827740 4 client.4779 mds_command: new command op to 4374 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T00:14:45.810 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:45.789+0000 7f7043827740 1 -- 172.21.15.92:0/1220976062 --> [v2:172.21.15.145:6836/3236563974,v1:172.21.15.145:6837/3236563974] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563d486e4770 con 0x563d487b2b20 2024-09-11T00:14:45.810 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:45.789+0000 7f703a59c640 1 --2- 172.21.15.92:0/1220976062 >> [v2:172.21.15.145:6836/3236563974,v1:172.21.15.145:6837/3236563974] conn(0x563d487b2b20 0x563d487b2f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:45.811 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:45.790+0000 7f70197fa640 10 client.4779 ms_handle_connect on v2:172.21.15.145:6836/3236563974 2024-09-11T00:14:45.811 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:45.790+0000 7f703a59c640 1 --2- 172.21.15.92:0/1220976062 >> [v2:172.21.15.145:6836/3236563974,v1:172.21.15.145:6837/3236563974] conn(0x563d487b2b20 0x563d487b2f00 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f3c805ad52bd38d9 server_cookie=466aee3f92d4abaf in_seq=0 out_seq=0 2024-09-11T00:14:45.811 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:45.790+0000 7f70197fa640 1 -- 172.21.15.92:0/1220976062 <== mds.0 v2:172.21.15.145:6836/3236563974 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x563d486e4770 con 0x563d487b2b20 2024-09-11T00:14:45.811 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:45.790+0000 7f70197fa640 10 client.4779 handle_command_reply: tid=0 2024-09-11T00:14:45.811 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:45.790+0000 7f7043827740 1 client.4779 shutdown 2024-09-11T00:14:45.811 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:45.790+0000 7f7043827740 1 -- 172.21.15.92:0/1220976062 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563d487b5df0 msgr2=0x563d487912d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:45.811 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:45.790+0000 7f7043827740 1 --2- 172.21.15.92:0/1220976062 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563d487b5df0 0x563d487912d0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f703000e7c0 tx=0x7f7030000ed0 comp rx=0 tx=0).stop 2024-09-11T00:14:45.811 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:45.791+0000 7f7043827740 1 -- 172.21.15.92:0/1220976062 shutdown_connections 2024-09-11T00:14:45.811 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:45.791+0000 7f7043827740 1 --2- 172.21.15.92:0/1220976062 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x563d487b0a20 0x563d487b0ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:45.811 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:45.791+0000 7f7043827740 1 --2- 172.21.15.92:0/1220976062 >> [v2:172.21.15.145:6836/3236563974,v1:172.21.15.145:6837/3236563974] conn(0x563d487b2b20 0x563d487b2f00 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:45.811 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:45.791+0000 7f7043827740 1 --2- 172.21.15.92:0/1220976062 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563d487b5df0 0x563d487912d0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:45.811 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:45.791+0000 7f7043827740 1 --2- 172.21.15.92:0/1220976062 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x563d48792ef0 0x563d487ccfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:45.811 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:45.791+0000 7f70197fa640 0 client.4779 ms_handle_reset on v2:172.21.15.145:6836/3236563974 2024-09-11T00:14:45.812 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:45.791+0000 7f7043827740 1 -- 172.21.15.92:0/1220976062 >> 172.21.15.92:0/1220976062 conn(0x563d48771310 msgr2=0x563d487695b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:14:45.812 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:45.791+0000 7f7043827740 1 -- 172.21.15.92:0/1220976062 shutdown_connections 2024-09-11T00:14:45.812 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:45.791+0000 7f7043827740 1 -- 172.21.15.92:0/1220976062 wait complete. 2024-09-11T00:14:45.812 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:45.791+0000 7f7043827740 20 client.4779 trim_cache size 0 max 16384 2024-09-11T00:14:45.818 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:45.809+0000 7f7043827740 1 Processor -- start 2024-09-11T00:14:45.818 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:45.809+0000 7f7043827740 1 -- start start 2024-09-11T00:14:45.818 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:45.809+0000 7f7043827740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x563d48792ef0 0x563d4879dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:45.818 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:45.809+0000 7f7043827740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563d487b0a20 0x563d4876feb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:45.818 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:45.809+0000 7f7043827740 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x563d487b5df0 0x563d487703f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:45.819 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:45.809+0000 7f7043827740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f703c1fe120 con 0x563d487b0a20 2024-09-11T00:14:45.819 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:45.809+0000 7f7043827740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f703c1fd2a0 con 0x563d48792ef0 2024-09-11T00:14:45.819 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:45.809+0000 7f7043827740 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f703c1f1cf0 con 0x563d487b5df0 2024-09-11T00:14:45.819 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:45.809+0000 7f7039d9b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563d487b0a20 0x563d4876feb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:45.819 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:45.809+0000 7f7039d9b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563d487b0a20 0x563d4876feb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:39512/0 (socket says 172.21.15.92:39512) 2024-09-11T00:14:45.819 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:45.809+0000 7f7039d9b640 1 -- 172.21.15.92:0/2976096728 learned_addr learned my addr 172.21.15.92:0/2976096728 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-11T00:14:45.819 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:45.810+0000 7f703a59c640 1 --2- 172.21.15.92:0/2976096728 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x563d48792ef0 0x563d4879dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:45.819 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:45.810+0000 7f7039d9b640 1 -- 172.21.15.92:0/2976096728 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x563d487b5df0 msgr2=0x563d487703f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:14:45.819 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:45.810+0000 7f7039d9b640 1 --2- 172.21.15.92:0/2976096728 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x563d487b5df0 0x563d487703f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:45.819 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:45.810+0000 7f7039d9b640 1 -- 172.21.15.92:0/2976096728 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x563d48792ef0 msgr2=0x563d4879dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:14:45.819 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:45.810+0000 7f7039d9b640 1 --2- 172.21.15.92:0/2976096728 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x563d48792ef0 0x563d4879dbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:45.819 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:45.810+0000 7f7039d9b640 1 -- 172.21.15.92:0/2976096728 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563d487b6730 con 0x563d487b0a20 2024-09-11T00:14:45.819 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:45.810+0000 7f703a59c640 1 --2- 172.21.15.92:0/2976096728 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x563d48792ef0 0x563d4879dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:14:45.820 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:45.810+0000 7f7039d9b640 1 --2- 172.21.15.92:0/2976096728 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563d487b0a20 0x563d4876feb0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f7030005370 tx=0x7f703000e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e19504527662bb6 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:14:45.820 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:45.810+0000 7f701b7fe640 1 -- 172.21.15.92:0/2976096728 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70300039c0 con 0x563d487b0a20 2024-09-11T00:14:45.820 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:45.810+0000 7f701b7fe640 1 -- 172.21.15.92:0/2976096728 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7030003d10 con 0x563d487b0a20 2024-09-11T00:14:45.820 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:45.810+0000 7f701b7fe640 1 -- 172.21.15.92:0/2976096728 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7030013420 con 0x563d487b0a20 2024-09-11T00:14:45.820 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:45.810+0000 7f7043827740 1 -- 172.21.15.92:0/2976096728 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563d487b0a20 msgr2=0x563d4876feb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:45.820 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:45.810+0000 7f7043827740 1 --2- 172.21.15.92:0/2976096728 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563d487b0a20 0x563d4876feb0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f7030005370 tx=0x7f703000e530 comp rx=0 tx=0).stop 2024-09-11T00:14:45.820 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:45.810+0000 7f7043827740 1 -- 172.21.15.92:0/2976096728 shutdown_connections 2024-09-11T00:14:45.820 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:45.811+0000 7f7043827740 1 --2- 172.21.15.92:0/2976096728 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x563d487b5df0 0x563d487703f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:45.820 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:45.811+0000 7f7043827740 1 --2- 172.21.15.92:0/2976096728 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563d487b0a20 0x563d4876feb0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:45.820 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:45.811+0000 7f7043827740 1 --2- 172.21.15.92:0/2976096728 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x563d48792ef0 0x563d4879dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:45.820 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:45.811+0000 7f7043827740 1 -- 172.21.15.92:0/2976096728 >> 172.21.15.92:0/2976096728 conn(0x563d48771310 msgr2=0x563d48798940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:14:45.820 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:45.811+0000 7f7043827740 1 -- 172.21.15.92:0/2976096728 shutdown_connections 2024-09-11T00:14:45.821 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:45.811+0000 7f7043827740 1 -- 172.21.15.92:0/2976096728 wait complete. 2024-09-11T00:14:45.821 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:45.811+0000 7f7043827740 1 -- start start 2024-09-11T00:14:45.821 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:45.811+0000 7f7043827740 1 Processor -- start 2024-09-11T00:14:45.821 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:45.812+0000 7f7043827740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563d48792ef0 0x563d48795c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:45.821 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:45.812+0000 7f7043827740 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x563d487b0a20 0x563d4882fd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:45.821 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:45.812+0000 7f7043827740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x563d487b5df0 0x563d4876e630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:45.821 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:45.812+0000 7f7043827740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x563d48799c20 con 0x563d48792ef0 2024-09-11T00:14:45.821 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:45.812+0000 7f7043827740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f703c070740 con 0x563d487b5df0 2024-09-11T00:14:45.821 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:45.812+0000 7f7043827740 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x563d487b4df0 con 0x563d487b0a20 2024-09-11T00:14:45.821 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:45.812+0000 7f7043827740 10 client.0 _ll_register_callbacks cb 0x7f7030001440 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:14:45.821 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:45.812+0000 7f703a59c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563d48792ef0 0x563d48795c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:45.821 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:45.812+0000 7f703a59c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563d48792ef0 0x563d48795c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:39522/0 (socket says 172.21.15.92:39522) 2024-09-11T00:14:45.822 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:45.812+0000 7f703a59c640 1 -- 172.21.15.92:0/3816525560 learned_addr learned my addr 172.21.15.92:0/3816525560 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-11T00:14:45.822 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:45.812+0000 7f703ad9d640 1 --2- 172.21.15.92:0/3816525560 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x563d487b5df0 0x563d4876e630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:45.822 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:45.812+0000 7f7039d9b640 1 --2- 172.21.15.92:0/3816525560 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x563d487b0a20 0x563d4882fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:45.822 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:45.812+0000 7f703a59c640 1 -- 172.21.15.92:0/3816525560 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x563d487b0a20 msgr2=0x563d4882fd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:14:45.822 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:45.812+0000 7f703a59c640 1 --2- 172.21.15.92:0/3816525560 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x563d487b0a20 0x563d4882fd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:45.822 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:45.812+0000 7f703a59c640 1 -- 172.21.15.92:0/3816525560 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x563d487b5df0 msgr2=0x563d4876e630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:14:45.822 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:45.812+0000 7f703a59c640 1 --2- 172.21.15.92:0/3816525560 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x563d487b5df0 0x563d4876e630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:45.822 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:45.812+0000 7f703a59c640 1 -- 172.21.15.92:0/3816525560 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563d488302a0 con 0x563d48792ef0 2024-09-11T00:14:45.822 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:45.812+0000 7f703ad9d640 1 --2- 172.21.15.92:0/3816525560 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x563d487b5df0 0x563d4876e630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:14:45.822 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:45.812+0000 7f7039d9b640 1 --2- 172.21.15.92:0/3816525560 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x563d487b0a20 0x563d4882fd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:14:45.822 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:45.813+0000 7f703a59c640 1 --2- 172.21.15.92:0/3816525560 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563d48792ef0 0x563d48795c80 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f702c05e1b0 tx=0x7f702c061f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4b1b11e290359cd server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:14:45.822 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:45.813+0000 7f70197fa640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-11T00:14:45.822 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:45.813+0000 7f70197fa640 1 -- 172.21.15.92:0/3816525560 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f702c06b2c0 con 0x563d48792ef0 2024-09-11T00:14:45.823 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:45.813+0000 7f70197fa640 1 -- 172.21.15.92:0/3816525560 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f702c094e00 con 0x563d48792ef0 2024-09-11T00:14:45.823 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:45.813+0000 7f7043827740 1 -- 172.21.15.92:0/3816525560 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7030003d10 con 0x563d48792ef0 2024-09-11T00:14:45.823 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:45.813+0000 7f70197fa640 1 -- 172.21.15.92:0/3816525560 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) ==== 24+0+0 (secure 0 0 0) 0x7f702c080050 con 0x563d48792ef0 2024-09-11T00:14:45.823 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:45.813+0000 7f7043827740 10 client.4785 fetch_fsmap learned FSMap version 8 2024-09-11T00:14:45.823 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:45.813+0000 7f7043827740 1 -- 172.21.15.92:0/3816525560 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) -- 0x563d4876ebd0 con 0x563d48792ef0 2024-09-11T00:14:45.823 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:45.813+0000 7f70197fa640 1 -- 172.21.15.92:0/3816525560 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7030003d10 con 0x563d48792ef0 2024-09-11T00:14:45.823 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:45.813+0000 7f70197fa640 1 -- 172.21.15.92:0/3816525560 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 8) ==== 3510+0+0 (secure 0 0 0) 0x7f702c083020 con 0x563d48792ef0 2024-09-11T00:14:45.823 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:45.813+0000 7f7043827740 10 client.4785 fetch_fsmap finished waiting for FSMap version 8 2024-09-11T00:14:45.823 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:45.813+0000 7f7043827740 10 client.4785 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-11T00:14:45.823 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:45.813+0000 7f7043827740 20 client.4785 populate_metadata read hostname 'smithi092' 2024-09-11T00:14:45.824 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:45.813+0000 7f7043827740 1 --2- 172.21.15.92:0/3816525560 >> [v2:172.21.15.145:6836/3236563974,v1:172.21.15.145:6837/3236563974] conn(0x563d487705e0 0x563d487dca70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:45.824 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:45.813+0000 7f7043827740 4 client.4785 mds_command: new command op to 4374 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-11T00:14:45.824 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:45.813+0000 7f7043827740 1 -- 172.21.15.92:0/3816525560 --> [v2:172.21.15.145:6836/3236563974,v1:172.21.15.145:6837/3236563974] -- command(tid 0: {"prefix": "status"}) -- 0x563d486e0220 con 0x563d487705e0 2024-09-11T00:14:45.824 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:45.813+0000 7f7039d9b640 1 --2- 172.21.15.92:0/3816525560 >> [v2:172.21.15.145:6836/3236563974,v1:172.21.15.145:6837/3236563974] conn(0x563d487705e0 0x563d487dca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:45.824 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:45.814+0000 7f7039d9b640 1 --2- 172.21.15.92:0/3816525560 >> [v2:172.21.15.145:6836/3236563974,v1:172.21.15.145:6837/3236563974] conn(0x563d487705e0 0x563d487dca70 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ff9b9a0c02d2c571 server_cookie=5ebfb62bfda49481 in_seq=0 out_seq=0 2024-09-11T00:14:45.824 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:45.814+0000 7f70197fa640 10 client.4785 ms_handle_connect on v2:172.21.15.145:6836/3236563974 2024-09-11T00:14:45.824 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:45.814+0000 7f70197fa640 1 -- 172.21.15.92:0/3816525560 <== mds.0 v2:172.21.15.145:6836/3236563974 1 ==== command_reply(tid 0: 0 ) ==== 8+0+330 (crc 0 0 0) 0x563d486e0220 con 0x563d487705e0 2024-09-11T00:14:45.824 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:45.814+0000 7f70197fa640 10 client.4785 handle_command_reply: tid=0 2024-09-11T00:14:45.824 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:45.814+0000 7f7043827740 1 client.4785 shutdown 2024-09-11T00:14:45.824 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:45.814+0000 7f7043827740 1 -- 172.21.15.92:0/3816525560 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563d48792ef0 msgr2=0x563d48795c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:45.824 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:45.814+0000 7f7043827740 1 --2- 172.21.15.92:0/3816525560 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563d48792ef0 0x563d48795c80 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f702c05e1b0 tx=0x7f702c061f90 comp rx=0 tx=0).stop 2024-09-11T00:14:45.824 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:45.814+0000 7f7043827740 1 -- 172.21.15.92:0/3816525560 shutdown_connections 2024-09-11T00:14:45.824 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:45.814+0000 7f7043827740 1 --2- 172.21.15.92:0/3816525560 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x563d487b5df0 0x563d4876e630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:45.825 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:45.814+0000 7f7043827740 1 --2- 172.21.15.92:0/3816525560 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x563d487b0a20 0x563d4882fd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:45.825 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:45.814+0000 7f7043827740 1 --2- 172.21.15.92:0/3816525560 >> [v2:172.21.15.145:6836/3236563974,v1:172.21.15.145:6837/3236563974] conn(0x563d487705e0 0x563d487dca70 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:45.825 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:45.814+0000 7f7043827740 1 --2- 172.21.15.92:0/3816525560 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563d48792ef0 0x563d48795c80 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:45.825 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:45.814+0000 7f70197fa640 0 client.4785 ms_handle_reset on v2:172.21.15.145:6836/3236563974 2024-09-11T00:14:45.825 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:45.814+0000 7f7043827740 1 -- 172.21.15.92:0/3816525560 >> 172.21.15.92:0/3816525560 conn(0x563d48771310 msgr2=0x563d487986f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:14:45.825 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:45.814+0000 7f7043827740 1 -- 172.21.15.92:0/3816525560 shutdown_connections 2024-09-11T00:14:45.825 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:45.814+0000 7f7043827740 1 -- 172.21.15.92:0/3816525560 wait complete. 2024-09-11T00:14:45.825 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:45.814+0000 7f7043827740 20 client.4785 trim_cache size 0 max 16384 2024-09-11T00:14:45.825 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2024-09-11T00:14:45.826 INFO:teuthology.orchestra.run.smithi092.stdout: "cluster_fsid": "47039cb3-5d2a-46bf-9066-8055b5dfc583", 2024-09-11T00:14:45.826 INFO:teuthology.orchestra.run.smithi092.stdout: "whoami": 0, 2024-09-11T00:14:45.826 INFO:teuthology.orchestra.run.smithi092.stdout: "id": 4374, 2024-09-11T00:14:45.826 INFO:teuthology.orchestra.run.smithi092.stdout: "want_state": "up:active", 2024-09-11T00:14:45.826 INFO:teuthology.orchestra.run.smithi092.stdout: "state": "up:active", 2024-09-11T00:14:45.826 INFO:teuthology.orchestra.run.smithi092.stdout: "fs_name": "cephfs", 2024-09-11T00:14:45.826 INFO:teuthology.orchestra.run.smithi092.stdout: "rank_uptime": 27.193909510000001, 2024-09-11T00:14:45.826 INFO:teuthology.orchestra.run.smithi092.stdout: "mdsmap_epoch": 8, 2024-09-11T00:14:45.826 INFO:teuthology.orchestra.run.smithi092.stdout: "osdmap_epoch": 25, 2024-09-11T00:14:45.826 INFO:teuthology.orchestra.run.smithi092.stdout: "osdmap_epoch_barrier": 25, 2024-09-11T00:14:45.826 INFO:teuthology.orchestra.run.smithi092.stdout: "uptime": 33.271492207000001 2024-09-11T00:14:45.826 INFO:teuthology.orchestra.run.smithi092.stdout:} 2024-09-11T00:14:45.828 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:45.815+0000 7f7040984640 1 -- 172.21.15.92:0/3326560630 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f701c077fa0 msgr2=0x7f701c07a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:45.828 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:45.815+0000 7f7040984640 1 --2- 172.21.15.92:0/3326560630 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f701c077fa0 0x7f701c07a460 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f7030007fd0 tx=0x7f7030009040 comp rx=0 tx=0).stop 2024-09-11T00:14:45.828 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:45.815+0000 7f7040984640 1 -- 172.21.15.92:0/3326560630 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f703c073cf0 msgr2=0x7f703c0cb9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:45.828 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:45.815+0000 7f7040984640 1 --2- 172.21.15.92:0/3326560630 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f703c073cf0 0x7f703c0cb9d0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f702c00ba50 tx=0x7f702c00bf10 comp rx=0 tx=0).stop 2024-09-11T00:14:45.828 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:45.815+0000 7f7040984640 1 -- 172.21.15.92:0/3326560630 shutdown_connections 2024-09-11T00:14:45.828 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:45.815+0000 7f7040984640 1 --2- 172.21.15.92:0/3326560630 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f701c077fa0 0x7f701c07a460 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:45.829 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:45.815+0000 7f7040984640 1 --2- 172.21.15.92:0/3326560630 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f703c15a920 0x7f703c1f4800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:45.829 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:45.815+0000 7f7040984640 1 --2- 172.21.15.92:0/3326560630 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f703c0b4a60 0x7f703c1542c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:45.829 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:45.815+0000 7f7040984640 1 --2- 172.21.15.92:0/3326560630 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f703c073cf0 0x7f703c0cb9d0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:45.829 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:45.815+0000 7f7040984640 1 -- 172.21.15.92:0/3326560630 >> 172.21.15.92:0/3326560630 conn(0x7f703c0b1c80 msgr2=0x7f703c0cdb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:14:45.829 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:45.815+0000 7f7040984640 1 -- 172.21.15.92:0/3326560630 shutdown_connections 2024-09-11T00:14:45.829 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:45.815+0000 7f7040984640 1 -- 172.21.15.92:0/3326560630 wait complete. 2024-09-11T00:14:45.829 INFO:teuthology.run_tasks:Running task kclient... 2024-09-11T00:14:45.849 INFO:tasks.kclient:Mounting kernel clients... 2024-09-11T00:14:45.850 INFO:tasks.kclient:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2024-09-11T00:14:45.850 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T00:14:45.850 DEBUG:teuthology.orchestra.run.smithi092:> ip netns list 2024-09-11T00:14:45.867 INFO:teuthology.orchestra.run.smithi092.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2024-09-11T00:14:45.868 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T00:14:45.868 DEBUG:teuthology.orchestra.run.smithi092:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-11T00:14:45.932 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T00:14:45.933 DEBUG:teuthology.orchestra.run.smithi092:> sudo ip link delete ceph-brx 2024-09-11T00:14:46.032 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T00:14:46.034 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T00:14:46.034 DEBUG:teuthology.orchestra.run.smithi092:> ip netns list 2024-09-11T00:14:46.075 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T00:14:46.090 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T00:14:46.090 DEBUG:teuthology.orchestra.run.smithi092:> sudo ip link delete ceph-brx 2024-09-11T00:14:46.193 INFO:teuthology.orchestra.run.smithi092.stderr:Cannot find device "ceph-brx" 2024-09-11T00:14:46.194 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T00:14:46.194 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T00:14:46.194 DEBUG:teuthology.orchestra.run.smithi145:> ip netns list 2024-09-11T00:14:46.213 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T00:14:46.214 DEBUG:teuthology.orchestra.run.smithi145:> sudo ip link delete ceph-brx 2024-09-11T00:14:46.288 INFO:teuthology.orchestra.run.smithi145.stderr:Cannot find device "ceph-brx" 2024-09-11T00:14:46.289 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T00:14:46.289 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T00:14:46.290 DEBUG:teuthology.orchestra.run.smithi145:> ip netns list 2024-09-11T00:14:46.349 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T00:14:46.349 DEBUG:teuthology.orchestra.run.smithi145:> sudo ip link delete ceph-brx 2024-09-11T00:14:46.418 INFO:teuthology.orchestra.run.smithi145.stderr:Cannot find device "ceph-brx" 2024-09-11T00:14:46.420 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T00:14:46.421 INFO:tasks.kclient:client.0 config is {'syntax': 'v1'} 2024-09-11T00:14:46.421 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-11T00:14:46.421 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-11T00:14:46.421 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-11T00:14:46.524 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:46.522+0000 7f5f7a452640 1 -- 172.21.15.92:0/1102351173 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f5f74144780 msgr2=0x7f5f740b3da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:46.524 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:46.522+0000 7f5f7a452640 1 --2- 172.21.15.92:0/1102351173 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f5f74144780 0x7f5f740b3da0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f5f64009830 tx=0x7f5f6402a410 comp rx=0 tx=0).stop 2024-09-11T00:14:46.525 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:46.522+0000 7f5f7a452640 1 -- 172.21.15.92:0/1102351173 shutdown_connections 2024-09-11T00:14:46.525 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:46.522+0000 7f5f7a452640 1 --2- 172.21.15.92:0/1102351173 >> v2:172.21.15.145:3300/0 conn(0x7f5f740cf210 0x7f5f74072aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:46.525 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:46.522+0000 7f5f7a452640 1 --2- 172.21.15.92:0/1102351173 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f5f74144780 0x7f5f740b3da0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:46.525 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:46.522+0000 7f5f7a452640 1 -- 172.21.15.92:0/1102351173 >> 172.21.15.92:0/1102351173 conn(0x7f5f740b1760 msgr2=0x7f5f740b1b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:14:46.525 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:46.522+0000 7f5f7a452640 1 -- 172.21.15.92:0/1102351173 shutdown_connections 2024-09-11T00:14:46.525 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:46.522+0000 7f5f7a452640 1 -- 172.21.15.92:0/1102351173 wait complete. 2024-09-11T00:14:46.525 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:46.524+0000 7f5f7a452640 1 Processor -- start 2024-09-11T00:14:46.526 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:46.524+0000 7f5f7a452640 1 -- start start 2024-09-11T00:14:46.528 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:46.525+0000 7f5f7a452640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f5f74072680 0x7f5f741f4b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:46.528 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:46.525+0000 7f5f7a452640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5f740cf210 0x7f5f7406e2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:46.528 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:46.525+0000 7f5f7a452640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5f74144780 0x7f5f740cc6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:46.528 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:46.525+0000 7f5f7a452640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f5f7415c9f0 con 0x7f5f74144780 2024-09-11T00:14:46.528 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:46.525+0000 7f5f7a452640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f5f7415c870 con 0x7f5f740cf210 2024-09-11T00:14:46.528 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:46.525+0000 7f5f7a452640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f5f7415cb70 con 0x7f5f74072680 2024-09-11T00:14:46.528 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:46.525+0000 7f5f789ef640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5f74144780 0x7f5f740cc6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:46.528 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:46.525+0000 7f5f789ef640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5f74144780 0x7f5f740cc6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:39524/0 (socket says 172.21.15.92:39524) 2024-09-11T00:14:46.528 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:46.525+0000 7f5f789ef640 1 -- 172.21.15.92:0/3630717518 learned_addr learned my addr 172.21.15.92:0/3630717518 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-11T00:14:46.528 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:46.525+0000 7f5f73fff640 1 --2- 172.21.15.92:0/3630717518 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f5f74072680 0x7f5f741f4b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:46.528 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:46.525+0000 7f5f737fe640 1 --2- 172.21.15.92:0/3630717518 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5f740cf210 0x7f5f7406e2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:46.529 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:46.525+0000 7f5f789ef640 1 -- 172.21.15.92:0/3630717518 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f5f74072680 msgr2=0x7f5f741f4b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:46.529 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:46.525+0000 7f5f789ef640 1 --2- 172.21.15.92:0/3630717518 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f5f74072680 0x7f5f741f4b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:46.529 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:46.525+0000 7f5f789ef640 1 -- 172.21.15.92:0/3630717518 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5f740cf210 msgr2=0x7f5f7406e2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:46.529 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:46.525+0000 7f5f789ef640 1 --2- 172.21.15.92:0/3630717518 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5f740cf210 0x7f5f7406e2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:46.529 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:46.525+0000 7f5f789ef640 1 -- 172.21.15.92:0/3630717518 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f7406fbd0 con 0x7f5f74144780 2024-09-11T00:14:46.529 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:46.525+0000 7f5f737fe640 1 --2- 172.21.15.92:0/3630717518 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5f740cf210 0x7f5f7406e2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:14:46.529 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:46.525+0000 7f5f73fff640 1 --2- 172.21.15.92:0/3630717518 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f5f74072680 0x7f5f741f4b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:14:46.529 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:46.525+0000 7f5f789ef640 1 --2- 172.21.15.92:0/3630717518 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5f74144780 0x7f5f740cc6d0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f5f6c009c90 tx=0x7f5f6c00c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:14:46.529 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:46.525+0000 7f5f70ff9640 1 -- 172.21.15.92:0/3630717518 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f6c003b70 con 0x7f5f74144780 2024-09-11T00:14:46.529 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:46.525+0000 7f5f70ff9640 1 -- 172.21.15.92:0/3630717518 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5f6c003d10 con 0x7f5f74144780 2024-09-11T00:14:46.529 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:46.525+0000 7f5f7a452640 1 -- 172.21.15.92:0/3630717518 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5f7406eb30 con 0x7f5f74144780 2024-09-11T00:14:46.529 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:46.525+0000 7f5f70ff9640 1 -- 172.21.15.92:0/3630717518 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f6c004280 con 0x7f5f74144780 2024-09-11T00:14:46.529 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:46.525+0000 7f5f7a452640 1 -- 172.21.15.92:0/3630717518 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5f7406f0f0 con 0x7f5f74144780 2024-09-11T00:14:46.529 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:46.526+0000 7f5f7a452640 1 -- 172.21.15.92:0/3630717518 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5f740b3da0 con 0x7f5f74144780 2024-09-11T00:14:46.530 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:46.527+0000 7f5f70ff9640 1 -- 172.21.15.92:0/3630717518 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f5f6c004420 con 0x7f5f74144780 2024-09-11T00:14:46.530 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:46.527+0000 7f5f70ff9640 1 --2- 172.21.15.92:0/3630717518 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f5f60077f70 0x7f5f6007a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:46.530 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:46.528+0000 7f5f70ff9640 1 -- 172.21.15.92:0/3630717518 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f5f6c09ae00 con 0x7f5f74144780 2024-09-11T00:14:46.530 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:46.528+0000 7f5f73fff640 1 --2- 172.21.15.92:0/3630717518 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f5f60077f70 0x7f5f6007a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:46.531 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:46.528+0000 7f5f73fff640 1 --2- 172.21.15.92:0/3630717518 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f5f60077f70 0x7f5f6007a430 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f5f64034000 tx=0x7f5f64004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:14:46.533 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:46.532+0000 7f5f70ff9640 1 -- 172.21.15.92:0/3630717518 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f5f6c0635c0 con 0x7f5f74144780 2024-09-11T00:14:46.746 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:46.744+0000 7f5f7a452640 1 -- 172.21.15.92:0/3630717518 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f5f74072dd0 con 0x7f5f74144780 2024-09-11T00:14:46.746 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:46.744+0000 7f5f70ff9640 1 -- 172.21.15.92:0/3630717518 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) ==== 53+0+88 (secure 0 0 0) 0x7f5f6c062ec0 con 0x7f5f74144780 2024-09-11T00:14:46.746 INFO:teuthology.orchestra.run.smithi092.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-09-11T00:14:46.749 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:46.747+0000 7f5f7a452640 1 -- 172.21.15.92:0/3630717518 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f5f60077f70 msgr2=0x7f5f6007a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:46.749 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:46.747+0000 7f5f7a452640 1 --2- 172.21.15.92:0/3630717518 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f5f60077f70 0x7f5f6007a430 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f5f64034000 tx=0x7f5f64004730 comp rx=0 tx=0).stop 2024-09-11T00:14:46.750 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:46.747+0000 7f5f7a452640 1 -- 172.21.15.92:0/3630717518 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5f74144780 msgr2=0x7f5f740cc6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:46.750 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:46.747+0000 7f5f7a452640 1 --2- 172.21.15.92:0/3630717518 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5f74144780 0x7f5f740cc6d0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f5f6c009c90 tx=0x7f5f6c00c6a0 comp rx=0 tx=0).stop 2024-09-11T00:14:46.750 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:46.747+0000 7f5f7a452640 1 -- 172.21.15.92:0/3630717518 shutdown_connections 2024-09-11T00:14:46.750 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:46.747+0000 7f5f7a452640 1 --2- 172.21.15.92:0/3630717518 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f5f60077f70 0x7f5f6007a430 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:46.750 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:46.747+0000 7f5f7a452640 1 --2- 172.21.15.92:0/3630717518 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5f74144780 0x7f5f740cc6d0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:46.751 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:46.747+0000 7f5f7a452640 1 --2- 172.21.15.92:0/3630717518 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5f740cf210 0x7f5f7406e2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:46.751 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:46.747+0000 7f5f7a452640 1 --2- 172.21.15.92:0/3630717518 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f5f74072680 0x7f5f741f4b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:46.751 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:46.747+0000 7f5f7a452640 1 -- 172.21.15.92:0/3630717518 >> 172.21.15.92:0/3630717518 conn(0x7f5f740b1760 msgr2=0x7f5f740cdcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:14:46.751 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:46.747+0000 7f5f7a452640 1 -- 172.21.15.92:0/3630717518 shutdown_connections 2024-09-11T00:14:46.751 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:46.747+0000 7f5f7a452640 1 -- 172.21.15.92:0/3630717518 wait complete. 2024-09-11T00:14:46.760 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-11T00:14:46.760 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-11T00:14:46.760 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi092.front.sepia.ceph.com 2024-09-11T00:14:46.760 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-11T00:14:46.760 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-11T00:14:46.761 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-11T00:14:46.761 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-11T00:14:46.761 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-11T00:14:46.761 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-11T00:14:46.761 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T00:14:46.762 DEBUG:teuthology.orchestra.run.smithi092:> ip addr 2024-09-11T00:14:46.778 INFO:teuthology.orchestra.run.smithi092.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-11T00:14:46.778 INFO:teuthology.orchestra.run.smithi092.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-11T00:14:46.778 INFO:teuthology.orchestra.run.smithi092.stdout: inet 127.0.0.1/8 scope host lo 2024-09-11T00:14:46.778 INFO:teuthology.orchestra.run.smithi092.stdout: valid_lft forever preferred_lft forever 2024-09-11T00:14:46.778 INFO:teuthology.orchestra.run.smithi092.stdout: inet6 ::1/128 scope host 2024-09-11T00:14:46.778 INFO:teuthology.orchestra.run.smithi092.stdout: valid_lft forever preferred_lft forever 2024-09-11T00:14:46.778 INFO:teuthology.orchestra.run.smithi092.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-11T00:14:46.778 INFO:teuthology.orchestra.run.smithi092.stdout: link/ether 0c:c4:7a:d8:a1:b2 brd ff:ff:ff:ff:ff:ff 2024-09-11T00:14:46.779 INFO:teuthology.orchestra.run.smithi092.stdout: altname enp7s0f0 2024-09-11T00:14:46.779 INFO:teuthology.orchestra.run.smithi092.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-11T00:14:46.779 INFO:teuthology.orchestra.run.smithi092.stdout: link/ether 0c:c4:7a:d8:a1:b3 brd ff:ff:ff:ff:ff:ff 2024-09-11T00:14:46.779 INFO:teuthology.orchestra.run.smithi092.stdout: altname enp7s0f1 2024-09-11T00:14:46.779 INFO:teuthology.orchestra.run.smithi092.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-11T00:14:46.779 INFO:teuthology.orchestra.run.smithi092.stdout: link/ether 0c:c4:7a:8f:cd:44 brd ff:ff:ff:ff:ff:ff 2024-09-11T00:14:46.779 INFO:teuthology.orchestra.run.smithi092.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-11T00:14:46.779 INFO:teuthology.orchestra.run.smithi092.stdout: link/ether 0c:c4:7a:8f:cd:45 brd ff:ff:ff:ff:ff:ff 2024-09-11T00:14:46.779 INFO:teuthology.orchestra.run.smithi092.stdout: inet 172.21.15.92/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-11T00:14:46.779 INFO:teuthology.orchestra.run.smithi092.stdout: valid_lft 42761sec preferred_lft 42761sec 2024-09-11T00:14:46.779 INFO:teuthology.orchestra.run.smithi092.stdout: inet6 fe80::ec4:7aff:fe8f:cd45/64 scope link noprefixroute 2024-09-11T00:14:46.779 INFO:teuthology.orchestra.run.smithi092.stdout: valid_lft forever preferred_lft forever 2024-09-11T00:14:46.780 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-11T00:14:46.780 DEBUG:teuthology.orchestra.run.smithi092:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-11T00:14:46.780 DEBUG:teuthology.orchestra.run.smithi092:> set -e 2024-09-11T00:14:46.780 DEBUG:teuthology.orchestra.run.smithi092:> sudo ip link add name ceph-brx type bridge 2024-09-11T00:14:46.780 DEBUG:teuthology.orchestra.run.smithi092:> sudo ip addr flush dev ceph-brx 2024-09-11T00:14:46.780 DEBUG:teuthology.orchestra.run.smithi092:> sudo ip link set ceph-brx up 2024-09-11T00:14:46.780 DEBUG:teuthology.orchestra.run.smithi092:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-11T00:14:46.780 DEBUG:teuthology.orchestra.run.smithi092:> ') 2024-09-11T00:14:46.866 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:46 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-11T00:14:46.909 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:46 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T00:14:46.915 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T00:14:46.915 DEBUG:teuthology.orchestra.run.smithi092:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-11T00:14:46.939 INFO:teuthology.orchestra.run.smithi092.stdout:1 2024-09-11T00:14:46.940 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T00:14:46.941 DEBUG:teuthology.orchestra.run.smithi092:> route 2024-09-11T00:14:46.997 INFO:teuthology.orchestra.run.smithi092.stdout:Kernel IP routing table 2024-09-11T00:14:46.997 INFO:teuthology.orchestra.run.smithi092.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-11T00:14:46.997 INFO:teuthology.orchestra.run.smithi092.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-11T00:14:46.997 INFO:teuthology.orchestra.run.smithi092.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-11T00:14:46.997 INFO:teuthology.orchestra.run.smithi092.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-11T00:14:46.998 DEBUG:teuthology.orchestra.run.smithi092:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-11T00:14:46.998 DEBUG:teuthology.orchestra.run.smithi092:> set -e 2024-09-11T00:14:46.998 DEBUG:teuthology.orchestra.run.smithi092:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-11T00:14:46.998 DEBUG:teuthology.orchestra.run.smithi092:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-11T00:14:46.998 DEBUG:teuthology.orchestra.run.smithi092:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-11T00:14:46.998 DEBUG:teuthology.orchestra.run.smithi092:> ') 2024-09-11T00:14:47.085 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:47 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-11T00:14:47.117 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:47 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T00:14:47.123 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T00:14:47.123 DEBUG:teuthology.orchestra.run.smithi092:> ip netns list 2024-09-11T00:14:47.139 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T00:14:47.139 DEBUG:teuthology.orchestra.run.smithi092:> ip netns list-id 2024-09-11T00:14:47.195 DEBUG:teuthology.orchestra.run.smithi092:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-11T00:14:47.195 DEBUG:teuthology.orchestra.run.smithi092:> set -e 2024-09-11T00:14:47.195 DEBUG:teuthology.orchestra.run.smithi092:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-11T00:14:47.195 DEBUG:teuthology.orchestra.run.smithi092:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-09-11T00:14:47.195 DEBUG:teuthology.orchestra.run.smithi092:> ') 2024-09-11T00:14:47.283 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:47 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-11T00:14:47.305 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:47 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T00:14:47.311 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-09-11T00:14:47.312 DEBUG:teuthology.orchestra.run.smithi092:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-11T00:14:47.312 DEBUG:teuthology.orchestra.run.smithi092:> set -e 2024-09-11T00:14:47.312 DEBUG:teuthology.orchestra.run.smithi092:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-09-11T00:14:47.312 DEBUG:teuthology.orchestra.run.smithi092:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-11T00:14:47.312 DEBUG:teuthology.orchestra.run.smithi092:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-09-11T00:14:47.312 DEBUG:teuthology.orchestra.run.smithi092:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-09-11T00:14:47.312 DEBUG:teuthology.orchestra.run.smithi092:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-09-11T00:14:47.312 DEBUG:teuthology.orchestra.run.smithi092:> ') 2024-09-11T00:14:47.360 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:47 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-11T00:14:47.418 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:47 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T00:14:47.423 DEBUG:teuthology.orchestra.run.smithi092:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-11T00:14:47.424 DEBUG:teuthology.orchestra.run.smithi092:> set -e 2024-09-11T00:14:47.424 DEBUG:teuthology.orchestra.run.smithi092:> sudo ip link set brx.0 up 2024-09-11T00:14:47.424 DEBUG:teuthology.orchestra.run.smithi092:> sudo ip link set dev brx.0 master ceph-brx 2024-09-11T00:14:47.424 DEBUG:teuthology.orchestra.run.smithi092:> ') 2024-09-11T00:14:47.472 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:47 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-11T00:14:47.493 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:47 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T00:14:47.499 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-11T00:14:47.499 DEBUG:teuthology.orchestra.run.smithi092:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-11T00:14:47.514 INFO:teuthology.orchestra.run.smithi092.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-11T00:14:47.515 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-11T00:14:47.515 DEBUG:teuthology.orchestra.run.smithi092:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-11T00:14:47.571 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-11T00:14:47.571 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T00:14:47.571 DEBUG:teuthology.orchestra.run.smithi092:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-11T00:14:47.655 INFO:teuthology.orchestra.run.smithi092.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-11T00:14:47.655 INFO:teuthology.orchestra.run.smithi092.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-11T00:14:47.655 INFO:teuthology.orchestra.run.smithi092.stdout:invalid new device string format 2024-09-11T00:14:47.775 INFO:teuthology.orchestra.run.smithi092.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-11T00:14:47.775 INFO:teuthology.orchestra.run.smithi092.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-11T00:14:47.775 INFO:teuthology.orchestra.run.smithi092.stdout:invalid new device string format 2024-09-11T00:14:47.775 INFO:teuthology.orchestra.run.smithi092.stdout:mount.ceph: resolved to: "172.21.15.92:3300,172.21.15.145:3300,172.21.15.145:3301" 2024-09-11T00:14:47.775 INFO:teuthology.orchestra.run.smithi092.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-11T00:14:47.780 INFO:teuthology.orchestra.run.smithi092.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-11T00:14:47.780 INFO:teuthology.orchestra.run.smithi092.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-11T00:14:47.781 INFO:teuthology.orchestra.run.smithi092.stdout:invalid new device string format 2024-09-11T00:14:47.781 INFO:teuthology.orchestra.run.smithi092.stdout:mount.ceph: resolved to: "172.21.15.92:3300,172.21.15.145:3300,172.21.15.145:3301" 2024-09-11T00:14:47.781 INFO:teuthology.orchestra.run.smithi092.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-11T00:14:47.781 INFO:teuthology.orchestra.run.smithi092.stdout:mount.ceph: resolved to: "172.21.15.92:6789,172.21.15.145:6789,172.21.15.145:6790" 2024-09-11T00:14:47.781 INFO:teuthology.orchestra.run.smithi092.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.92:6789,172.21.15.145:6789,172.21.15.145:6790:/ 2024-09-11T00:14:47.781 INFO:teuthology.orchestra.run.smithi092.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=47039cb3-5d2a-46bf-9066-8055b5dfc583" will pass to kernel 2024-09-11T00:14:47.781 INFO:teuthology.orchestra.run.smithi092.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-11T00:14:47.781 INFO:teuthology.orchestra.run.smithi092.stdout: You just mounted a file system that supports labels which does not 2024-09-11T00:14:47.782 INFO:teuthology.orchestra.run.smithi092.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-11T00:14:47.782 INFO:teuthology.orchestra.run.smithi092.stdout: applications will generate AVC messages and not be allowed access to 2024-09-11T00:14:47.782 INFO:teuthology.orchestra.run.smithi092.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-11T00:14:47.783 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-11T00:14:47.783 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T00:14:47.783 DEBUG:teuthology.orchestra.run.smithi092:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-11T00:14:47.849 DEBUG:teuthology.orchestra.run.smithi092:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-11T00:14:47.938 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:47 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-11T00:14:47.939 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:47 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T00:14:47.945 INFO:teuthology.orchestra.run.smithi092.stdout:client4529 2024-09-11T00:14:47.946 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2024-09-11T00:14:47.946 DEBUG:teuthology.orchestra.run.smithi092:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T00:14:47.961 DEBUG:teuthology.orchestra.run.smithi092:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-11T00:14:48.051 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:48 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-11T00:14:48.052 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:48 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T00:14:48.058 INFO:teuthology.orchestra.run.smithi092.stdout:client4529 2024-09-11T00:14:48.058 DEBUG:teuthology.orchestra.run.smithi092:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-11T00:14:48.105 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:48 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-11T00:14:48.107 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:48 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T00:14:48.113 INFO:teuthology.orchestra.run.smithi092.stdout:client4529 2024-09-11T00:14:48.113 DEBUG:teuthology.orchestra.run.smithi092:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/47039cb3-5d2a-46bf-9066-8055b5dfc583.client4529/status') 2024-09-11T00:14:48.161 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:48 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-11T00:14:48.171 INFO:teuthology.orchestra.run.smithi092.stdout:instance: client.4529 (3)172.21.15.92:0/40962915 2024-09-11T00:14:48.171 INFO:teuthology.orchestra.run.smithi092.stdout:blocklisted: false 2024-09-11T00:14:48.172 INFO:teuthology.orchestra.run.smithi092.stderr:0+1 records in 2024-09-11T00:14:48.172 INFO:teuthology.orchestra.run.smithi092.stderr:0+1 records out 2024-09-11T00:14:48.172 INFO:teuthology.orchestra.run.smithi092.stderr:68 bytes copied, 2.5781e-05 s, 2.6 MB/s 2024-09-11T00:14:48.172 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:48 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T00:14:48.179 INFO:tasks.kclient:client.2 config is {'syntax': 'v1'} 2024-09-11T00:14:48.179 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-11T00:14:48.179 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-09-11T00:14:48.179 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-11T00:14:48.280 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:48.278+0000 7fc48e17d640 1 -- 172.21.15.92:0/2927551805 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc470004d40 msgr2=0x7fc4700051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:48.281 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:48.278+0000 7fc48e17d640 1 --2- 172.21.15.92:0/2927551805 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc470004d40 0x7fc4700051c0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fc48000ac90 tx=0x7fc470005830 comp rx=0 tx=0).stop 2024-09-11T00:14:48.281 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:48.278+0000 7fc487fff640 1 -- 172.21.15.92:0/2927551805 reap_dead start 2024-09-11T00:14:48.281 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:48.279+0000 7fc48e17d640 1 -- 172.21.15.92:0/2927551805 shutdown_connections 2024-09-11T00:14:48.281 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:48.279+0000 7fc48e17d640 1 -- 172.21.15.92:0/2927551805 >> 172.21.15.92:0/2927551805 conn(0x7fc4880b1760 msgr2=0x7fc4880b1b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:14:48.281 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:48.279+0000 7fc48e17d640 1 -- 172.21.15.92:0/2927551805 shutdown_connections 2024-09-11T00:14:48.281 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:48.279+0000 7fc48e17d640 1 -- 172.21.15.92:0/2927551805 wait complete. 2024-09-11T00:14:48.282 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:48.280+0000 7fc48e17d640 1 Processor -- start 2024-09-11T00:14:48.282 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:48.280+0000 7fc48e17d640 1 -- start start 2024-09-11T00:14:48.284 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:48.281+0000 7fc48e17d640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc488149860 0x7fc4881f5f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:48.284 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:48.281+0000 7fc48e17d640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc488149c40 0x7fc4881f64d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:48.284 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:48.281+0000 7fc48e17d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc48815cb60 0x7fc48815cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:48.284 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:48.281+0000 7fc48e17d640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fc4880b3f10 con 0x7fc48815cb60 2024-09-11T00:14:48.284 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:48.281+0000 7fc48e17d640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fc4880b3d90 con 0x7fc488149860 2024-09-11T00:14:48.284 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:48.281+0000 7fc48e17d640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7fc4880cf450 con 0x7fc488149c40 2024-09-11T00:14:48.284 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:48.281+0000 7fc487fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc48815cb60 0x7fc48815cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:48.284 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:48.281+0000 7fc487fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc48815cb60 0x7fc48815cfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:39546/0 (socket says 172.21.15.92:39546) 2024-09-11T00:14:48.284 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:48.281+0000 7fc487fff640 1 -- 172.21.15.92:0/748323844 learned_addr learned my addr 172.21.15.92:0/748323844 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-11T00:14:48.284 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:48.281+0000 7fc4877fe640 1 --2- 172.21.15.92:0/748323844 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc488149860 0x7fc4881f5f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:48.285 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:48.281+0000 7fc486ffd640 1 --2- 172.21.15.92:0/748323844 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc488149c40 0x7fc4881f64d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:48.285 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:48.281+0000 7fc487fff640 1 -- 172.21.15.92:0/748323844 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc488149c40 msgr2=0x7fc4881f64d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:48.285 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:48.281+0000 7fc487fff640 1 --2- 172.21.15.92:0/748323844 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc488149c40 0x7fc4881f64d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:48.285 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:48.281+0000 7fc487fff640 1 -- 172.21.15.92:0/748323844 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc488149860 msgr2=0x7fc4881f5f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:48.285 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:48.281+0000 7fc487fff640 1 --2- 172.21.15.92:0/748323844 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc488149860 0x7fc4881f5f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:48.285 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:48.281+0000 7fc487fff640 1 -- 172.21.15.92:0/748323844 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4881f6b50 con 0x7fc48815cb60 2024-09-11T00:14:48.285 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:48.281+0000 7fc4877fe640 1 --2- 172.21.15.92:0/748323844 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc488149860 0x7fc4881f5f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:14:48.285 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:48.281+0000 7fc487fff640 1 --2- 172.21.15.92:0/748323844 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc48815cb60 0x7fc48815cfc0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fc48000adb0 tx=0x7fc480034dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:14:48.285 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:48.281+0000 7fc46ffff640 1 -- 172.21.15.92:0/748323844 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc480039040 con 0x7fc48815cb60 2024-09-11T00:14:48.285 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:48.281+0000 7fc46ffff640 1 -- 172.21.15.92:0/748323844 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc480004030 con 0x7fc48815cb60 2024-09-11T00:14:48.285 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:48.281+0000 7fc48e17d640 1 -- 172.21.15.92:0/748323844 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc48814b0a0 con 0x7fc48815cb60 2024-09-11T00:14:48.285 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:48.282+0000 7fc46ffff640 1 -- 172.21.15.92:0/748323844 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc480004480 con 0x7fc48815cb60 2024-09-11T00:14:48.285 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:48.282+0000 7fc48e17d640 1 -- 172.21.15.92:0/748323844 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc488150700 con 0x7fc48815cb60 2024-09-11T00:14:48.285 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:48.282+0000 7fc48e17d640 1 -- 172.21.15.92:0/748323844 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc48815d500 con 0x7fc48815cb60 2024-09-11T00:14:48.286 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:48.283+0000 7fc46ffff640 1 -- 172.21.15.92:0/748323844 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fc48000b040 con 0x7fc48815cb60 2024-09-11T00:14:48.286 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:48.283+0000 7fc46ffff640 1 --2- 172.21.15.92:0/748323844 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7fc474077f70 0x7fc47407a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:48.286 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:48.284+0000 7fc46ffff640 1 -- 172.21.15.92:0/748323844 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fc4800ba900 con 0x7fc48815cb60 2024-09-11T00:14:48.286 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:48.284+0000 7fc4877fe640 1 --2- 172.21.15.92:0/748323844 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7fc474077f70 0x7fc47407a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:48.287 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:48.284+0000 7fc4877fe640 1 --2- 172.21.15.92:0/748323844 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7fc474077f70 0x7fc47407a430 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fc4780062b0 tx=0x7fc478004c90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:14:48.289 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:48.288+0000 7fc46ffff640 1 -- 172.21.15.92:0/748323844 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fc480083150 con 0x7fc48815cb60 2024-09-11T00:14:48.499 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:48.497+0000 7fc48e17d640 1 -- 172.21.15.92:0/748323844 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fc4880b4a50 con 0x7fc48815cb60 2024-09-11T00:14:48.499 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:48.497+0000 7fc46ffff640 1 -- 172.21.15.92:0/748323844 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) ==== 53+0+88 (secure 0 0 0) 0x7fc480082a50 con 0x7fc48815cb60 2024-09-11T00:14:48.499 INFO:teuthology.orchestra.run.smithi092.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-09-11T00:14:48.501 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:48.499+0000 7fc48e17d640 1 -- 172.21.15.92:0/748323844 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7fc474077f70 msgr2=0x7fc47407a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:48.501 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:48.499+0000 7fc48e17d640 1 --2- 172.21.15.92:0/748323844 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7fc474077f70 0x7fc47407a430 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fc4780062b0 tx=0x7fc478004c90 comp rx=0 tx=0).stop 2024-09-11T00:14:48.501 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:48.499+0000 7fc48e17d640 1 -- 172.21.15.92:0/748323844 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc48815cb60 msgr2=0x7fc48815cfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:48.501 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:48.499+0000 7fc48e17d640 1 --2- 172.21.15.92:0/748323844 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc48815cb60 0x7fc48815cfc0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fc48000adb0 tx=0x7fc480034dd0 comp rx=0 tx=0).stop 2024-09-11T00:14:48.501 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:48.499+0000 7fc48e17d640 1 -- 172.21.15.92:0/748323844 shutdown_connections 2024-09-11T00:14:48.502 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:48.499+0000 7fc48e17d640 1 --2- 172.21.15.92:0/748323844 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7fc474077f70 0x7fc47407a430 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:48.502 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:48.499+0000 7fc48e17d640 1 --2- 172.21.15.92:0/748323844 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc48815cb60 0x7fc48815cfc0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:48.502 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:48.499+0000 7fc48e17d640 1 --2- 172.21.15.92:0/748323844 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc488149c40 0x7fc4881f64d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:48.502 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:48.499+0000 7fc48e17d640 1 --2- 172.21.15.92:0/748323844 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc488149860 0x7fc4881f5f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:48.502 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:48.499+0000 7fc48e17d640 1 -- 172.21.15.92:0/748323844 >> 172.21.15.92:0/748323844 conn(0x7fc4880b1760 msgr2=0x7fc4880b1b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:14:48.502 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:48.499+0000 7fc48e17d640 1 -- 172.21.15.92:0/748323844 shutdown_connections 2024-09-11T00:14:48.502 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:48.499+0000 7fc48e17d640 1 -- 172.21.15.92:0/748323844 wait complete. 2024-09-11T00:14:48.511 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-11T00:14:48.511 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-11T00:14:48.511 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi092.front.sepia.ceph.com 2024-09-11T00:14:48.511 INFO:tasks.cephfs.mount:self.client.name = client.2 2024-09-11T00:14:48.512 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-09-11T00:14:48.512 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-11T00:14:48.512 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-11T00:14:48.512 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-11T00:14:48.512 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2024-09-11T00:14:48.512 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T00:14:48.512 DEBUG:teuthology.orchestra.run.smithi092:> ip addr 2024-09-11T00:14:48.528 INFO:teuthology.orchestra.run.smithi092.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-11T00:14:48.528 INFO:teuthology.orchestra.run.smithi092.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-11T00:14:48.528 INFO:teuthology.orchestra.run.smithi092.stdout: inet 127.0.0.1/8 scope host lo 2024-09-11T00:14:48.528 INFO:teuthology.orchestra.run.smithi092.stdout: valid_lft forever preferred_lft forever 2024-09-11T00:14:48.528 INFO:teuthology.orchestra.run.smithi092.stdout: inet6 ::1/128 scope host 2024-09-11T00:14:48.528 INFO:teuthology.orchestra.run.smithi092.stdout: valid_lft forever preferred_lft forever 2024-09-11T00:14:48.528 INFO:teuthology.orchestra.run.smithi092.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-11T00:14:48.528 INFO:teuthology.orchestra.run.smithi092.stdout: link/ether 0c:c4:7a:d8:a1:b2 brd ff:ff:ff:ff:ff:ff 2024-09-11T00:14:48.529 INFO:teuthology.orchestra.run.smithi092.stdout: altname enp7s0f0 2024-09-11T00:14:48.529 INFO:teuthology.orchestra.run.smithi092.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-11T00:14:48.529 INFO:teuthology.orchestra.run.smithi092.stdout: link/ether 0c:c4:7a:d8:a1:b3 brd ff:ff:ff:ff:ff:ff 2024-09-11T00:14:48.529 INFO:teuthology.orchestra.run.smithi092.stdout: altname enp7s0f1 2024-09-11T00:14:48.529 INFO:teuthology.orchestra.run.smithi092.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-11T00:14:48.529 INFO:teuthology.orchestra.run.smithi092.stdout: link/ether 0c:c4:7a:8f:cd:44 brd ff:ff:ff:ff:ff:ff 2024-09-11T00:14:48.529 INFO:teuthology.orchestra.run.smithi092.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-11T00:14:48.529 INFO:teuthology.orchestra.run.smithi092.stdout: link/ether 0c:c4:7a:8f:cd:45 brd ff:ff:ff:ff:ff:ff 2024-09-11T00:14:48.529 INFO:teuthology.orchestra.run.smithi092.stdout: inet 172.21.15.92/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-11T00:14:48.529 INFO:teuthology.orchestra.run.smithi092.stdout: valid_lft 42760sec preferred_lft 42760sec 2024-09-11T00:14:48.529 INFO:teuthology.orchestra.run.smithi092.stdout: inet6 fe80::ec4:7aff:fe8f:cd45/64 scope link noprefixroute 2024-09-11T00:14:48.529 INFO:teuthology.orchestra.run.smithi092.stdout: valid_lft forever preferred_lft forever 2024-09-11T00:14:48.530 INFO:teuthology.orchestra.run.smithi092.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-11T00:14:48.530 INFO:teuthology.orchestra.run.smithi092.stdout: link/ether a2:91:29:a1:39:9a brd ff:ff:ff:ff:ff:ff 2024-09-11T00:14:48.530 INFO:teuthology.orchestra.run.smithi092.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-11T00:14:48.530 INFO:teuthology.orchestra.run.smithi092.stdout: valid_lft forever preferred_lft forever 2024-09-11T00:14:48.530 INFO:teuthology.orchestra.run.smithi092.stdout: inet6 fe80::60ba:93ff:fe0a:84b6/64 scope link tentative 2024-09-11T00:14:48.530 INFO:teuthology.orchestra.run.smithi092.stdout: valid_lft forever preferred_lft forever 2024-09-11T00:14:48.530 INFO:teuthology.orchestra.run.smithi092.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-11T00:14:48.530 INFO:teuthology.orchestra.run.smithi092.stdout: link/ether a2:91:29:a1:39:9a brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-11T00:14:48.530 INFO:teuthology.orchestra.run.smithi092.stdout: inet6 fe80::a091:29ff:fea1:399a/64 scope link tentative 2024-09-11T00:14:48.530 INFO:teuthology.orchestra.run.smithi092.stdout: valid_lft forever preferred_lft forever 2024-09-11T00:14:48.531 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T00:14:48.531 DEBUG:teuthology.orchestra.run.smithi092:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-11T00:14:48.591 INFO:teuthology.orchestra.run.smithi092.stdout:1 2024-09-11T00:14:48.593 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T00:14:48.593 DEBUG:teuthology.orchestra.run.smithi092:> route 2024-09-11T00:14:48.650 INFO:teuthology.orchestra.run.smithi092.stdout:Kernel IP routing table 2024-09-11T00:14:48.650 INFO:teuthology.orchestra.run.smithi092.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-11T00:14:48.650 INFO:teuthology.orchestra.run.smithi092.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-11T00:14:48.650 INFO:teuthology.orchestra.run.smithi092.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-11T00:14:48.650 INFO:teuthology.orchestra.run.smithi092.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-11T00:14:48.650 DEBUG:teuthology.orchestra.run.smithi092:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-11T00:14:48.651 DEBUG:teuthology.orchestra.run.smithi092:> set -e 2024-09-11T00:14:48.651 DEBUG:teuthology.orchestra.run.smithi092:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-11T00:14:48.651 DEBUG:teuthology.orchestra.run.smithi092:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-11T00:14:48.651 DEBUG:teuthology.orchestra.run.smithi092:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-11T00:14:48.651 DEBUG:teuthology.orchestra.run.smithi092:> ') 2024-09-11T00:14:48.738 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:48 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-11T00:14:48.771 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:48 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T00:14:48.777 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T00:14:48.777 DEBUG:teuthology.orchestra.run.smithi092:> ip netns list 2024-09-11T00:14:48.794 INFO:teuthology.orchestra.run.smithi092.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-11T00:14:48.795 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T00:14:48.795 DEBUG:teuthology.orchestra.run.smithi092:> ip netns list-id 2024-09-11T00:14:48.849 INFO:teuthology.orchestra.run.smithi092.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2024-09-11T00:14:48.850 DEBUG:teuthology.orchestra.run.smithi092:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-11T00:14:48.850 DEBUG:teuthology.orchestra.run.smithi092:> set -e 2024-09-11T00:14:48.850 DEBUG:teuthology.orchestra.run.smithi092:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-11T00:14:48.850 DEBUG:teuthology.orchestra.run.smithi092:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2024-09-11T00:14:48.850 DEBUG:teuthology.orchestra.run.smithi092:> ') 2024-09-11T00:14:48.940 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:48 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-11T00:14:48.960 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:48 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T00:14:48.966 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T00:14:48.966 DEBUG:teuthology.orchestra.run.smithi092:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-09-11T00:14:48.990 INFO:teuthology.orchestra.run.smithi092.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-11T00:14:48.991 INFO:teuthology.orchestra.run.smithi092.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-11T00:14:48.991 INFO:teuthology.orchestra.run.smithi092.stdout: inet 127.0.0.1/8 scope host lo 2024-09-11T00:14:48.991 INFO:teuthology.orchestra.run.smithi092.stdout: valid_lft forever preferred_lft forever 2024-09-11T00:14:48.991 INFO:teuthology.orchestra.run.smithi092.stdout: inet6 ::1/128 scope host 2024-09-11T00:14:48.991 INFO:teuthology.orchestra.run.smithi092.stdout: valid_lft forever preferred_lft forever 2024-09-11T00:14:48.991 INFO:teuthology.orchestra.run.smithi092.stdout:2: veth0@if9: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-11T00:14:48.991 INFO:teuthology.orchestra.run.smithi092.stdout: link/ether de:2a:33:c7:a0:39 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-09-11T00:14:48.991 INFO:teuthology.orchestra.run.smithi092.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-09-11T00:14:48.991 INFO:teuthology.orchestra.run.smithi092.stdout: valid_lft forever preferred_lft forever 2024-09-11T00:14:48.991 INFO:teuthology.orchestra.run.smithi092.stdout: inet6 fe80::dc2a:33ff:fec7:a039/64 scope link tentative 2024-09-11T00:14:48.991 INFO:teuthology.orchestra.run.smithi092.stdout: valid_lft forever preferred_lft forever 2024-09-11T00:14:48.993 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T00:14:48.993 DEBUG:teuthology.orchestra.run.smithi092:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-09-11T00:14:49.057 INFO:teuthology.orchestra.run.smithi092.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-11T00:14:49.057 INFO:teuthology.orchestra.run.smithi092.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-11T00:14:49.058 INFO:teuthology.orchestra.run.smithi092.stdout: inet 127.0.0.1/8 scope host lo 2024-09-11T00:14:49.058 INFO:teuthology.orchestra.run.smithi092.stdout: valid_lft forever preferred_lft forever 2024-09-11T00:14:49.058 INFO:teuthology.orchestra.run.smithi092.stdout: inet6 ::1/128 scope host 2024-09-11T00:14:49.058 INFO:teuthology.orchestra.run.smithi092.stdout: valid_lft forever preferred_lft forever 2024-09-11T00:14:49.058 INFO:teuthology.orchestra.run.smithi092.stdout:2: veth0@if9: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-11T00:14:49.058 INFO:teuthology.orchestra.run.smithi092.stdout: link/ether de:2a:33:c7:a0:39 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-09-11T00:14:49.058 INFO:teuthology.orchestra.run.smithi092.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-09-11T00:14:49.058 INFO:teuthology.orchestra.run.smithi092.stdout: valid_lft forever preferred_lft forever 2024-09-11T00:14:49.058 INFO:teuthology.orchestra.run.smithi092.stdout: inet6 fe80::dc2a:33ff:fec7:a039/64 scope link tentative 2024-09-11T00:14:49.059 INFO:teuthology.orchestra.run.smithi092.stdout: valid_lft forever preferred_lft forever 2024-09-11T00:14:49.060 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2024-09-11T00:14:49.060 DEBUG:teuthology.orchestra.run.smithi092:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-11T00:14:49.060 DEBUG:teuthology.orchestra.run.smithi092:> set -e 2024-09-11T00:14:49.060 DEBUG:teuthology.orchestra.run.smithi092:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2024-09-11T00:14:49.060 DEBUG:teuthology.orchestra.run.smithi092:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-09-11T00:14:49.060 DEBUG:teuthology.orchestra.run.smithi092:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2024-09-11T00:14:49.060 DEBUG:teuthology.orchestra.run.smithi092:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2024-09-11T00:14:49.060 DEBUG:teuthology.orchestra.run.smithi092:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2024-09-11T00:14:49.061 DEBUG:teuthology.orchestra.run.smithi092:> ') 2024-09-11T00:14:49.148 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:49 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-11T00:14:49.206 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:49 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T00:14:49.212 DEBUG:teuthology.orchestra.run.smithi092:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-11T00:14:49.212 DEBUG:teuthology.orchestra.run.smithi092:> set -e 2024-09-11T00:14:49.212 DEBUG:teuthology.orchestra.run.smithi092:> sudo ip link set brx.1 up 2024-09-11T00:14:49.212 DEBUG:teuthology.orchestra.run.smithi092:> sudo ip link set dev brx.1 master ceph-brx 2024-09-11T00:14:49.212 DEBUG:teuthology.orchestra.run.smithi092:> ') 2024-09-11T00:14:49.259 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:49 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-11T00:14:49.281 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:49 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T00:14:49.288 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-11T00:14:49.288 DEBUG:teuthology.orchestra.run.smithi092:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2024-09-11T00:14:49.302 INFO:teuthology.orchestra.run.smithi092.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2024-09-11T00:14:49.303 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-11T00:14:49.303 DEBUG:teuthology.orchestra.run.smithi092:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2024-09-11T00:14:49.357 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-11T00:14:49.357 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T00:14:49.357 DEBUG:teuthology.orchestra.run.smithi092:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.2 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2024-09-11T00:14:49.440 INFO:teuthology.orchestra.run.smithi092.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2024-09-11T00:14:49.441 INFO:teuthology.orchestra.run.smithi092.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2024-09-11T00:14:49.441 INFO:teuthology.orchestra.run.smithi092.stdout:invalid new device string format 2024-09-11T00:14:49.449 INFO:teuthology.orchestra.run.smithi092.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2024-09-11T00:14:49.449 INFO:teuthology.orchestra.run.smithi092.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2024-09-11T00:14:49.449 INFO:teuthology.orchestra.run.smithi092.stdout:invalid new device string format 2024-09-11T00:14:49.449 INFO:teuthology.orchestra.run.smithi092.stdout:mount.ceph: resolved to: "172.21.15.92:3300,172.21.15.145:3300,172.21.15.145:3301" 2024-09-11T00:14:49.450 INFO:teuthology.orchestra.run.smithi092.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-11T00:14:49.455 INFO:teuthology.orchestra.run.smithi092.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2024-09-11T00:14:49.455 INFO:teuthology.orchestra.run.smithi092.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2024-09-11T00:14:49.455 INFO:teuthology.orchestra.run.smithi092.stdout:invalid new device string format 2024-09-11T00:14:49.455 INFO:teuthology.orchestra.run.smithi092.stdout:mount.ceph: resolved to: "172.21.15.92:3300,172.21.15.145:3300,172.21.15.145:3301" 2024-09-11T00:14:49.455 INFO:teuthology.orchestra.run.smithi092.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-11T00:14:49.455 INFO:teuthology.orchestra.run.smithi092.stdout:mount.ceph: resolved to: "172.21.15.92:6789,172.21.15.145:6789,172.21.15.145:6790" 2024-09-11T00:14:49.455 INFO:teuthology.orchestra.run.smithi092.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.92:6789,172.21.15.145:6789,172.21.15.145:6790:/ 2024-09-11T00:14:49.456 INFO:teuthology.orchestra.run.smithi092.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs,key=2,fsid=47039cb3-5d2a-46bf-9066-8055b5dfc583" will pass to kernel 2024-09-11T00:14:49.456 INFO:teuthology.orchestra.run.smithi092.stdout:mount: /home/ubuntu/cephtest/mnt.2 does not contain SELinux labels. 2024-09-11T00:14:49.456 INFO:teuthology.orchestra.run.smithi092.stdout: You just mounted a file system that supports labels which does not 2024-09-11T00:14:49.456 INFO:teuthology.orchestra.run.smithi092.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-11T00:14:49.456 INFO:teuthology.orchestra.run.smithi092.stdout: applications will generate AVC messages and not be allowed access to 2024-09-11T00:14:49.456 INFO:teuthology.orchestra.run.smithi092.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-11T00:14:49.457 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-11T00:14:49.457 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T00:14:49.457 DEBUG:teuthology.orchestra.run.smithi092:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2024-09-11T00:14:49.522 DEBUG:teuthology.orchestra.run.smithi092:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-11T00:14:49.611 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:49 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-11T00:14:49.613 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:49 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T00:14:49.619 INFO:teuthology.orchestra.run.smithi092.stdout:client4800 2024-09-11T00:14:49.619 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2024-09-11T00:14:49.619 DEBUG:teuthology.orchestra.run.smithi092:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T00:14:49.636 DEBUG:teuthology.orchestra.run.smithi092:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-11T00:14:49.723 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:49 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-11T00:14:49.725 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:49 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T00:14:49.731 INFO:teuthology.orchestra.run.smithi092.stdout:client4800 2024-09-11T00:14:49.731 DEBUG:teuthology.orchestra.run.smithi092:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-11T00:14:49.779 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:49 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-11T00:14:49.781 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:49 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T00:14:49.786 INFO:teuthology.orchestra.run.smithi092.stdout:client4800 2024-09-11T00:14:49.787 DEBUG:teuthology.orchestra.run.smithi092:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/47039cb3-5d2a-46bf-9066-8055b5dfc583.client4800/status') 2024-09-11T00:14:49.834 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:49 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-11T00:14:49.844 INFO:teuthology.orchestra.run.smithi092.stdout:instance: client.4800 (3)192.168.0.2:0/129399563 2024-09-11T00:14:49.844 INFO:teuthology.orchestra.run.smithi092.stdout:blocklisted: false 2024-09-11T00:14:49.845 INFO:teuthology.orchestra.run.smithi092.stderr:0+1 records in 2024-09-11T00:14:49.845 INFO:teuthology.orchestra.run.smithi092.stderr:0+1 records out 2024-09-11T00:14:49.845 INFO:teuthology.orchestra.run.smithi092.stderr:68 bytes copied, 2.1689e-05 s, 3.1 MB/s 2024-09-11T00:14:49.845 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:49 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T00:14:49.852 INFO:tasks.kclient:client.1 config is {'syntax': 'v1'} 2024-09-11T00:14:49.852 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-11T00:14:49.852 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-11T00:14:49.853 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-11T00:14:49.955 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:49.953+0000 7f0949d75640 1 -- 172.21.15.92:0/2571770344 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0944072680 msgr2=0x7f0944072aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:49.982 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:49.953+0000 7f0949d75640 1 --2- 172.21.15.92:0/2571770344 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0944072680 0x7f0944072aa0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f0938005fd0 tx=0x7f093802a540 comp rx=0 tx=0).stop 2024-09-11T00:14:49.982 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:49.953+0000 7f0949d75640 1 -- 172.21.15.92:0/2571770344 shutdown_connections 2024-09-11T00:14:49.982 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:49.953+0000 7f0949d75640 1 --2- 172.21.15.92:0/2571770344 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0944072680 0x7f0944072aa0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:49.982 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:49.953+0000 7f0949d75640 1 --2- 172.21.15.92:0/2571770344 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f0944144780 0x7f09440b3da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:49.982 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:49.953+0000 7f0949d75640 1 -- 172.21.15.92:0/2571770344 >> 172.21.15.92:0/2571770344 conn(0x7f09440b1760 msgr2=0x7f09440b1b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:14:49.982 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:49.953+0000 7f0949d75640 1 -- 172.21.15.92:0/2571770344 shutdown_connections 2024-09-11T00:14:49.982 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:49.953+0000 7f0949d75640 1 -- 172.21.15.92:0/2571770344 wait complete. 2024-09-11T00:14:49.985 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:49.955+0000 7f0949d75640 1 Processor -- start 2024-09-11T00:14:49.985 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:49.955+0000 7f0949d75640 1 -- start start 2024-09-11T00:14:49.985 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:49.956+0000 7f0949d75640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f0944072680 0x7f0944151b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:49.985 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:49.956+0000 7f0949d75640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f09440ceb00 0x7f094414eac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:49.986 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:49.956+0000 7f0949d75640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0944144780 0x7f0944140110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:49.986 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:49.956+0000 7f0949d75640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f094415d070 con 0x7f0944144780 2024-09-11T00:14:49.986 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:49.956+0000 7f0949d75640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f094415cef0 con 0x7f09440ceb00 2024-09-11T00:14:49.986 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:49.956+0000 7f0949d75640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f09440cef90 con 0x7f0944072680 2024-09-11T00:14:49.986 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:49.956+0000 7f0943fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0944144780 0x7f0944140110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:49.986 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:49.956+0000 7f0943fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0944144780 0x7f0944140110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:39556/0 (socket says 172.21.15.92:39556) 2024-09-11T00:14:49.986 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:49.956+0000 7f0943fff640 1 -- 172.21.15.92:0/3889687588 learned_addr learned my addr 172.21.15.92:0/3889687588 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-11T00:14:49.987 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:49.956+0000 7f0942ffd640 1 --2- 172.21.15.92:0/3889687588 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f09440ceb00 0x7f094414eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:49.987 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:49.956+0000 7f09437fe640 1 --2- 172.21.15.92:0/3889687588 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f0944072680 0x7f0944151b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:49.987 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:49.956+0000 7f0943fff640 1 -- 172.21.15.92:0/3889687588 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f0944072680 msgr2=0x7f0944151b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:49.987 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:49.956+0000 7f0943fff640 1 --2- 172.21.15.92:0/3889687588 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f0944072680 0x7f0944151b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:49.987 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:49.956+0000 7f0943fff640 1 -- 172.21.15.92:0/3889687588 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f09440ceb00 msgr2=0x7f094414eac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:49.987 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:49.956+0000 7f0943fff640 1 --2- 172.21.15.92:0/3889687588 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f09440ceb00 0x7f094414eac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:49.987 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:49.956+0000 7f0943fff640 1 -- 172.21.15.92:0/3889687588 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09440aece0 con 0x7f0944144780 2024-09-11T00:14:49.987 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:49.956+0000 7f0943fff640 1 --2- 172.21.15.92:0/3889687588 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0944144780 0x7f0944140110 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f093c00c7a0 tx=0x7f093c00cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:14:49.987 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:49.956+0000 7f092bfff640 1 -- 172.21.15.92:0/3889687588 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f093c003b70 con 0x7f0944144780 2024-09-11T00:14:49.987 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:49.956+0000 7f092bfff640 1 -- 172.21.15.92:0/3889687588 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f093c003d10 con 0x7f0944144780 2024-09-11T00:14:49.987 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:49.956+0000 7f0949d75640 1 -- 172.21.15.92:0/3889687588 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f094414f000 con 0x7f0944144780 2024-09-11T00:14:49.987 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:49.956+0000 7f092bfff640 1 -- 172.21.15.92:0/3889687588 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f093c00aab0 con 0x7f0944144780 2024-09-11T00:14:49.987 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:49.956+0000 7f0949d75640 1 -- 172.21.15.92:0/3889687588 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f09440af230 con 0x7f0944144780 2024-09-11T00:14:49.988 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:49.957+0000 7f0949d75640 1 -- 172.21.15.92:0/3889687588 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f09440af470 con 0x7f0944144780 2024-09-11T00:14:49.988 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:49.958+0000 7f092bfff640 1 -- 172.21.15.92:0/3889687588 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f093c00ac50 con 0x7f0944144780 2024-09-11T00:14:49.988 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:49.958+0000 7f092bfff640 1 --2- 172.21.15.92:0/3889687588 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f0930077f70 0x7f093007a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:49.988 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:49.958+0000 7f092bfff640 1 -- 172.21.15.92:0/3889687588 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f093c099e10 con 0x7f0944144780 2024-09-11T00:14:49.988 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:49.959+0000 7f09437fe640 1 --2- 172.21.15.92:0/3889687588 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f0930077f70 0x7f093007a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:49.988 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:49.959+0000 7f09437fe640 1 --2- 172.21.15.92:0/3889687588 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f0930077f70 0x7f093007a430 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f094413e310 tx=0x7f093400b2e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:14:49.988 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:49.962+0000 7f092bfff640 1 -- 172.21.15.92:0/3889687588 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f093c061f80 con 0x7f0944144780 2024-09-11T00:14:50.173 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:50.171+0000 7f0949d75640 1 -- 172.21.15.92:0/3889687588 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f0944143f80 con 0x7f0944144780 2024-09-11T00:14:50.173 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:50.171+0000 7f092bfff640 1 -- 172.21.15.92:0/3889687588 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) ==== 53+0+88 (secure 0 0 0) 0x7f093c0669b0 con 0x7f0944144780 2024-09-11T00:14:50.173 INFO:teuthology.orchestra.run.smithi092.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-09-11T00:14:50.175 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:50.173+0000 7f0949d75640 1 -- 172.21.15.92:0/3889687588 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f0930077f70 msgr2=0x7f093007a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:50.175 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:50.173+0000 7f0949d75640 1 --2- 172.21.15.92:0/3889687588 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f0930077f70 0x7f093007a430 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f094413e310 tx=0x7f093400b2e0 comp rx=0 tx=0).stop 2024-09-11T00:14:50.176 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:50.173+0000 7f0949d75640 1 -- 172.21.15.92:0/3889687588 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0944144780 msgr2=0x7f0944140110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:50.176 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:50.173+0000 7f0949d75640 1 --2- 172.21.15.92:0/3889687588 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0944144780 0x7f0944140110 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f093c00c7a0 tx=0x7f093c00cc60 comp rx=0 tx=0).stop 2024-09-11T00:14:50.176 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:50.173+0000 7f0949d75640 1 -- 172.21.15.92:0/3889687588 shutdown_connections 2024-09-11T00:14:50.176 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:50.173+0000 7f0949d75640 1 --2- 172.21.15.92:0/3889687588 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f0930077f70 0x7f093007a430 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:50.176 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:50.173+0000 7f0949d75640 1 --2- 172.21.15.92:0/3889687588 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0944144780 0x7f0944140110 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:50.176 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:50.173+0000 7f0949d75640 1 --2- 172.21.15.92:0/3889687588 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f09440ceb00 0x7f094414eac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:50.176 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:50.173+0000 7f0949d75640 1 --2- 172.21.15.92:0/3889687588 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f0944072680 0x7f0944151b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:50.176 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:50.173+0000 7f0949d75640 1 -- 172.21.15.92:0/3889687588 >> 172.21.15.92:0/3889687588 conn(0x7f09440b1760 msgr2=0x7f094415e270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:14:50.176 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:50.174+0000 7f0949d75640 1 -- 172.21.15.92:0/3889687588 shutdown_connections 2024-09-11T00:14:50.176 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:50.174+0000 7f0949d75640 1 -- 172.21.15.92:0/3889687588 wait complete. 2024-09-11T00:14:50.186 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-11T00:14:50.186 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-11T00:14:50.186 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi145.front.sepia.ceph.com 2024-09-11T00:14:50.186 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-11T00:14:50.186 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-11T00:14:50.187 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-11T00:14:50.187 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-11T00:14:50.187 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-11T00:14:50.187 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-11T00:14:50.187 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T00:14:50.187 DEBUG:teuthology.orchestra.run.smithi145:> ip addr 2024-09-11T00:14:50.207 INFO:teuthology.orchestra.run.smithi145.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-11T00:14:50.207 INFO:teuthology.orchestra.run.smithi145.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-11T00:14:50.207 INFO:teuthology.orchestra.run.smithi145.stdout: inet 127.0.0.1/8 scope host lo 2024-09-11T00:14:50.207 INFO:teuthology.orchestra.run.smithi145.stdout: valid_lft forever preferred_lft forever 2024-09-11T00:14:50.207 INFO:teuthology.orchestra.run.smithi145.stdout: inet6 ::1/128 scope host 2024-09-11T00:14:50.207 INFO:teuthology.orchestra.run.smithi145.stdout: valid_lft forever preferred_lft forever 2024-09-11T00:14:50.207 INFO:teuthology.orchestra.run.smithi145.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-11T00:14:50.207 INFO:teuthology.orchestra.run.smithi145.stdout: link/ether 0c:c4:7a:d9:38:66 brd ff:ff:ff:ff:ff:ff 2024-09-11T00:14:50.207 INFO:teuthology.orchestra.run.smithi145.stdout: altname enp7s0f0 2024-09-11T00:14:50.208 INFO:teuthology.orchestra.run.smithi145.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-11T00:14:50.208 INFO:teuthology.orchestra.run.smithi145.stdout: link/ether 0c:c4:7a:d9:38:67 brd ff:ff:ff:ff:ff:ff 2024-09-11T00:14:50.208 INFO:teuthology.orchestra.run.smithi145.stdout: altname enp7s0f1 2024-09-11T00:14:50.208 INFO:teuthology.orchestra.run.smithi145.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-11T00:14:50.208 INFO:teuthology.orchestra.run.smithi145.stdout: link/ether 0c:c4:7a:88:77:90 brd ff:ff:ff:ff:ff:ff 2024-09-11T00:14:50.208 INFO:teuthology.orchestra.run.smithi145.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-11T00:14:50.208 INFO:teuthology.orchestra.run.smithi145.stdout: link/ether 0c:c4:7a:88:77:91 brd ff:ff:ff:ff:ff:ff 2024-09-11T00:14:50.208 INFO:teuthology.orchestra.run.smithi145.stdout: inet 172.21.15.145/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-11T00:14:50.208 INFO:teuthology.orchestra.run.smithi145.stdout: valid_lft 42756sec preferred_lft 42756sec 2024-09-11T00:14:50.208 INFO:teuthology.orchestra.run.smithi145.stdout: inet6 fe80::ec4:7aff:fe88:7791/64 scope link noprefixroute 2024-09-11T00:14:50.208 INFO:teuthology.orchestra.run.smithi145.stdout: valid_lft forever preferred_lft forever 2024-09-11T00:14:50.209 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-11T00:14:50.209 DEBUG:teuthology.orchestra.run.smithi145:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-11T00:14:50.209 DEBUG:teuthology.orchestra.run.smithi145:> set -e 2024-09-11T00:14:50.209 DEBUG:teuthology.orchestra.run.smithi145:> sudo ip link add name ceph-brx type bridge 2024-09-11T00:14:50.209 DEBUG:teuthology.orchestra.run.smithi145:> sudo ip addr flush dev ceph-brx 2024-09-11T00:14:50.209 DEBUG:teuthology.orchestra.run.smithi145:> sudo ip link set ceph-brx up 2024-09-11T00:14:50.209 DEBUG:teuthology.orchestra.run.smithi145:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-11T00:14:50.209 DEBUG:teuthology.orchestra.run.smithi145:> ') 2024-09-11T00:14:50.302 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:14:50 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-11T00:14:50.473 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:14:50 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T00:14:50.480 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T00:14:50.480 DEBUG:teuthology.orchestra.run.smithi145:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-11T00:14:50.504 INFO:teuthology.orchestra.run.smithi145.stdout:1 2024-09-11T00:14:50.506 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T00:14:50.506 DEBUG:teuthology.orchestra.run.smithi145:> route 2024-09-11T00:14:50.582 INFO:teuthology.orchestra.run.smithi145.stdout:Kernel IP routing table 2024-09-11T00:14:50.582 INFO:teuthology.orchestra.run.smithi145.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-11T00:14:50.582 INFO:teuthology.orchestra.run.smithi145.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-11T00:14:50.582 INFO:teuthology.orchestra.run.smithi145.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-11T00:14:50.582 INFO:teuthology.orchestra.run.smithi145.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-11T00:14:50.582 DEBUG:teuthology.orchestra.run.smithi145:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-11T00:14:50.582 DEBUG:teuthology.orchestra.run.smithi145:> set -e 2024-09-11T00:14:50.583 DEBUG:teuthology.orchestra.run.smithi145:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-11T00:14:50.583 DEBUG:teuthology.orchestra.run.smithi145:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-11T00:14:50.583 DEBUG:teuthology.orchestra.run.smithi145:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-11T00:14:50.583 DEBUG:teuthology.orchestra.run.smithi145:> ') 2024-09-11T00:14:50.670 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:14:50 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-11T00:14:50.865 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:14:50 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T00:14:50.870 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T00:14:50.870 DEBUG:teuthology.orchestra.run.smithi145:> ip netns list 2024-09-11T00:14:50.886 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T00:14:50.886 DEBUG:teuthology.orchestra.run.smithi145:> ip netns list-id 2024-09-11T00:14:50.941 DEBUG:teuthology.orchestra.run.smithi145:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-11T00:14:50.942 DEBUG:teuthology.orchestra.run.smithi145:> set -e 2024-09-11T00:14:50.942 DEBUG:teuthology.orchestra.run.smithi145:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-11T00:14:50.942 DEBUG:teuthology.orchestra.run.smithi145:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-09-11T00:14:50.942 DEBUG:teuthology.orchestra.run.smithi145:> ') 2024-09-11T00:14:51.030 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:14:51 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-11T00:14:51.053 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:14:51 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T00:14:51.060 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-09-11T00:14:51.060 DEBUG:teuthology.orchestra.run.smithi145:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-11T00:14:51.060 DEBUG:teuthology.orchestra.run.smithi145:> set -e 2024-09-11T00:14:51.060 DEBUG:teuthology.orchestra.run.smithi145:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-09-11T00:14:51.060 DEBUG:teuthology.orchestra.run.smithi145:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-11T00:14:51.060 DEBUG:teuthology.orchestra.run.smithi145:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-09-11T00:14:51.060 DEBUG:teuthology.orchestra.run.smithi145:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-09-11T00:14:51.060 DEBUG:teuthology.orchestra.run.smithi145:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-09-11T00:14:51.060 DEBUG:teuthology.orchestra.run.smithi145:> ') 2024-09-11T00:14:51.108 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:14:51 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-11T00:14:51.178 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:14:51 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T00:14:51.184 DEBUG:teuthology.orchestra.run.smithi145:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-11T00:14:51.184 DEBUG:teuthology.orchestra.run.smithi145:> set -e 2024-09-11T00:14:51.184 DEBUG:teuthology.orchestra.run.smithi145:> sudo ip link set brx.0 up 2024-09-11T00:14:51.185 DEBUG:teuthology.orchestra.run.smithi145:> sudo ip link set dev brx.0 master ceph-brx 2024-09-11T00:14:51.185 DEBUG:teuthology.orchestra.run.smithi145:> ') 2024-09-11T00:14:51.233 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:14:51 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-11T00:14:51.261 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:14:51 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T00:14:51.267 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-11T00:14:51.267 DEBUG:teuthology.orchestra.run.smithi145:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-11T00:14:51.282 INFO:teuthology.orchestra.run.smithi145.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-11T00:14:51.283 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-11T00:14:51.283 DEBUG:teuthology.orchestra.run.smithi145:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-11T00:14:51.337 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-11T00:14:51.337 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T00:14:51.337 DEBUG:teuthology.orchestra.run.smithi145:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-11T00:14:51.430 INFO:teuthology.orchestra.run.smithi145.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-11T00:14:51.431 INFO:teuthology.orchestra.run.smithi145.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-11T00:14:51.431 INFO:teuthology.orchestra.run.smithi145.stdout:invalid new device string format 2024-09-11T00:14:51.554 INFO:teuthology.orchestra.run.smithi145.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-11T00:14:51.554 INFO:teuthology.orchestra.run.smithi145.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-11T00:14:51.555 INFO:teuthology.orchestra.run.smithi145.stdout:invalid new device string format 2024-09-11T00:14:51.555 INFO:teuthology.orchestra.run.smithi145.stdout:mount.ceph: resolved to: "172.21.15.92:3300,172.21.15.145:3300,172.21.15.145:3301" 2024-09-11T00:14:51.555 INFO:teuthology.orchestra.run.smithi145.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-11T00:14:51.559 INFO:teuthology.orchestra.run.smithi145.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-11T00:14:51.559 INFO:teuthology.orchestra.run.smithi145.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-11T00:14:51.559 INFO:teuthology.orchestra.run.smithi145.stdout:invalid new device string format 2024-09-11T00:14:51.560 INFO:teuthology.orchestra.run.smithi145.stdout:mount.ceph: resolved to: "172.21.15.92:3300,172.21.15.145:3300,172.21.15.145:3301" 2024-09-11T00:14:51.560 INFO:teuthology.orchestra.run.smithi145.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-11T00:14:51.560 INFO:teuthology.orchestra.run.smithi145.stdout:mount.ceph: resolved to: "172.21.15.92:6789,172.21.15.145:6789,172.21.15.145:6790" 2024-09-11T00:14:51.560 INFO:teuthology.orchestra.run.smithi145.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.92:6789,172.21.15.145:6789,172.21.15.145:6790:/ 2024-09-11T00:14:51.560 INFO:teuthology.orchestra.run.smithi145.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=47039cb3-5d2a-46bf-9066-8055b5dfc583" will pass to kernel 2024-09-11T00:14:51.561 INFO:teuthology.orchestra.run.smithi145.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-09-11T00:14:51.561 INFO:teuthology.orchestra.run.smithi145.stdout: You just mounted a file system that supports labels which does not 2024-09-11T00:14:51.561 INFO:teuthology.orchestra.run.smithi145.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-11T00:14:51.561 INFO:teuthology.orchestra.run.smithi145.stdout: applications will generate AVC messages and not be allowed access to 2024-09-11T00:14:51.561 INFO:teuthology.orchestra.run.smithi145.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-11T00:14:51.562 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-11T00:14:51.562 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T00:14:51.562 DEBUG:teuthology.orchestra.run.smithi145:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-11T00:14:51.587 DEBUG:teuthology.orchestra.run.smithi145:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-11T00:14:51.676 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:14:51 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-11T00:14:51.678 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:14:51 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T00:14:51.683 INFO:teuthology.orchestra.run.smithi145.stdout:client4809 2024-09-11T00:14:51.684 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2024-09-11T00:14:51.684 DEBUG:teuthology.orchestra.run.smithi145:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T00:14:51.702 DEBUG:teuthology.orchestra.run.smithi145:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-11T00:14:51.790 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:14:51 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-11T00:14:51.792 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:14:51 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T00:14:51.798 INFO:teuthology.orchestra.run.smithi145.stdout:client4809 2024-09-11T00:14:51.798 DEBUG:teuthology.orchestra.run.smithi145:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-11T00:14:51.846 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:14:51 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-11T00:14:51.847 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:14:51 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T00:14:51.853 INFO:teuthology.orchestra.run.smithi145.stdout:client4809 2024-09-11T00:14:51.853 DEBUG:teuthology.orchestra.run.smithi145:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/47039cb3-5d2a-46bf-9066-8055b5dfc583.client4809/status') 2024-09-11T00:14:51.902 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:14:51 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-11T00:14:51.912 INFO:teuthology.orchestra.run.smithi145.stdout:instance: client.4809 (3)172.21.15.145:0/2261240194 2024-09-11T00:14:51.912 INFO:teuthology.orchestra.run.smithi145.stdout:blocklisted: false 2024-09-11T00:14:51.912 INFO:teuthology.orchestra.run.smithi145.stderr:0+1 records in 2024-09-11T00:14:51.913 INFO:teuthology.orchestra.run.smithi145.stderr:0+1 records out 2024-09-11T00:14:51.913 INFO:teuthology.orchestra.run.smithi145.stderr:71 bytes copied, 2.3213e-05 s, 3.1 MB/s 2024-09-11T00:14:51.913 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:14:51 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T00:14:51.919 INFO:tasks.kclient:client.3 config is {'syntax': 'v1'} 2024-09-11T00:14:51.920 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-11T00:14:51.920 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-09-11T00:14:51.920 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-11T00:14:52.030 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:52.028+0000 7f96f547f640 1 -- 172.21.15.92:0/3931297955 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f96f015e060 msgr2=0x7f96f00b6dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:52.030 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:52.028+0000 7f96f547f640 1 --2- 172.21.15.92:0/3931297955 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f96f015e060 0x7f96f00b6dc0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f96f008c0d0 tx=0x7f96e002aa50 comp rx=0 tx=0).stop 2024-09-11T00:14:52.030 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:52.028+0000 7f96f547f640 1 -- 172.21.15.92:0/3931297955 shutdown_connections 2024-09-11T00:14:52.030 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:52.028+0000 7f96f547f640 1 --2- 172.21.15.92:0/3931297955 >> v2:172.21.15.145:3300/0 conn(0x7f96f00d4af0 0x7f96f00d2a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:52.030 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:52.028+0000 7f96f547f640 1 --2- 172.21.15.92:0/3931297955 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f96f00b7300 0x7f96f00d24e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:52.030 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:52.028+0000 7f96f547f640 1 --2- 172.21.15.92:0/3931297955 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f96f015e060 0x7f96f00b6dc0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:52.030 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:52.028+0000 7f96f547f640 1 -- 172.21.15.92:0/3931297955 >> 172.21.15.92:0/3931297955 conn(0x7f96f00d3f70 msgr2=0x7f96f00d4350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:14:52.031 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:52.028+0000 7f96f547f640 1 -- 172.21.15.92:0/3931297955 shutdown_connections 2024-09-11T00:14:52.031 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:52.028+0000 7f96f547f640 1 -- 172.21.15.92:0/3931297955 wait complete. 2024-09-11T00:14:52.034 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:52.029+0000 7f96f547f640 1 Processor -- start 2024-09-11T00:14:52.034 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:52.029+0000 7f96f547f640 1 -- start start 2024-09-11T00:14:52.034 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:52.030+0000 7f96f547f640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f96f00d4af0 0x7f96f01f88c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:52.034 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:52.030+0000 7f96f547f640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f96f015e060 0x7f96f00c9cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:52.035 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:52.030+0000 7f96f547f640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f96f00ca200 0x7f96f0148b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:52.035 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:52.030+0000 7f96f547f640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f96f0161e60 con 0x7f96f015e060 2024-09-11T00:14:52.035 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:52.030+0000 7f96f547f640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f96f0161ce0 con 0x7f96f00ca200 2024-09-11T00:14:52.035 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:52.030+0000 7f96f547f640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f96f0161fe0 con 0x7f96f00d4af0 2024-09-11T00:14:52.035 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:52.030+0000 7f96ee7fc640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f96f015e060 0x7f96f00c9cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:52.035 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:52.030+0000 7f96ee7fc640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f96f015e060 0x7f96f00c9cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:39572/0 (socket says 172.21.15.92:39572) 2024-09-11T00:14:52.035 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:52.030+0000 7f96ee7fc640 1 -- 172.21.15.92:0/3528773011 learned_addr learned my addr 172.21.15.92:0/3528773011 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-11T00:14:52.036 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:52.030+0000 7f96ef7fe640 1 --2- 172.21.15.92:0/3528773011 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f96f00ca200 0x7f96f0148b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:52.036 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:52.030+0000 7f96eeffd640 1 --2- 172.21.15.92:0/3528773011 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f96f00d4af0 0x7f96f01f88c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:52.036 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:52.030+0000 7f96ee7fc640 1 -- 172.21.15.92:0/3528773011 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f96f00d4af0 msgr2=0x7f96f01f88c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:52.036 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:52.030+0000 7f96ee7fc640 1 --2- 172.21.15.92:0/3528773011 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f96f00d4af0 0x7f96f01f88c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:52.036 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:52.030+0000 7f96ee7fc640 1 -- 172.21.15.92:0/3528773011 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f96f00ca200 msgr2=0x7f96f0148b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:52.037 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:52.030+0000 7f96ee7fc640 1 --2- 172.21.15.92:0/3528773011 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f96f00ca200 0x7f96f0148b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:52.037 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:52.030+0000 7f96ee7fc640 1 -- 172.21.15.92:0/3528773011 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96f00cb170 con 0x7f96f015e060 2024-09-11T00:14:52.037 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:52.031+0000 7f96ee7fc640 1 --2- 172.21.15.92:0/3528773011 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f96f015e060 0x7f96f00c9cc0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f96e400c920 tx=0x7f96e400cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:14:52.037 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:52.031+0000 7f96d77fe640 1 -- 172.21.15.92:0/3528773011 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96e4007c70 con 0x7f96f015e060 2024-09-11T00:14:52.037 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:52.031+0000 7f96d77fe640 1 -- 172.21.15.92:0/3528773011 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f96e400f450 con 0x7f96f015e060 2024-09-11T00:14:52.037 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:52.031+0000 7f96d77fe640 1 -- 172.21.15.92:0/3528773011 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96e400f8a0 con 0x7f96f015e060 2024-09-11T00:14:52.037 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:52.031+0000 7f96f547f640 1 -- 172.21.15.92:0/3528773011 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96f00cb450 con 0x7f96f015e060 2024-09-11T00:14:52.038 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:52.031+0000 7f96f547f640 1 -- 172.21.15.92:0/3528773011 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96f00c9470 con 0x7f96f015e060 2024-09-11T00:14:52.038 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:52.032+0000 7f96f547f640 1 -- 172.21.15.92:0/3528773011 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f96f00b6dc0 con 0x7f96f015e060 2024-09-11T00:14:52.038 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:52.033+0000 7f96d77fe640 1 -- 172.21.15.92:0/3528773011 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f96e4020030 con 0x7f96f015e060 2024-09-11T00:14:52.039 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:52.033+0000 7f96d77fe640 1 --2- 172.21.15.92:0/3528773011 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f96dc077f70 0x7f96dc07a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:52.039 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:52.033+0000 7f96d77fe640 1 -- 172.21.15.92:0/3528773011 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f96e409a470 con 0x7f96f015e060 2024-09-11T00:14:52.039 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:52.034+0000 7f96eeffd640 1 --2- 172.21.15.92:0/3528773011 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f96dc077f70 0x7f96dc07a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:52.039 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:52.034+0000 7f96eeffd640 1 --2- 172.21.15.92:0/3528773011 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f96dc077f70 0x7f96dc07a430 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f96e0035000 tx=0x7f96e0004ab0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:14:52.039 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:52.038+0000 7f96d77fe640 1 -- 172.21.15.92:0/3528773011 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f96e4014030 con 0x7f96f015e060 2024-09-11T00:14:52.249 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:52.247+0000 7f96f547f640 1 -- 172.21.15.92:0/3528773011 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f96f00cb620 con 0x7f96f015e060 2024-09-11T00:14:52.249 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:52.247+0000 7f96d77fe640 1 -- 172.21.15.92:0/3528773011 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) ==== 53+0+88 (secure 0 0 0) 0x7f96e4062670 con 0x7f96f015e060 2024-09-11T00:14:52.249 INFO:teuthology.orchestra.run.smithi092.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-09-11T00:14:52.252 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:52.249+0000 7f96f547f640 1 -- 172.21.15.92:0/3528773011 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f96dc077f70 msgr2=0x7f96dc07a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:52.252 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:52.249+0000 7f96f547f640 1 --2- 172.21.15.92:0/3528773011 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f96dc077f70 0x7f96dc07a430 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f96e0035000 tx=0x7f96e0004ab0 comp rx=0 tx=0).stop 2024-09-11T00:14:52.252 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:52.249+0000 7f96f547f640 1 -- 172.21.15.92:0/3528773011 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f96f015e060 msgr2=0x7f96f00c9cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:52.252 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:52.249+0000 7f96f547f640 1 --2- 172.21.15.92:0/3528773011 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f96f015e060 0x7f96f00c9cc0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f96e400c920 tx=0x7f96e400cde0 comp rx=0 tx=0).stop 2024-09-11T00:14:52.252 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:52.249+0000 7f96f547f640 1 -- 172.21.15.92:0/3528773011 shutdown_connections 2024-09-11T00:14:52.252 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:52.249+0000 7f96f547f640 1 --2- 172.21.15.92:0/3528773011 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f96dc077f70 0x7f96dc07a430 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:52.253 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:52.249+0000 7f96f547f640 1 --2- 172.21.15.92:0/3528773011 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f96f00ca200 0x7f96f0148b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:52.253 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:52.249+0000 7f96f547f640 1 --2- 172.21.15.92:0/3528773011 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f96f015e060 0x7f96f00c9cc0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:52.253 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:52.249+0000 7f96f547f640 1 --2- 172.21.15.92:0/3528773011 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f96f00d4af0 0x7f96f01f88c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:52.253 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:52.249+0000 7f96f547f640 1 -- 172.21.15.92:0/3528773011 >> 172.21.15.92:0/3528773011 conn(0x7f96f00d3f70 msgr2=0x7f96f00b8690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:14:52.253 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:52.250+0000 7f96f547f640 1 -- 172.21.15.92:0/3528773011 shutdown_connections 2024-09-11T00:14:52.253 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:52.250+0000 7f96f547f640 1 -- 172.21.15.92:0/3528773011 wait complete. 2024-09-11T00:14:52.262 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-11T00:14:52.262 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-11T00:14:52.262 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi145.front.sepia.ceph.com 2024-09-11T00:14:52.262 INFO:tasks.cephfs.mount:self.client.name = client.3 2024-09-11T00:14:52.263 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-09-11T00:14:52.263 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-11T00:14:52.263 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-11T00:14:52.263 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-11T00:14:52.263 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2024-09-11T00:14:52.263 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T00:14:52.263 DEBUG:teuthology.orchestra.run.smithi145:> ip addr 2024-09-11T00:14:52.280 INFO:teuthology.orchestra.run.smithi145.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-11T00:14:52.280 INFO:teuthology.orchestra.run.smithi145.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-11T00:14:52.280 INFO:teuthology.orchestra.run.smithi145.stdout: inet 127.0.0.1/8 scope host lo 2024-09-11T00:14:52.280 INFO:teuthology.orchestra.run.smithi145.stdout: valid_lft forever preferred_lft forever 2024-09-11T00:14:52.280 INFO:teuthology.orchestra.run.smithi145.stdout: inet6 ::1/128 scope host 2024-09-11T00:14:52.280 INFO:teuthology.orchestra.run.smithi145.stdout: valid_lft forever preferred_lft forever 2024-09-11T00:14:52.281 INFO:teuthology.orchestra.run.smithi145.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-11T00:14:52.281 INFO:teuthology.orchestra.run.smithi145.stdout: link/ether 0c:c4:7a:d9:38:66 brd ff:ff:ff:ff:ff:ff 2024-09-11T00:14:52.281 INFO:teuthology.orchestra.run.smithi145.stdout: altname enp7s0f0 2024-09-11T00:14:52.281 INFO:teuthology.orchestra.run.smithi145.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-11T00:14:52.281 INFO:teuthology.orchestra.run.smithi145.stdout: link/ether 0c:c4:7a:d9:38:67 brd ff:ff:ff:ff:ff:ff 2024-09-11T00:14:52.281 INFO:teuthology.orchestra.run.smithi145.stdout: altname enp7s0f1 2024-09-11T00:14:52.281 INFO:teuthology.orchestra.run.smithi145.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-11T00:14:52.281 INFO:teuthology.orchestra.run.smithi145.stdout: link/ether 0c:c4:7a:88:77:90 brd ff:ff:ff:ff:ff:ff 2024-09-11T00:14:52.281 INFO:teuthology.orchestra.run.smithi145.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-11T00:14:52.281 INFO:teuthology.orchestra.run.smithi145.stdout: link/ether 0c:c4:7a:88:77:91 brd ff:ff:ff:ff:ff:ff 2024-09-11T00:14:52.281 INFO:teuthology.orchestra.run.smithi145.stdout: inet 172.21.15.145/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-11T00:14:52.281 INFO:teuthology.orchestra.run.smithi145.stdout: valid_lft 42754sec preferred_lft 42754sec 2024-09-11T00:14:52.281 INFO:teuthology.orchestra.run.smithi145.stdout: inet6 fe80::ec4:7aff:fe88:7791/64 scope link noprefixroute 2024-09-11T00:14:52.281 INFO:teuthology.orchestra.run.smithi145.stdout: valid_lft forever preferred_lft forever 2024-09-11T00:14:52.282 INFO:teuthology.orchestra.run.smithi145.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-11T00:14:52.282 INFO:teuthology.orchestra.run.smithi145.stdout: link/ether ca:5f:68:d4:e5:9d brd ff:ff:ff:ff:ff:ff 2024-09-11T00:14:52.282 INFO:teuthology.orchestra.run.smithi145.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-11T00:14:52.282 INFO:teuthology.orchestra.run.smithi145.stdout: valid_lft forever preferred_lft forever 2024-09-11T00:14:52.282 INFO:teuthology.orchestra.run.smithi145.stdout: inet6 fe80::2008:67ff:fe02:a944/64 scope link 2024-09-11T00:14:52.282 INFO:teuthology.orchestra.run.smithi145.stdout: valid_lft forever preferred_lft forever 2024-09-11T00:14:52.282 INFO:teuthology.orchestra.run.smithi145.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-11T00:14:52.282 INFO:teuthology.orchestra.run.smithi145.stdout: link/ether ca:5f:68:d4:e5:9d brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-11T00:14:52.282 INFO:teuthology.orchestra.run.smithi145.stdout: inet6 fe80::c85f:68ff:fed4:e59d/64 scope link tentative 2024-09-11T00:14:52.282 INFO:teuthology.orchestra.run.smithi145.stdout: valid_lft forever preferred_lft forever 2024-09-11T00:14:52.282 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T00:14:52.283 DEBUG:teuthology.orchestra.run.smithi145:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-11T00:14:52.344 INFO:teuthology.orchestra.run.smithi145.stdout:1 2024-09-11T00:14:52.346 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T00:14:52.346 DEBUG:teuthology.orchestra.run.smithi145:> route 2024-09-11T00:14:52.403 INFO:teuthology.orchestra.run.smithi145.stdout:Kernel IP routing table 2024-09-11T00:14:52.403 INFO:teuthology.orchestra.run.smithi145.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-11T00:14:52.403 INFO:teuthology.orchestra.run.smithi145.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-11T00:14:52.404 INFO:teuthology.orchestra.run.smithi145.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-11T00:14:52.404 INFO:teuthology.orchestra.run.smithi145.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-11T00:14:52.404 DEBUG:teuthology.orchestra.run.smithi145:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-11T00:14:52.404 DEBUG:teuthology.orchestra.run.smithi145:> set -e 2024-09-11T00:14:52.404 DEBUG:teuthology.orchestra.run.smithi145:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-11T00:14:52.404 DEBUG:teuthology.orchestra.run.smithi145:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-11T00:14:52.405 DEBUG:teuthology.orchestra.run.smithi145:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-11T00:14:52.405 DEBUG:teuthology.orchestra.run.smithi145:> ') 2024-09-11T00:14:52.492 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:14:52 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-11T00:14:52.523 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:14:52 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T00:14:52.529 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T00:14:52.529 DEBUG:teuthology.orchestra.run.smithi145:> ip netns list 2024-09-11T00:14:52.545 INFO:teuthology.orchestra.run.smithi145.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-11T00:14:52.545 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T00:14:52.545 DEBUG:teuthology.orchestra.run.smithi145:> ip netns list-id 2024-09-11T00:14:52.600 INFO:teuthology.orchestra.run.smithi145.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2024-09-11T00:14:52.601 DEBUG:teuthology.orchestra.run.smithi145:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-11T00:14:52.601 DEBUG:teuthology.orchestra.run.smithi145:> set -e 2024-09-11T00:14:52.601 DEBUG:teuthology.orchestra.run.smithi145:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-11T00:14:52.601 DEBUG:teuthology.orchestra.run.smithi145:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2024-09-11T00:14:52.601 DEBUG:teuthology.orchestra.run.smithi145:> ') 2024-09-11T00:14:52.687 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:14:52 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-11T00:14:52.710 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:14:52 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T00:14:52.716 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T00:14:52.717 DEBUG:teuthology.orchestra.run.smithi145:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-09-11T00:14:52.742 INFO:teuthology.orchestra.run.smithi145.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-11T00:14:52.742 INFO:teuthology.orchestra.run.smithi145.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-11T00:14:52.742 INFO:teuthology.orchestra.run.smithi145.stdout: inet 127.0.0.1/8 scope host lo 2024-09-11T00:14:52.742 INFO:teuthology.orchestra.run.smithi145.stdout: valid_lft forever preferred_lft forever 2024-09-11T00:14:52.742 INFO:teuthology.orchestra.run.smithi145.stdout: inet6 ::1/128 scope host 2024-09-11T00:14:52.742 INFO:teuthology.orchestra.run.smithi145.stdout: valid_lft forever preferred_lft forever 2024-09-11T00:14:52.742 INFO:teuthology.orchestra.run.smithi145.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-11T00:14:52.743 INFO:teuthology.orchestra.run.smithi145.stdout: link/ether 16:74:39:e0:e9:42 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-09-11T00:14:52.743 INFO:teuthology.orchestra.run.smithi145.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-09-11T00:14:52.743 INFO:teuthology.orchestra.run.smithi145.stdout: valid_lft forever preferred_lft forever 2024-09-11T00:14:52.743 INFO:teuthology.orchestra.run.smithi145.stdout: inet6 fe80::1474:39ff:fee0:e942/64 scope link 2024-09-11T00:14:52.743 INFO:teuthology.orchestra.run.smithi145.stdout: valid_lft forever preferred_lft forever 2024-09-11T00:14:52.744 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T00:14:52.744 DEBUG:teuthology.orchestra.run.smithi145:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-09-11T00:14:52.810 INFO:teuthology.orchestra.run.smithi145.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-11T00:14:52.810 INFO:teuthology.orchestra.run.smithi145.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-11T00:14:52.810 INFO:teuthology.orchestra.run.smithi145.stdout: inet 127.0.0.1/8 scope host lo 2024-09-11T00:14:52.810 INFO:teuthology.orchestra.run.smithi145.stdout: valid_lft forever preferred_lft forever 2024-09-11T00:14:52.810 INFO:teuthology.orchestra.run.smithi145.stdout: inet6 ::1/128 scope host 2024-09-11T00:14:52.810 INFO:teuthology.orchestra.run.smithi145.stdout: valid_lft forever preferred_lft forever 2024-09-11T00:14:52.811 INFO:teuthology.orchestra.run.smithi145.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-11T00:14:52.811 INFO:teuthology.orchestra.run.smithi145.stdout: link/ether 16:74:39:e0:e9:42 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-09-11T00:14:52.811 INFO:teuthology.orchestra.run.smithi145.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-09-11T00:14:52.811 INFO:teuthology.orchestra.run.smithi145.stdout: valid_lft forever preferred_lft forever 2024-09-11T00:14:52.811 INFO:teuthology.orchestra.run.smithi145.stdout: inet6 fe80::1474:39ff:fee0:e942/64 scope link 2024-09-11T00:14:52.811 INFO:teuthology.orchestra.run.smithi145.stdout: valid_lft forever preferred_lft forever 2024-09-11T00:14:52.812 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2024-09-11T00:14:52.812 DEBUG:teuthology.orchestra.run.smithi145:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-11T00:14:52.812 DEBUG:teuthology.orchestra.run.smithi145:> set -e 2024-09-11T00:14:52.813 DEBUG:teuthology.orchestra.run.smithi145:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2024-09-11T00:14:52.813 DEBUG:teuthology.orchestra.run.smithi145:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-09-11T00:14:52.813 DEBUG:teuthology.orchestra.run.smithi145:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2024-09-11T00:14:52.813 DEBUG:teuthology.orchestra.run.smithi145:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2024-09-11T00:14:52.813 DEBUG:teuthology.orchestra.run.smithi145:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2024-09-11T00:14:52.813 DEBUG:teuthology.orchestra.run.smithi145:> ') 2024-09-11T00:14:52.901 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:14:52 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-11T00:14:52.958 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:14:52 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T00:14:52.965 DEBUG:teuthology.orchestra.run.smithi145:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-11T00:14:52.965 DEBUG:teuthology.orchestra.run.smithi145:> set -e 2024-09-11T00:14:52.965 DEBUG:teuthology.orchestra.run.smithi145:> sudo ip link set brx.1 up 2024-09-11T00:14:52.965 DEBUG:teuthology.orchestra.run.smithi145:> sudo ip link set dev brx.1 master ceph-brx 2024-09-11T00:14:52.965 DEBUG:teuthology.orchestra.run.smithi145:> ') 2024-09-11T00:14:53.012 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:14:53 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-11T00:14:53.035 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:14:53 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T00:14:53.041 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-11T00:14:53.041 DEBUG:teuthology.orchestra.run.smithi145:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2024-09-11T00:14:53.056 INFO:teuthology.orchestra.run.smithi145.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2024-09-11T00:14:53.056 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-11T00:14:53.056 DEBUG:teuthology.orchestra.run.smithi145:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2024-09-11T00:14:53.111 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-11T00:14:53.111 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T00:14:53.112 DEBUG:teuthology.orchestra.run.smithi145:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.3 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2024-09-11T00:14:53.194 INFO:teuthology.orchestra.run.smithi145.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2024-09-11T00:14:53.195 INFO:teuthology.orchestra.run.smithi145.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2024-09-11T00:14:53.195 INFO:teuthology.orchestra.run.smithi145.stdout:invalid new device string format 2024-09-11T00:14:53.203 INFO:teuthology.orchestra.run.smithi145.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2024-09-11T00:14:53.203 INFO:teuthology.orchestra.run.smithi145.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2024-09-11T00:14:53.203 INFO:teuthology.orchestra.run.smithi145.stdout:invalid new device string format 2024-09-11T00:14:53.203 INFO:teuthology.orchestra.run.smithi145.stdout:mount.ceph: resolved to: "172.21.15.92:3300,172.21.15.145:3300,172.21.15.145:3301" 2024-09-11T00:14:53.203 INFO:teuthology.orchestra.run.smithi145.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-11T00:14:53.208 INFO:teuthology.orchestra.run.smithi145.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2024-09-11T00:14:53.208 INFO:teuthology.orchestra.run.smithi145.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2024-09-11T00:14:53.208 INFO:teuthology.orchestra.run.smithi145.stdout:invalid new device string format 2024-09-11T00:14:53.208 INFO:teuthology.orchestra.run.smithi145.stdout:mount.ceph: resolved to: "172.21.15.92:3300,172.21.15.145:3300,172.21.15.145:3301" 2024-09-11T00:14:53.208 INFO:teuthology.orchestra.run.smithi145.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-11T00:14:53.208 INFO:teuthology.orchestra.run.smithi145.stdout:mount.ceph: resolved to: "172.21.15.92:6789,172.21.15.145:6789,172.21.15.145:6790" 2024-09-11T00:14:53.208 INFO:teuthology.orchestra.run.smithi145.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.92:6789,172.21.15.145:6789,172.21.15.145:6790:/ 2024-09-11T00:14:53.208 INFO:teuthology.orchestra.run.smithi145.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs,key=3,fsid=47039cb3-5d2a-46bf-9066-8055b5dfc583" will pass to kernel 2024-09-11T00:14:53.209 INFO:teuthology.orchestra.run.smithi145.stdout:mount: /home/ubuntu/cephtest/mnt.3 does not contain SELinux labels. 2024-09-11T00:14:53.209 INFO:teuthology.orchestra.run.smithi145.stdout: You just mounted a file system that supports labels which does not 2024-09-11T00:14:53.209 INFO:teuthology.orchestra.run.smithi145.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-11T00:14:53.209 INFO:teuthology.orchestra.run.smithi145.stdout: applications will generate AVC messages and not be allowed access to 2024-09-11T00:14:53.209 INFO:teuthology.orchestra.run.smithi145.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-11T00:14:53.211 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-11T00:14:53.211 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T00:14:53.211 DEBUG:teuthology.orchestra.run.smithi145:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2024-09-11T00:14:53.276 DEBUG:teuthology.orchestra.run.smithi145:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-11T00:14:53.365 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:14:53 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-11T00:14:53.366 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:14:53 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T00:14:53.372 INFO:teuthology.orchestra.run.smithi145.stdout:client4547 2024-09-11T00:14:53.372 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2024-09-11T00:14:53.372 DEBUG:teuthology.orchestra.run.smithi145:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T00:14:53.388 DEBUG:teuthology.orchestra.run.smithi145:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-11T00:14:53.476 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:14:53 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-11T00:14:53.478 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:14:53 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T00:14:53.483 INFO:teuthology.orchestra.run.smithi145.stdout:client4547 2024-09-11T00:14:53.484 DEBUG:teuthology.orchestra.run.smithi145:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-11T00:14:53.532 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:14:53 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-11T00:14:53.533 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:14:53 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T00:14:53.539 INFO:teuthology.orchestra.run.smithi145.stdout:client4547 2024-09-11T00:14:53.539 DEBUG:teuthology.orchestra.run.smithi145:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/47039cb3-5d2a-46bf-9066-8055b5dfc583.client4547/status') 2024-09-11T00:14:53.587 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:14:53 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-11T00:14:53.597 INFO:teuthology.orchestra.run.smithi145.stdout:instance: client.4547 (3)192.168.0.2:0/3309780023 2024-09-11T00:14:53.597 INFO:teuthology.orchestra.run.smithi145.stdout:blocklisted: false 2024-09-11T00:14:53.597 INFO:teuthology.orchestra.run.smithi145.stderr:0+1 records in 2024-09-11T00:14:53.597 INFO:teuthology.orchestra.run.smithi145.stderr:0+1 records out 2024-09-11T00:14:53.597 INFO:teuthology.orchestra.run.smithi145.stderr:69 bytes copied, 2.2893e-05 s, 3.0 MB/s 2024-09-11T00:14:53.598 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T00:14:53 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T00:14:53.605 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2024-09-11T00:14:53.693 INFO:tasks.cephfs_test_runner:Starting test: test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev) 2024-09-11T00:14:53.694 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T00:14:53.798 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:53.796+0000 7feeba0b0640 1 -- 172.21.15.92:0/3994173188 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fee9c004d40 msgr2=0x7fee9c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:53.798 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:53.796+0000 7feeba0b0640 1 --2- 172.21.15.92:0/3994173188 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fee9c004d40 0x7fee9c0051c0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7feeac009b20 tx=0x7fee9c005830 comp rx=0 tx=0).stop 2024-09-11T00:14:53.799 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:53.796+0000 7feeb3fff640 1 -- 172.21.15.92:0/3994173188 reap_dead start 2024-09-11T00:14:53.799 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:53.796+0000 7feeba0b0640 1 -- 172.21.15.92:0/3994173188 shutdown_connections 2024-09-11T00:14:53.799 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:53.796+0000 7feeba0b0640 1 -- 172.21.15.92:0/3994173188 >> 172.21.15.92:0/3994173188 conn(0x7feeb40b1760 msgr2=0x7feeb40b1b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:14:53.799 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:53.796+0000 7feeba0b0640 1 -- 172.21.15.92:0/3994173188 shutdown_connections 2024-09-11T00:14:53.799 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:53.796+0000 7feeba0b0640 1 -- 172.21.15.92:0/3994173188 wait complete. 2024-09-11T00:14:53.799 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:53.798+0000 7feeba0b0640 1 Processor -- start 2024-09-11T00:14:53.799 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:53.798+0000 7feeba0b0640 1 -- start start 2024-09-11T00:14:53.801 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:53.798+0000 7feeba0b0640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fee9c004d40 0x7feeb413dc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:53.801 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:53.799+0000 7feeba0b0640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7feeb413e150 0x7feeb41f5de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:53.801 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:53.799+0000 7feeba0b0640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7feeb41f6320 0x7feeb40aa730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:53.802 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:53.799+0000 7feeba0b0640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7feeb40b43a0 con 0x7feeb413e150 2024-09-11T00:14:53.802 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:53.799+0000 7feeba0b0640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7feeb40b4220 con 0x7fee9c004d40 2024-09-11T00:14:53.802 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:53.799+0000 7feeba0b0640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7feeb415c550 con 0x7feeb41f6320 2024-09-11T00:14:53.802 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:53.799+0000 7feeb2ffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7feeb413e150 0x7feeb41f5de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:53.802 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:53.799+0000 7feeb2ffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7feeb413e150 0x7feeb41f5de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:39592/0 (socket says 172.21.15.92:39592) 2024-09-11T00:14:53.802 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:53.799+0000 7feeb2ffd640 1 -- 172.21.15.92:0/3337703182 learned_addr learned my addr 172.21.15.92:0/3337703182 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-11T00:14:53.802 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:53.799+0000 7feeb37fe640 1 --2- 172.21.15.92:0/3337703182 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fee9c004d40 0x7feeb413dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:53.802 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:53.799+0000 7feeb3fff640 1 --2- 172.21.15.92:0/3337703182 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7feeb41f6320 0x7feeb40aa730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:53.802 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:53.799+0000 7feeb2ffd640 1 -- 172.21.15.92:0/3337703182 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7feeb41f6320 msgr2=0x7feeb40aa730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:53.802 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:53.799+0000 7feeb2ffd640 1 --2- 172.21.15.92:0/3337703182 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7feeb41f6320 0x7feeb40aa730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:53.802 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:53.799+0000 7feeb2ffd640 1 -- 172.21.15.92:0/3337703182 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fee9c004d40 msgr2=0x7feeb413dc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:53.802 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:53.799+0000 7feeb2ffd640 1 --2- 172.21.15.92:0/3337703182 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fee9c004d40 0x7feeb413dc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:53.803 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:53.799+0000 7feeb2ffd640 1 -- 172.21.15.92:0/3337703182 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feeb41f39b0 con 0x7feeb413e150 2024-09-11T00:14:53.803 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:53.799+0000 7feeb3fff640 1 --2- 172.21.15.92:0/3337703182 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7feeb41f6320 0x7feeb40aa730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:14:53.803 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:53.799+0000 7feeb2ffd640 1 --2- 172.21.15.92:0/3337703182 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7feeb413e150 0x7feeb41f5de0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7feea8001050 tx=0x7feea80039c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:14:53.803 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:53.799+0000 7fee9bfff640 1 -- 172.21.15.92:0/3337703182 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feea8015070 con 0x7feeb413e150 2024-09-11T00:14:53.803 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:53.799+0000 7fee9bfff640 1 -- 172.21.15.92:0/3337703182 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7feea800f980 con 0x7feeb413e150 2024-09-11T00:14:53.803 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:53.799+0000 7fee9bfff640 1 -- 172.21.15.92:0/3337703182 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feea800fdd0 con 0x7feeb413e150 2024-09-11T00:14:53.803 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:53.799+0000 7feeba0b0640 1 -- 172.21.15.92:0/3337703182 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feeb40ab440 con 0x7feeb413e150 2024-09-11T00:14:53.803 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:53.799+0000 7feeba0b0640 1 -- 172.21.15.92:0/3337703182 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feeb41f3c50 con 0x7feeb413e150 2024-09-11T00:14:53.804 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:53.800+0000 7feeba0b0640 1 -- 172.21.15.92:0/3337703182 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feeb4072aa0 con 0x7feeb413e150 2024-09-11T00:14:53.804 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:53.801+0000 7fee9bfff640 1 -- 172.21.15.92:0/3337703182 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7feea8011430 con 0x7feeb413e150 2024-09-11T00:14:53.804 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:53.801+0000 7fee9bfff640 1 --2- 172.21.15.92:0/3337703182 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7feea0077fa0 0x7feea007a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:53.804 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:53.801+0000 7fee9bfff640 1 -- 172.21.15.92:0/3337703182 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7feea809ad80 con 0x7feeb413e150 2024-09-11T00:14:53.804 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:53.802+0000 7feeb37fe640 1 --2- 172.21.15.92:0/3337703182 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7feea0077fa0 0x7feea007a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:53.804 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:53.802+0000 7feeb37fe640 1 --2- 172.21.15.92:0/3337703182 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7feea0077fa0 0x7feea007a460 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7feea4005fd0 tx=0x7feea4009500 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:14:53.807 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:53.806+0000 7fee9bfff640 1 -- 172.21.15.92:0/3337703182 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7feea8063550 con 0x7feeb413e150 2024-09-11T00:14:53.983 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:53.982+0000 7feeba0b0640 1 -- 172.21.15.92:0/3337703182 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7feeb40b4d40 con 0x7feeb413e150 2024-09-11T00:14:53.984 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:53.983+0000 7fee9bfff640 1 -- 172.21.15.92:0/3337703182 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18622 (secure 0 0 0) 0x7feea8062e50 con 0x7feeb413e150 2024-09-11T00:14:53.985 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:14:53.985 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":25,"fsid":"47039cb3-5d2a-46bf-9066-8055b5dfc583","created":"2024-09-11T00:13:53.889939+0000","modified":"2024-09-11T00:14:23.001261+0000","last_up_change":"2024-09-11T00:14:06.563107+0000","last_in_change":"2024-09-11T00:13:56.982537+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T00:14:06.287223+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-11T00:14:15.739528+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-11T00:14:16.925480+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-11T00:14:20.639419+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"538af0ea-96c9-4999-9ccc-bee55f80ff76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":2860560077},{"type":"v1","addr":"172.21.15.92:6801","nonce":2860560077}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":2860560077},{"type":"v1","addr":"172.21.15.92:6803","nonce":2860560077}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":2860560077},{"type":"v1","addr":"172.21.15.92:6807","nonce":2860560077}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":2860560077},{"type":"v1","addr":"172.21.15.92:6805","nonce":2860560077}]},"public_addr":"172.21.15.92:6801/2860560077","cluster_addr":"172.21.15.92:6803/2860560077","heartbeat_back_addr":"172.21.15.92:6807/2860560077","heartbeat_front_addr":"172.21.15.92:6805/2860560077","state":["exists","up"]},{"osd":1,"uuid":"f9214f2c-ffe6-4447-9a13-9549a36e0537","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":2600417443},{"type":"v1","addr":"172.21.15.92:6817","nonce":2600417443}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6818","nonce":2600417443},{"type":"v1","addr":"172.21.15.92:6819","nonce":2600417443}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6822","nonce":2600417443},{"type":"v1","addr":"172.21.15.92:6823","nonce":2600417443}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":2600417443},{"type":"v1","addr":"172.21.15.92:6821","nonce":2600417443}]},"public_addr":"172.21.15.92:6817/2600417443","cluster_addr":"172.21.15.92:6819/2600417443","heartbeat_back_addr":"172.21.15.92:6823/2600417443","heartbeat_front_addr":"172.21.15.92:6821/2600417443","state":["exists","up"]},{"osd":2,"uuid":"b44dd849-fb85-42b1-8a1a-b6681bb1f467","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":3143892898},{"type":"v1","addr":"172.21.15.92:6809","nonce":3143892898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":3143892898},{"type":"v1","addr":"172.21.15.92:6811","nonce":3143892898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":3143892898},{"type":"v1","addr":"172.21.15.92:6815","nonce":3143892898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":3143892898},{"type":"v1","addr":"172.21.15.92:6813","nonce":3143892898}]},"public_addr":"172.21.15.92:6809/3143892898","cluster_addr":"172.21.15.92:6811/3143892898","heartbeat_back_addr":"172.21.15.92:6815/3143892898","heartbeat_front_addr":"172.21.15.92:6813/3143892898","state":["exists","up"]},{"osd":3,"uuid":"05a49d87-23b9-48dd-962c-d5c2686e7a32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":3913961488},{"type":"v1","addr":"172.21.15.92:6825","nonce":3913961488}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6826","nonce":3913961488},{"type":"v1","addr":"172.21.15.92:6827","nonce":3913961488}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":3913961488},{"type":"v1","addr":"172.21.15.92:6831","nonce":3913961488}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":3913961488},{"type":"v1","addr":"172.21.15.92:6829","nonce":3913961488}]},"public_addr":"172.21.15.92:6825/3913961488","cluster_addr":"172.21.15.92:6827/3913961488","heartbeat_back_addr":"172.21.15.92:6831/3913961488","heartbeat_front_addr":"172.21.15.92:6829/3913961488","state":["exists","up"]},{"osd":4,"uuid":"cf52b087-afe0-4f43-a4e7-db2ebc158815","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6826","nonce":2206798907},{"type":"v1","addr":"172.21.15.145:6827","nonce":2206798907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6828","nonce":2206798907},{"type":"v1","addr":"172.21.15.145:6829","nonce":2206798907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6832","nonce":2206798907},{"type":"v1","addr":"172.21.15.145:6833","nonce":2206798907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6830","nonce":2206798907},{"type":"v1","addr":"172.21.15.145:6831","nonce":2206798907}]},"public_addr":"172.21.15.145:6827/2206798907","cluster_addr":"172.21.15.145:6829/2206798907","heartbeat_back_addr":"172.21.15.145:6833/2206798907","heartbeat_front_addr":"172.21.15.145:6831/2206798907","state":["exists","up"]},{"osd":5,"uuid":"0e54adcd-2d1d-49fb-bf97-3dd7e9addd30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6810","nonce":2599548493},{"type":"v1","addr":"172.21.15.145:6811","nonce":2599548493}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6812","nonce":2599548493},{"type":"v1","addr":"172.21.15.145:6813","nonce":2599548493}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6816","nonce":2599548493},{"type":"v1","addr":"172.21.15.145:6817","nonce":2599548493}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6814","nonce":2599548493},{"type":"v1","addr":"172.21.15.145:6815","nonce":2599548493}]},"public_addr":"172.21.15.145:6811/2599548493","cluster_addr":"172.21.15.145:6813/2599548493","heartbeat_back_addr":"172.21.15.145:6817/2599548493","heartbeat_front_addr":"172.21.15.145:6815/2599548493","state":["exists","up"]},{"osd":6,"uuid":"4d5ae7a8-b3df-4c7a-9124-290f239f5b57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6802","nonce":4192380792},{"type":"v1","addr":"172.21.15.145:6803","nonce":4192380792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6804","nonce":4192380792},{"type":"v1","addr":"172.21.15.145:6805","nonce":4192380792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6808","nonce":4192380792},{"type":"v1","addr":"172.21.15.145:6809","nonce":4192380792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6806","nonce":4192380792},{"type":"v1","addr":"172.21.15.145:6807","nonce":4192380792}]},"public_addr":"172.21.15.145:6803/4192380792","cluster_addr":"172.21.15.145:6805/4192380792","heartbeat_back_addr":"172.21.15.145:6809/4192380792","heartbeat_front_addr":"172.21.15.145:6807/4192380792","state":["exists","up"]},{"osd":7,"uuid":"d7e36444-6e3f-4372-81d3-88e7b4e993f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6818","nonce":3010598400},{"type":"v1","addr":"172.21.15.145:6819","nonce":3010598400}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6820","nonce":3010598400},{"type":"v1","addr":"172.21.15.145:6821","nonce":3010598400}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6824","nonce":3010598400},{"type":"v1","addr":"172.21.15.145:6825","nonce":3010598400}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6822","nonce":3010598400},{"type":"v1","addr":"172.21.15.145:6823","nonce":3010598400}]},"public_addr":"172.21.15.145:6819/3010598400","cluster_addr":"172.21.15.145:6821/3010598400","heartbeat_back_addr":"172.21.15.145:6825/3010598400","heartbeat_front_addr":"172.21.15.145:6823/3010598400","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:14:03.281892+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:14:04.039021+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:14:03.045775+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:14:03.708856+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:14:04.425520+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:14:03.839369+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:14:03.029834+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:14:03.707529+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T00:14:53.987 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:53.985+0000 7feeba0b0640 1 -- 172.21.15.92:0/3337703182 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7feea0077fa0 msgr2=0x7feea007a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:53.987 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:53.985+0000 7feeba0b0640 1 --2- 172.21.15.92:0/3337703182 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7feea0077fa0 0x7feea007a460 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7feea4005fd0 tx=0x7feea4009500 comp rx=0 tx=0).stop 2024-09-11T00:14:53.987 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:53.985+0000 7feeba0b0640 1 -- 172.21.15.92:0/3337703182 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7feeb413e150 msgr2=0x7feeb41f5de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:53.987 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:53.985+0000 7feeba0b0640 1 --2- 172.21.15.92:0/3337703182 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7feeb413e150 0x7feeb41f5de0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7feea8001050 tx=0x7feea80039c0 comp rx=0 tx=0).stop 2024-09-11T00:14:53.987 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:53.985+0000 7feeba0b0640 1 -- 172.21.15.92:0/3337703182 shutdown_connections 2024-09-11T00:14:53.987 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:53.985+0000 7feeba0b0640 1 --2- 172.21.15.92:0/3337703182 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7feea0077fa0 0x7feea007a460 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:53.987 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:53.985+0000 7feeba0b0640 1 --2- 172.21.15.92:0/3337703182 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7feeb41f6320 0x7feeb40aa730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:53.987 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:53.985+0000 7feeba0b0640 1 --2- 172.21.15.92:0/3337703182 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7feeb413e150 0x7feeb41f5de0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:53.987 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:53.985+0000 7feeba0b0640 1 --2- 172.21.15.92:0/3337703182 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fee9c004d40 0x7feeb413dc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:53.987 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:53.985+0000 7feeba0b0640 1 -- 172.21.15.92:0/3337703182 >> 172.21.15.92:0/3337703182 conn(0x7feeb40b1760 msgr2=0x7feeb40cfa80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:14:53.987 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:53.985+0000 7feeba0b0640 1 -- 172.21.15.92:0/3337703182 shutdown_connections 2024-09-11T00:14:53.988 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:53.985+0000 7feeba0b0640 1 -- 172.21.15.92:0/3337703182 wait complete. 2024-09-11T00:14:53.997 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-11T00:14:06.287223+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-11T00:14:15.739528+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-11T00:14:16.925480+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-09-11T00:14:20.639419+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-09-11T00:14:53.998 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-11T00:14:54.102 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:54.100+0000 7f3fd28cd640 1 -- 172.21.15.92:0/2711512943 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3fcc072680 msgr2=0x7f3fcc0ceb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:54.102 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:54.100+0000 7f3fd28cd640 1 --2- 172.21.15.92:0/2711512943 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3fcc072680 0x7f3fcc0ceb00 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f3fcc0b2fc0 tx=0x7f3fb402a4d0 comp rx=0 tx=0).stop 2024-09-11T00:14:54.103 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:54.100+0000 7f3fd28cd640 1 -- 172.21.15.92:0/2711512943 shutdown_connections 2024-09-11T00:14:54.103 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:54.100+0000 7f3fd28cd640 1 --2- 172.21.15.92:0/2711512943 >> v2:172.21.15.145:3300/0 conn(0x7f3fcc072ad0 0x7f3fcc0cf040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:54.103 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:54.100+0000 7f3fd28cd640 1 --2- 172.21.15.92:0/2711512943 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3fcc072680 0x7f3fcc0ceb00 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:54.103 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:54.100+0000 7f3fd28cd640 1 -- 172.21.15.92:0/2711512943 >> 172.21.15.92:0/2711512943 conn(0x7f3fcc0b1760 msgr2=0x7f3fcc0b1b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:14:54.103 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:54.100+0000 7f3fd28cd640 1 -- 172.21.15.92:0/2711512943 shutdown_connections 2024-09-11T00:14:54.103 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:54.100+0000 7f3fd28cd640 1 -- 172.21.15.92:0/2711512943 wait complete. 2024-09-11T00:14:54.105 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:54.102+0000 7f3fd28cd640 1 Processor -- start 2024-09-11T00:14:54.105 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:54.102+0000 7f3fd28cd640 1 -- start start 2024-09-11T00:14:54.105 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:54.102+0000 7f3fd28cd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3fcc072680 0x7f3fcc0af000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:54.106 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:54.102+0000 7f3fd28cd640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3fcc072ad0 0x7f3fcc0cd9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:54.106 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:54.102+0000 7f3fd28cd640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3fcc144780 0x7f3fcc0cdf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:54.106 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:54.102+0000 7f3fd28cd640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f3fcc15c8e0 con 0x7f3fcc072680 2024-09-11T00:14:54.106 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:54.102+0000 7f3fd28cd640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f3fcc15c760 con 0x7f3fcc144780 2024-09-11T00:14:54.106 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:54.102+0000 7f3fd28cd640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f3fcc15ca60 con 0x7f3fcc072ad0 2024-09-11T00:14:54.106 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:54.102+0000 7f3fcbfff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3fcc072680 0x7f3fcc0af000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:54.106 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:54.102+0000 7f3fcbfff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3fcc072680 0x7f3fcc0af000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:39604/0 (socket says 172.21.15.92:39604) 2024-09-11T00:14:54.106 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:54.102+0000 7f3fcbfff640 1 -- 172.21.15.92:0/902602683 learned_addr learned my addr 172.21.15.92:0/902602683 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-11T00:14:54.106 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:54.103+0000 7f3fc3fff640 1 --2- 172.21.15.92:0/902602683 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3fcc072ad0 0x7f3fcc0cd9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:54.106 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:54.103+0000 7f3fd0e6a640 1 --2- 172.21.15.92:0/902602683 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3fcc144780 0x7f3fcc0cdf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:54.106 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:54.103+0000 7f3fcbfff640 1 -- 172.21.15.92:0/902602683 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3fcc072ad0 msgr2=0x7f3fcc0cd9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:54.106 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:54.103+0000 7f3fcbfff640 1 --2- 172.21.15.92:0/902602683 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3fcc072ad0 0x7f3fcc0cd9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:54.107 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:54.103+0000 7f3fcbfff640 1 -- 172.21.15.92:0/902602683 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3fcc144780 msgr2=0x7f3fcc0cdf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:54.107 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:54.103+0000 7f3fcbfff640 1 --2- 172.21.15.92:0/902602683 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3fcc144780 0x7f3fcc0cdf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:54.107 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:54.103+0000 7f3fcbfff640 1 -- 172.21.15.92:0/902602683 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3fcc14e150 con 0x7f3fcc072680 2024-09-11T00:14:54.107 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:54.103+0000 7f3fcbfff640 1 --2- 172.21.15.92:0/902602683 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3fcc072680 0x7f3fcc0af000 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f3fbc00b3e0 tx=0x7f3fbc00b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:14:54.107 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:54.103+0000 7f3fc97fa640 1 -- 172.21.15.92:0/902602683 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fbc015020 con 0x7f3fcc072680 2024-09-11T00:14:54.107 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:54.103+0000 7f3fc97fa640 1 -- 172.21.15.92:0/902602683 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3fbc011940 con 0x7f3fcc072680 2024-09-11T00:14:54.107 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:54.103+0000 7f3fd28cd640 1 -- 172.21.15.92:0/902602683 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3fcc14e3f0 con 0x7f3fcc072680 2024-09-11T00:14:54.107 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:54.103+0000 7f3fc97fa640 1 -- 172.21.15.92:0/902602683 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fbc011d90 con 0x7f3fcc072680 2024-09-11T00:14:54.107 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:54.103+0000 7f3fd28cd640 1 -- 172.21.15.92:0/902602683 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3fcc14e9b0 con 0x7f3fcc072680 2024-09-11T00:14:54.107 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:54.104+0000 7f3fd28cd640 1 -- 172.21.15.92:0/902602683 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3fcc15cfc0 con 0x7f3fcc072680 2024-09-11T00:14:54.108 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:54.105+0000 7f3fc97fa640 1 -- 172.21.15.92:0/902602683 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f3fbc01a400 con 0x7f3fcc072680 2024-09-11T00:14:54.108 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:54.105+0000 7f3fc97fa640 1 --2- 172.21.15.92:0/902602683 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f3fac077f70 0x7f3fac07a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:54.108 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:54.105+0000 7f3fc97fa640 1 -- 172.21.15.92:0/902602683 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f3fbc09a360 con 0x7f3fcc072680 2024-09-11T00:14:54.108 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:54.105+0000 7f3fc3fff640 1 --2- 172.21.15.92:0/902602683 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f3fac077f70 0x7f3fac07a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:54.108 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:54.106+0000 7f3fc3fff640 1 --2- 172.21.15.92:0/902602683 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f3fac077f70 0x7f3fac07a430 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f3fb4033000 tx=0x7f3fb4004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:14:54.110 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:54.109+0000 7f3fc97fa640 1 -- 172.21.15.92:0/902602683 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f3fbc01f020 con 0x7f3fcc072680 2024-09-11T00:14:54.285 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:54.283+0000 7f3fd28cd640 1 -- 172.21.15.92:0/902602683 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f3fcc0cf810 con 0x7f3fcc072680 2024-09-11T00:14:54.285 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:54.283+0000 7f3fc97fa640 1 -- 172.21.15.92:0/902602683 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) ==== 93+0+10 (secure 0 0 0) 0x7f3fbc062b20 con 0x7f3fcc072680 2024-09-11T00:14:54.285 INFO:teuthology.orchestra.run.smithi092.stdout:pg_num: 1 2024-09-11T00:14:54.287 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:54.286+0000 7f3fd28cd640 1 -- 172.21.15.92:0/902602683 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f3fac077f70 msgr2=0x7f3fac07a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:54.287 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:54.286+0000 7f3fd28cd640 1 --2- 172.21.15.92:0/902602683 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f3fac077f70 0x7f3fac07a430 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f3fb4033000 tx=0x7f3fb4004730 comp rx=0 tx=0).stop 2024-09-11T00:14:54.288 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:54.286+0000 7f3fd28cd640 1 -- 172.21.15.92:0/902602683 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3fcc072680 msgr2=0x7f3fcc0af000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:54.288 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:54.286+0000 7f3fd28cd640 1 --2- 172.21.15.92:0/902602683 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3fcc072680 0x7f3fcc0af000 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f3fbc00b3e0 tx=0x7f3fbc00b8a0 comp rx=0 tx=0).stop 2024-09-11T00:14:54.288 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:54.286+0000 7f3fd28cd640 1 -- 172.21.15.92:0/902602683 shutdown_connections 2024-09-11T00:14:54.288 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:54.286+0000 7f3fd28cd640 1 --2- 172.21.15.92:0/902602683 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f3fac077f70 0x7f3fac07a430 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:54.288 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:54.286+0000 7f3fd28cd640 1 --2- 172.21.15.92:0/902602683 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3fcc144780 0x7f3fcc0cdf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:54.288 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:54.286+0000 7f3fd28cd640 1 --2- 172.21.15.92:0/902602683 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3fcc072ad0 0x7f3fcc0cd9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:54.288 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:54.286+0000 7f3fd28cd640 1 --2- 172.21.15.92:0/902602683 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3fcc072680 0x7f3fcc0af000 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:54.288 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:54.286+0000 7f3fd28cd640 1 -- 172.21.15.92:0/902602683 >> 172.21.15.92:0/902602683 conn(0x7f3fcc0b1760 msgr2=0x7f3fcc0ced40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:14:54.288 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:54.286+0000 7f3fd28cd640 1 -- 172.21.15.92:0/902602683 shutdown_connections 2024-09-11T00:14:54.288 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:54.286+0000 7f3fd28cd640 1 -- 172.21.15.92:0/902602683 wait complete. 2024-09-11T00:14:54.298 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-11T00:14:54.402 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:54.400+0000 7ff4b76b8640 1 -- 172.21.15.92:0/255193778 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff4b0161560 msgr2=0x7ff4b00d2360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:54.403 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:54.400+0000 7ff4b76b8640 1 --2- 172.21.15.92:0/255193778 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff4b0161560 0x7ff4b00d2360 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7ff4a0005fd0 tx=0x7ff4a002a820 comp rx=0 tx=0).stop 2024-09-11T00:14:54.403 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:54.400+0000 7ff4b76b8640 1 -- 172.21.15.92:0/255193778 shutdown_connections 2024-09-11T00:14:54.403 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:54.400+0000 7ff4b76b8640 1 --2- 172.21.15.92:0/255193778 >> v2:172.21.15.145:3300/0 conn(0x7ff4b00b55a0 0x7ff4b00d28a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:54.403 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:54.400+0000 7ff4b76b8640 1 --2- 172.21.15.92:0/255193778 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff4b0161560 0x7ff4b00d2360 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:54.403 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:54.400+0000 7ff4b76b8640 1 -- 172.21.15.92:0/255193778 >> 172.21.15.92:0/255193778 conn(0x7ff4b009d170 msgr2=0x7ff4b00d3f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:14:54.403 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:54.400+0000 7ff4b76b8640 1 -- 172.21.15.92:0/255193778 shutdown_connections 2024-09-11T00:14:54.403 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:54.400+0000 7ff4b76b8640 1 -- 172.21.15.92:0/255193778 wait complete. 2024-09-11T00:14:54.406 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:54.401+0000 7ff4b76b8640 1 Processor -- start 2024-09-11T00:14:54.406 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:54.402+0000 7ff4b76b8640 1 -- start start 2024-09-11T00:14:54.406 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:54.402+0000 7ff4b76b8640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff4b00b55a0 0x7ff4b0153d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:54.406 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:54.402+0000 7ff4b76b8640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff4b00d01b0 0x7ff4b01f4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:54.406 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:54.402+0000 7ff4b76b8640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff4b0161560 0x7ff4b00cd3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:54.406 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:54.402+0000 7ff4b76b8640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7ff4b00b4bc0 con 0x7ff4b00d01b0 2024-09-11T00:14:54.406 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:54.402+0000 7ff4b76b8640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7ff4b00b4a40 con 0x7ff4b0161560 2024-09-11T00:14:54.406 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:54.402+0000 7ff4b76b8640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7ff4b00b4d40 con 0x7ff4b00b55a0 2024-09-11T00:14:54.407 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:54.402+0000 7ff4b4c53640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff4b00d01b0 0x7ff4b01f4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:54.407 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:54.402+0000 7ff4b4c53640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff4b00d01b0 0x7ff4b01f4eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:43466/0 (socket says 172.21.15.92:43466) 2024-09-11T00:14:54.407 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:54.402+0000 7ff4b4c53640 1 -- 172.21.15.92:0/4129467671 learned_addr learned my addr 172.21.15.92:0/4129467671 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-11T00:14:54.407 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:54.402+0000 7ff4b5454640 1 --2- 172.21.15.92:0/4129467671 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff4b00b55a0 0x7ff4b0153d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:54.407 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:54.402+0000 7ff4b5c55640 1 --2- 172.21.15.92:0/4129467671 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff4b0161560 0x7ff4b00cd3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:54.407 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:54.403+0000 7ff4b4c53640 1 -- 172.21.15.92:0/4129467671 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff4b00b55a0 msgr2=0x7ff4b0153d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:54.407 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:54.403+0000 7ff4b4c53640 1 --2- 172.21.15.92:0/4129467671 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff4b00b55a0 0x7ff4b0153d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:54.408 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:54.403+0000 7ff4b4c53640 1 -- 172.21.15.92:0/4129467671 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff4b0161560 msgr2=0x7ff4b00cd3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:54.408 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:54.403+0000 7ff4b4c53640 1 --2- 172.21.15.92:0/4129467671 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff4b0161560 0x7ff4b00cd3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:54.408 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:54.403+0000 7ff4b4c53640 1 -- 172.21.15.92:0/4129467671 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4b01f53f0 con 0x7ff4b00d01b0 2024-09-11T00:14:54.408 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:54.403+0000 7ff4b5c55640 1 --2- 172.21.15.92:0/4129467671 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff4b0161560 0x7ff4b00cd3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:14:54.408 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:54.403+0000 7ff4b4c53640 1 --2- 172.21.15.92:0/4129467671 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff4b00d01b0 0x7ff4b01f4eb0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7ff4a400ea60 tx=0x7ff4a400ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:14:54.408 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:54.403+0000 7ff4adffb640 1 -- 172.21.15.92:0/4129467671 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4a400cde0 con 0x7ff4b00d01b0 2024-09-11T00:14:54.408 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:54.403+0000 7ff4adffb640 1 -- 172.21.15.92:0/4129467671 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff4a4004020 con 0x7ff4b00d01b0 2024-09-11T00:14:54.408 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:54.403+0000 7ff4adffb640 1 -- 172.21.15.92:0/4129467671 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4a4004450 con 0x7ff4b00d01b0 2024-09-11T00:14:54.408 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:54.403+0000 7ff4b76b8640 1 -- 172.21.15.92:0/4129467671 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff4b00b9760 con 0x7ff4b00d01b0 2024-09-11T00:14:54.408 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:54.403+0000 7ff4b76b8640 1 -- 172.21.15.92:0/4129467671 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4b00cb900 con 0x7ff4b00d01b0 2024-09-11T00:14:54.408 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:54.404+0000 7ff4b76b8640 1 -- 172.21.15.92:0/4129467671 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff4b00cf3c0 con 0x7ff4b00d01b0 2024-09-11T00:14:54.409 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:54.405+0000 7ff4adffb640 1 -- 172.21.15.92:0/4129467671 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7ff4a40035f0 con 0x7ff4b00d01b0 2024-09-11T00:14:54.409 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:54.405+0000 7ff4adffb640 1 --2- 172.21.15.92:0/4129467671 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7ff49c077f70 0x7ff49c07a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:54.409 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:54.405+0000 7ff4adffb640 1 -- 172.21.15.92:0/4129467671 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7ff4a409a9c0 con 0x7ff4b00d01b0 2024-09-11T00:14:54.409 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:54.405+0000 7ff4b5454640 1 --2- 172.21.15.92:0/4129467671 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7ff49c077f70 0x7ff49c07a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:54.410 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:54.406+0000 7ff4b5454640 1 --2- 172.21.15.92:0/4129467671 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7ff49c077f70 0x7ff49c07a430 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7ff4a0034000 tx=0x7ff4a0004ab0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:14:54.410 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:54.409+0000 7ff4adffb640 1 -- 172.21.15.92:0/4129467671 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7ff4a409ce20 con 0x7ff4b00d01b0 2024-09-11T00:14:54.586 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:54.585+0000 7ff4b76b8640 1 -- 172.21.15.92:0/4129467671 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7ff4b00d0900 con 0x7ff4b00d01b0 2024-09-11T00:14:54.587 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:54.585+0000 7ff4adffb640 1 -- 172.21.15.92:0/4129467671 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) ==== 104+0+11 (secure 0 0 0) 0x7ff4b01f53f0 con 0x7ff4b00d01b0 2024-09-11T00:14:54.587 INFO:teuthology.orchestra.run.smithi092.stdout:pg_num: 32 2024-09-11T00:14:54.589 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:54.587+0000 7ff4b76b8640 1 -- 172.21.15.92:0/4129467671 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7ff49c077f70 msgr2=0x7ff49c07a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:54.589 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:54.587+0000 7ff4b76b8640 1 --2- 172.21.15.92:0/4129467671 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7ff49c077f70 0x7ff49c07a430 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7ff4a0034000 tx=0x7ff4a0004ab0 comp rx=0 tx=0).stop 2024-09-11T00:14:54.589 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:54.587+0000 7ff4b76b8640 1 -- 172.21.15.92:0/4129467671 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff4b00d01b0 msgr2=0x7ff4b01f4eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:54.589 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:54.587+0000 7ff4b76b8640 1 --2- 172.21.15.92:0/4129467671 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff4b00d01b0 0x7ff4b01f4eb0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7ff4a400ea60 tx=0x7ff4a400ef20 comp rx=0 tx=0).stop 2024-09-11T00:14:54.589 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:54.587+0000 7ff4b76b8640 1 -- 172.21.15.92:0/4129467671 shutdown_connections 2024-09-11T00:14:54.590 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:54.587+0000 7ff4b76b8640 1 --2- 172.21.15.92:0/4129467671 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7ff49c077f70 0x7ff49c07a430 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:54.590 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:54.587+0000 7ff4b76b8640 1 --2- 172.21.15.92:0/4129467671 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff4b0161560 0x7ff4b00cd3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:54.590 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:54.587+0000 7ff4b76b8640 1 --2- 172.21.15.92:0/4129467671 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff4b00d01b0 0x7ff4b01f4eb0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:54.590 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:54.587+0000 7ff4b76b8640 1 --2- 172.21.15.92:0/4129467671 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff4b00b55a0 0x7ff4b0153d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:54.590 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:54.587+0000 7ff4b76b8640 1 -- 172.21.15.92:0/4129467671 >> 172.21.15.92:0/4129467671 conn(0x7ff4b009d170 msgr2=0x7ff4b0160340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:14:54.590 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:54.587+0000 7ff4b76b8640 1 -- 172.21.15.92:0/4129467671 shutdown_connections 2024-09-11T00:14:54.590 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:54.587+0000 7ff4b76b8640 1 -- 172.21.15.92:0/4129467671 wait complete. 2024-09-11T00:14:54.599 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-11T00:14:54.706 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:54.704+0000 7f5d041ec640 1 -- 172.21.15.92:0/3756111066 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5cfc0cf210 msgr2=0x7f5cfc15c550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:54.706 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:54.704+0000 7f5d041ec640 1 --2- 172.21.15.92:0/3756111066 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5cfc0cf210 0x7f5cfc15c550 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f5cfc06de10 tx=0x7f5cf402a980 comp rx=0 tx=0).stop 2024-09-11T00:14:54.706 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:54.704+0000 7f5d041ec640 1 -- 172.21.15.92:0/3756111066 shutdown_connections 2024-09-11T00:14:54.706 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:54.704+0000 7f5d041ec640 1 --2- 172.21.15.92:0/3756111066 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5cfc0cf210 0x7f5cfc15c550 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:54.706 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:54.704+0000 7f5d041ec640 1 --2- 172.21.15.92:0/3756111066 >> v2:172.21.15.145:3300/0 conn(0x7f5cfc144780 0x7f5cfc0b3da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:54.707 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:54.704+0000 7f5d041ec640 1 -- 172.21.15.92:0/3756111066 >> 172.21.15.92:0/3756111066 conn(0x7f5cfc0b1760 msgr2=0x7f5cfc0b1b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:14:54.707 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:54.704+0000 7f5d041ec640 1 -- 172.21.15.92:0/3756111066 shutdown_connections 2024-09-11T00:14:54.707 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:54.704+0000 7f5d041ec640 1 -- 172.21.15.92:0/3756111066 wait complete. 2024-09-11T00:14:54.709 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:54.705+0000 7f5d041ec640 1 Processor -- start 2024-09-11T00:14:54.709 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:54.705+0000 7f5d041ec640 1 -- start start 2024-09-11T00:14:54.709 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:54.706+0000 7f5d041ec640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f5cfc072680 0x7f5cfc0703d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:54.709 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:54.706+0000 7f5d041ec640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5cfc0cf210 0x7f5cfc15a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:54.709 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:54.706+0000 7f5d041ec640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5cfc144780 0x7f5cfc06f460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:54.709 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:54.706+0000 7f5d041ec640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f5cfc15ca90 con 0x7f5cfc144780 2024-09-11T00:14:54.709 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:54.706+0000 7f5d041ec640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f5cfc072d60 con 0x7f5cfc0cf210 2024-09-11T00:14:54.709 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:54.706+0000 7f5d041ec640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f5cfc15cc10 con 0x7f5cfc072680 2024-09-11T00:14:54.710 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:54.706+0000 7f5d02789640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5cfc144780 0x7f5cfc06f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:54.710 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:54.706+0000 7f5d02789640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5cfc144780 0x7f5cfc06f460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:43488/0 (socket says 172.21.15.92:43488) 2024-09-11T00:14:54.710 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:54.706+0000 7f5d02789640 1 -- 172.21.15.92:0/339293510 learned_addr learned my addr 172.21.15.92:0/339293510 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-11T00:14:54.710 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:54.706+0000 7f5d01787640 1 --2- 172.21.15.92:0/339293510 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5cfc0cf210 0x7f5cfc15a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:54.710 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:54.706+0000 7f5d01f88640 1 --2- 172.21.15.92:0/339293510 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f5cfc072680 0x7f5cfc0703d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:54.710 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:54.707+0000 7f5d02789640 1 -- 172.21.15.92:0/339293510 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f5cfc072680 msgr2=0x7f5cfc0703d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:54.710 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:54.707+0000 7f5d02789640 1 --2- 172.21.15.92:0/339293510 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f5cfc072680 0x7f5cfc0703d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:54.710 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:54.707+0000 7f5d02789640 1 -- 172.21.15.92:0/339293510 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5cfc0cf210 msgr2=0x7f5cfc15a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:54.710 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:54.707+0000 7f5d02789640 1 --2- 172.21.15.92:0/339293510 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5cfc0cf210 0x7f5cfc15a490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:54.710 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:54.707+0000 7f5d02789640 1 -- 172.21.15.92:0/339293510 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5cfc0ac6f0 con 0x7f5cfc144780 2024-09-11T00:14:54.710 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:54.707+0000 7f5d02789640 1 --2- 172.21.15.92:0/339293510 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5cfc144780 0x7f5cfc06f460 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f5cf4009d60 tx=0x7f5cf4003ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:14:54.710 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:54.707+0000 7f5cf27fc640 1 -- 172.21.15.92:0/339293510 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cf4049070 con 0x7f5cfc144780 2024-09-11T00:14:54.710 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:54.707+0000 7f5cf27fc640 1 -- 172.21.15.92:0/339293510 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5cf403cc40 con 0x7f5cfc144780 2024-09-11T00:14:54.711 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:54.707+0000 7f5d041ec640 1 -- 172.21.15.92:0/339293510 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5cfc0ac990 con 0x7f5cfc144780 2024-09-11T00:14:54.711 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:54.707+0000 7f5cf27fc640 1 -- 172.21.15.92:0/339293510 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cf4034070 con 0x7f5cfc144780 2024-09-11T00:14:54.711 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:54.707+0000 7f5d041ec640 1 -- 172.21.15.92:0/339293510 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5cfc0acf50 con 0x7f5cfc144780 2024-09-11T00:14:54.712 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:54.708+0000 7f5d041ec640 1 -- 172.21.15.92:0/339293510 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5cfc15c550 con 0x7f5cfc144780 2024-09-11T00:14:54.712 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:54.709+0000 7f5cf27fc640 1 -- 172.21.15.92:0/339293510 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f5cf4043030 con 0x7f5cfc144780 2024-09-11T00:14:54.712 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:54.709+0000 7f5cf27fc640 1 --2- 172.21.15.92:0/339293510 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f5ce0077f70 0x7f5ce007a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:54.712 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:54.710+0000 7f5cf27fc640 1 -- 172.21.15.92:0/339293510 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f5cf40bd450 con 0x7f5cfc144780 2024-09-11T00:14:54.712 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:54.710+0000 7f5d01f88640 1 --2- 172.21.15.92:0/339293510 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f5ce0077f70 0x7f5ce007a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:54.712 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:54.710+0000 7f5d01f88640 1 --2- 172.21.15.92:0/339293510 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f5ce0077f70 0x7f5ce007a430 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f5cf800a490 tx=0x7f5cf800a420 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:14:54.715 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:54.714+0000 7f5cf27fc640 1 -- 172.21.15.92:0/339293510 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f5cf4041070 con 0x7f5cfc144780 2024-09-11T00:14:54.891 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:54.889+0000 7f5d041ec640 1 -- 172.21.15.92:0/339293510 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f5cfc0afab0 con 0x7f5cfc144780 2024-09-11T00:14:54.891 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:54.889+0000 7f5cf27fc640 1 -- 172.21.15.92:0/339293510 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) ==== 100+0+11 (secure 0 0 0) 0x7f5cf40855c0 con 0x7f5cfc144780 2024-09-11T00:14:54.891 INFO:teuthology.orchestra.run.smithi092.stdout:pg_num: 64 2024-09-11T00:14:54.893 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:54.891+0000 7f5d041ec640 1 -- 172.21.15.92:0/339293510 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f5ce0077f70 msgr2=0x7f5ce007a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:54.893 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:54.891+0000 7f5d041ec640 1 --2- 172.21.15.92:0/339293510 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f5ce0077f70 0x7f5ce007a430 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f5cf800a490 tx=0x7f5cf800a420 comp rx=0 tx=0).stop 2024-09-11T00:14:54.893 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:54.891+0000 7f5d041ec640 1 -- 172.21.15.92:0/339293510 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5cfc144780 msgr2=0x7f5cfc06f460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:54.894 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:54.891+0000 7f5d041ec640 1 --2- 172.21.15.92:0/339293510 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5cfc144780 0x7f5cfc06f460 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f5cf4009d60 tx=0x7f5cf4003ef0 comp rx=0 tx=0).stop 2024-09-11T00:14:54.894 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:54.891+0000 7f5d041ec640 1 -- 172.21.15.92:0/339293510 shutdown_connections 2024-09-11T00:14:54.894 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:54.891+0000 7f5d041ec640 1 --2- 172.21.15.92:0/339293510 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f5ce0077f70 0x7f5ce007a430 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:54.894 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:54.891+0000 7f5d041ec640 1 --2- 172.21.15.92:0/339293510 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5cfc144780 0x7f5cfc06f460 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:54.894 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:54.891+0000 7f5d041ec640 1 --2- 172.21.15.92:0/339293510 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5cfc0cf210 0x7f5cfc15a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:54.894 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:54.891+0000 7f5d041ec640 1 --2- 172.21.15.92:0/339293510 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f5cfc072680 0x7f5cfc0703d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:54.894 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:54.891+0000 7f5d041ec640 1 -- 172.21.15.92:0/339293510 >> 172.21.15.92:0/339293510 conn(0x7f5cfc0b1760 msgr2=0x7f5cfc0b1b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:14:54.894 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:54.891+0000 7f5d041ec640 1 -- 172.21.15.92:0/339293510 shutdown_connections 2024-09-11T00:14:54.894 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:54.891+0000 7f5d041ec640 1 -- 172.21.15.92:0/339293510 wait complete. 2024-09-11T00:14:54.904 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-09-11T00:14:55.008 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:55.006+0000 7fefad240640 1 -- 172.21.15.92:0/1611114196 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fefa815f480 msgr2=0x7fefa80aea30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:55.008 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:55.006+0000 7fefad240640 1 --2- 172.21.15.92:0/1611114196 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fefa815f480 0x7fefa80aea30 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fefa0005fd0 tx=0x7fefa002a5d0 comp rx=0 tx=0).stop 2024-09-11T00:14:55.008 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:55.006+0000 7fefad240640 1 -- 172.21.15.92:0/1611114196 shutdown_connections 2024-09-11T00:14:55.008 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:55.006+0000 7fefad240640 1 --2- 172.21.15.92:0/1611114196 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fefa815f480 0x7fefa80aea30 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:55.008 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:55.006+0000 7fefad240640 1 --2- 172.21.15.92:0/1611114196 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fefa80b2dc0 0x7fefa815ef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:55.008 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:55.006+0000 7fefad240640 1 -- 172.21.15.92:0/1611114196 >> 172.21.15.92:0/1611114196 conn(0x7fefa80d1d70 msgr2=0x7fefa80d2180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:14:55.008 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:55.006+0000 7fefad240640 1 -- 172.21.15.92:0/1611114196 shutdown_connections 2024-09-11T00:14:55.008 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:55.006+0000 7fefad240640 1 -- 172.21.15.92:0/1611114196 wait complete. 2024-09-11T00:14:55.009 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:55.007+0000 7fefad240640 1 Processor -- start 2024-09-11T00:14:55.009 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:55.007+0000 7fefad240640 1 -- start start 2024-09-11T00:14:55.011 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:55.008+0000 7fefad240640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fefa80b2dc0 0x7fefa81f54b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:55.011 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:55.008+0000 7fefad240640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fefa80cff50 0x7fefa80b67c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:55.011 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:55.008+0000 7fefad240640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fefa815f480 0x7fefa815ca80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:55.012 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:55.008+0000 7fefad240640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fefa80d0bc0 con 0x7fefa80b2dc0 2024-09-11T00:14:55.012 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:55.008+0000 7fefad240640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fefa80d0a40 con 0x7fefa815f480 2024-09-11T00:14:55.012 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:55.008+0000 7fefad240640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7fefa80aef70 con 0x7fefa80cff50 2024-09-11T00:14:55.012 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:55.008+0000 7fefa6d9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fefa80b2dc0 0x7fefa81f54b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:55.012 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:55.008+0000 7fefa6d9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fefa80b2dc0 0x7fefa81f54b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:43504/0 (socket says 172.21.15.92:43504) 2024-09-11T00:14:55.012 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:55.008+0000 7fefa6d9d640 1 -- 172.21.15.92:0/66090448 learned_addr learned my addr 172.21.15.92:0/66090448 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-11T00:14:55.012 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:55.008+0000 7fefa659c640 1 --2- 172.21.15.92:0/66090448 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fefa80cff50 0x7fefa80b67c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:55.012 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:55.008+0000 7fefa759e640 1 --2- 172.21.15.92:0/66090448 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fefa815f480 0x7fefa815ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:55.012 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:55.009+0000 7fefa6d9d640 1 -- 172.21.15.92:0/66090448 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fefa80cff50 msgr2=0x7fefa80b67c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:55.012 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:55.009+0000 7fefa6d9d640 1 --2- 172.21.15.92:0/66090448 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fefa80cff50 0x7fefa80b67c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:55.012 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:55.009+0000 7fefa6d9d640 1 -- 172.21.15.92:0/66090448 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fefa815f480 msgr2=0x7fefa815ca80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:55.012 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:55.009+0000 7fefa6d9d640 1 --2- 172.21.15.92:0/66090448 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fefa815f480 0x7fefa815ca80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:55.012 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:55.009+0000 7fefa6d9d640 1 -- 172.21.15.92:0/66090448 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fefa80b5d20 con 0x7fefa80b2dc0 2024-09-11T00:14:55.013 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:55.009+0000 7fefa659c640 1 --2- 172.21.15.92:0/66090448 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fefa80cff50 0x7fefa80b67c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:14:55.013 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:55.009+0000 7fefa6d9d640 1 --2- 172.21.15.92:0/66090448 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fefa80b2dc0 0x7fefa81f54b0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fef9800c870 tx=0x7fef9800cd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:14:55.013 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:55.009+0000 7fef8f7fe640 1 -- 172.21.15.92:0/66090448 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef98003b70 con 0x7fefa80b2dc0 2024-09-11T00:14:55.013 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:55.009+0000 7fef8f7fe640 1 -- 172.21.15.92:0/66090448 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fef98003d30 con 0x7fefa80b2dc0 2024-09-11T00:14:55.013 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:55.009+0000 7fef8f7fe640 1 -- 172.21.15.92:0/66090448 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef9800aa50 con 0x7fefa80b2dc0 2024-09-11T00:14:55.013 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:55.009+0000 7fefad240640 1 -- 172.21.15.92:0/66090448 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fefa815a0e0 con 0x7fefa80b2dc0 2024-09-11T00:14:55.013 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:55.009+0000 7fefad240640 1 -- 172.21.15.92:0/66090448 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fefa80b5fc0 con 0x7fefa80b2dc0 2024-09-11T00:14:55.014 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:55.010+0000 7fefad240640 1 -- 172.21.15.92:0/66090448 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fefa815ef40 con 0x7fefa80b2dc0 2024-09-11T00:14:55.014 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:55.011+0000 7fef8f7fe640 1 -- 172.21.15.92:0/66090448 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fef9800abf0 con 0x7fefa80b2dc0 2024-09-11T00:14:55.014 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:55.011+0000 7fef8f7fe640 1 --2- 172.21.15.92:0/66090448 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7fef94077f70 0x7fef9407a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:55.014 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:55.011+0000 7fef8f7fe640 1 -- 172.21.15.92:0/66090448 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fef98099f70 con 0x7fefa80b2dc0 2024-09-11T00:14:55.014 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:55.011+0000 7fefa659c640 1 --2- 172.21.15.92:0/66090448 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7fef94077f70 0x7fef9407a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:55.015 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:55.012+0000 7fefa659c640 1 --2- 172.21.15.92:0/66090448 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7fef94077f70 0x7fef9407a430 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fefa815b7f0 tx=0x7fef9c00b2c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:14:55.017 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:55.015+0000 7fef8f7fe640 1 -- 172.21.15.92:0/66090448 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fef98062730 con 0x7fefa80b2dc0 2024-09-11T00:14:55.193 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:55.191+0000 7fefad240640 1 -- 172.21.15.92:0/66090448 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7fefa8073000 con 0x7fefa80b2dc0 2024-09-11T00:14:55.194 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:55.192+0000 7fef8f7fe640 1 -- 172.21.15.92:0/66090448 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v25) ==== 103+0+11 (secure 0 0 0) 0x7fef98062030 con 0x7fefa80b2dc0 2024-09-11T00:14:55.194 INFO:teuthology.orchestra.run.smithi092.stdout:pg_num: 32 2024-09-11T00:14:55.196 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:55.194+0000 7fefad240640 1 -- 172.21.15.92:0/66090448 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7fef94077f70 msgr2=0x7fef9407a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:55.196 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:55.194+0000 7fefad240640 1 --2- 172.21.15.92:0/66090448 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7fef94077f70 0x7fef9407a430 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fefa815b7f0 tx=0x7fef9c00b2c0 comp rx=0 tx=0).stop 2024-09-11T00:14:55.197 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:55.194+0000 7fefad240640 1 -- 172.21.15.92:0/66090448 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fefa80b2dc0 msgr2=0x7fefa81f54b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:55.197 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:55.194+0000 7fefad240640 1 --2- 172.21.15.92:0/66090448 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fefa80b2dc0 0x7fefa81f54b0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fef9800c870 tx=0x7fef9800cd30 comp rx=0 tx=0).stop 2024-09-11T00:14:55.197 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:55.194+0000 7fefad240640 1 -- 172.21.15.92:0/66090448 shutdown_connections 2024-09-11T00:14:55.197 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:55.194+0000 7fefad240640 1 --2- 172.21.15.92:0/66090448 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7fef94077f70 0x7fef9407a430 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:55.197 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:55.194+0000 7fefad240640 1 --2- 172.21.15.92:0/66090448 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fefa815f480 0x7fefa815ca80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:55.197 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:55.194+0000 7fefad240640 1 --2- 172.21.15.92:0/66090448 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fefa80cff50 0x7fefa80b67c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:55.197 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:55.194+0000 7fefad240640 1 --2- 172.21.15.92:0/66090448 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fefa80b2dc0 0x7fefa81f54b0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:55.197 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:55.194+0000 7fefad240640 1 -- 172.21.15.92:0/66090448 >> 172.21.15.92:0/66090448 conn(0x7fefa80d1d70 msgr2=0x7fefa8071ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:14:55.197 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:55.194+0000 7fefad240640 1 -- 172.21.15.92:0/66090448 shutdown_connections 2024-09-11T00:14:55.197 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:55.194+0000 7fefad240640 1 -- 172.21.15.92:0/66090448 wait complete. 2024-09-11T00:14:55.207 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic' 2024-09-11T00:14:55.308 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:55.307+0000 7fc0e03e8640 1 -- 172.21.15.92:0/3372347493 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc0d8155f50 msgr2=0x7fc0d8160070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:55.309 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:55.307+0000 7fc0e03e8640 1 --2- 172.21.15.92:0/3372347493 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc0d8155f50 0x7fc0d8160070 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fc0d80cdcb0 tx=0x7fc0d402a440 comp rx=0 tx=0).stop 2024-09-11T00:14:55.309 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:55.307+0000 7fc0e03e8640 1 -- 172.21.15.92:0/3372347493 shutdown_connections 2024-09-11T00:14:55.309 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:55.307+0000 7fc0e03e8640 1 --2- 172.21.15.92:0/3372347493 >> v2:172.21.15.145:3300/0 conn(0x7fc0d8074a40 0x7fc0d8070140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:55.309 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:55.307+0000 7fc0e03e8640 1 --2- 172.21.15.92:0/3372347493 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc0d8155f50 0x7fc0d8160070 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:55.309 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:55.307+0000 7fc0e03e8640 1 -- 172.21.15.92:0/3372347493 >> 172.21.15.92:0/3372347493 conn(0x7fc0d80b1c80 msgr2=0x7fc0d80b2060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:14:55.309 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:55.307+0000 7fc0e03e8640 1 -- 172.21.15.92:0/3372347493 shutdown_connections 2024-09-11T00:14:55.309 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:55.307+0000 7fc0e03e8640 1 -- 172.21.15.92:0/3372347493 wait complete. 2024-09-11T00:14:55.312 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:55.308+0000 7fc0e03e8640 1 Processor -- start 2024-09-11T00:14:55.312 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:55.308+0000 7fc0e03e8640 1 -- start start 2024-09-11T00:14:55.312 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:55.308+0000 7fc0e03e8640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc0d8074a40 0x7fc0d80aeb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:55.312 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:55.309+0000 7fc0e03e8640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc0d8155f50 0x7fc0d8150660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:55.312 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:55.309+0000 7fc0e03e8640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc0d8156330 0x7fc0d80729a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:55.312 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:55.309+0000 7fc0e03e8640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fc0d8070800 con 0x7fc0d8155f50 2024-09-11T00:14:55.312 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:55.309+0000 7fc0e03e8640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fc0d8070680 con 0x7fc0d8156330 2024-09-11T00:14:55.312 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:55.309+0000 7fc0e03e8640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7fc0d8070980 con 0x7fc0d8074a40 2024-09-11T00:14:55.312 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:55.309+0000 7fc0dd983640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc0d8155f50 0x7fc0d8150660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:55.312 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:55.309+0000 7fc0dd983640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc0d8155f50 0x7fc0d8150660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:43524/0 (socket says 172.21.15.92:43524) 2024-09-11T00:14:55.312 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:55.309+0000 7fc0dd983640 1 -- 172.21.15.92:0/1806383725 learned_addr learned my addr 172.21.15.92:0/1806383725 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-11T00:14:55.313 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:55.309+0000 7fc0de184640 1 --2- 172.21.15.92:0/1806383725 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc0d8074a40 0x7fc0d80aeb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:55.313 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:55.309+0000 7fc0de985640 1 --2- 172.21.15.92:0/1806383725 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc0d8156330 0x7fc0d80729a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:55.313 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:55.309+0000 7fc0dd983640 1 -- 172.21.15.92:0/1806383725 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc0d8074a40 msgr2=0x7fc0d80aeb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:55.313 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:55.309+0000 7fc0dd983640 1 --2- 172.21.15.92:0/1806383725 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc0d8074a40 0x7fc0d80aeb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:55.313 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:55.309+0000 7fc0dd983640 1 -- 172.21.15.92:0/1806383725 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc0d8156330 msgr2=0x7fc0d80729a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:55.313 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:55.309+0000 7fc0dd983640 1 --2- 172.21.15.92:0/1806383725 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc0d8156330 0x7fc0d80729a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:55.313 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:55.309+0000 7fc0dd983640 1 -- 172.21.15.92:0/1806383725 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0d8150ba0 con 0x7fc0d8155f50 2024-09-11T00:14:55.313 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:55.309+0000 7fc0dd983640 1 --2- 172.21.15.92:0/1806383725 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc0d8155f50 0x7fc0d8150660 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fc0c800b3f0 tx=0x7fc0c800b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:14:55.313 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:55.309+0000 7fc0ceffd640 1 -- 172.21.15.92:0/1806383725 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0c8015020 con 0x7fc0d8155f50 2024-09-11T00:14:55.313 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:55.309+0000 7fc0ceffd640 1 -- 172.21.15.92:0/1806383725 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc0c8011920 con 0x7fc0d8155f50 2024-09-11T00:14:55.313 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:55.309+0000 7fc0ceffd640 1 -- 172.21.15.92:0/1806383725 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0c8011d50 con 0x7fc0d8155f50 2024-09-11T00:14:55.313 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:55.309+0000 7fc0e03e8640 1 -- 172.21.15.92:0/1806383725 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0d80af1d0 con 0x7fc0d8155f50 2024-09-11T00:14:55.313 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:55.309+0000 7fc0e03e8640 1 -- 172.21.15.92:0/1806383725 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0d8154d90 con 0x7fc0d8155f50 2024-09-11T00:14:55.314 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:55.310+0000 7fc0e03e8640 1 -- 172.21.15.92:0/1806383725 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc0d8070140 con 0x7fc0d8155f50 2024-09-11T00:14:55.314 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:55.311+0000 7fc0ceffd640 1 -- 172.21.15.92:0/1806383725 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fc0c801a400 con 0x7fc0d8155f50 2024-09-11T00:14:55.315 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:55.311+0000 7fc0ceffd640 1 --2- 172.21.15.92:0/1806383725 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7fc0bc077f70 0x7fc0bc07a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:55.315 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:55.311+0000 7fc0ceffd640 1 -- 172.21.15.92:0/1806383725 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fc0c809a210 con 0x7fc0d8155f50 2024-09-11T00:14:55.315 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:55.311+0000 7fc0de184640 1 --2- 172.21.15.92:0/1806383725 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7fc0bc077f70 0x7fc0bc07a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:55.315 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:55.312+0000 7fc0de184640 1 --2- 172.21.15.92:0/1806383725 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7fc0bc077f70 0x7fc0bc07a430 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fc0d4033000 tx=0x7fc0d4004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:14:55.317 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:55.315+0000 7fc0ceffd640 1 -- 172.21.15.92:0/1806383725 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fc0c801f020 con 0x7fc0d8155f50 2024-09-11T00:14:55.555 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:55.553+0000 7fc0e03e8640 1 -- 172.21.15.92:0/1806383725 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic"]} v 0) -- 0x7fc0d815b7f0 con 0x7fc0d8155f50 2024-09-11T00:14:55.740 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:55.739+0000 7fc0ceffd640 1 -- 172.21.15.92:0/1806383725 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic"]}]=0 v56) ==== 147+0+0 (secure 0 0 0) 0x7fc0c8062a60 con 0x7fc0d8155f50 2024-09-11T00:14:55.743 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:55.741+0000 7fc0e03e8640 1 -- 172.21.15.92:0/1806383725 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7fc0bc077f70 msgr2=0x7fc0bc07a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:55.743 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:55.741+0000 7fc0e03e8640 1 --2- 172.21.15.92:0/1806383725 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7fc0bc077f70 0x7fc0bc07a430 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fc0d4033000 tx=0x7fc0d4004730 comp rx=0 tx=0).stop 2024-09-11T00:14:55.743 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:55.741+0000 7fc0e03e8640 1 -- 172.21.15.92:0/1806383725 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc0d8155f50 msgr2=0x7fc0d8150660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:55.743 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:55.741+0000 7fc0e03e8640 1 --2- 172.21.15.92:0/1806383725 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc0d8155f50 0x7fc0d8150660 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fc0c800b3f0 tx=0x7fc0c800b8b0 comp rx=0 tx=0).stop 2024-09-11T00:14:55.743 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:55.741+0000 7fc0e03e8640 1 -- 172.21.15.92:0/1806383725 shutdown_connections 2024-09-11T00:14:55.743 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:55.741+0000 7fc0e03e8640 1 --2- 172.21.15.92:0/1806383725 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7fc0bc077f70 0x7fc0bc07a430 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:55.743 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:55.741+0000 7fc0e03e8640 1 --2- 172.21.15.92:0/1806383725 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc0d8156330 0x7fc0d80729a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:55.743 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:55.741+0000 7fc0e03e8640 1 --2- 172.21.15.92:0/1806383725 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc0d8155f50 0x7fc0d8150660 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:55.743 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:55.741+0000 7fc0e03e8640 1 --2- 172.21.15.92:0/1806383725 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc0d8074a40 0x7fc0d80aeb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:55.743 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:55.741+0000 7fc0e03e8640 1 -- 172.21.15.92:0/1806383725 >> 172.21.15.92:0/1806383725 conn(0x7fc0d80b1c80 msgr2=0x7fc0d80cf4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:14:55.743 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:55.741+0000 7fc0e03e8640 1 -- 172.21.15.92:0/1806383725 shutdown_connections 2024-09-11T00:14:55.743 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:55.741+0000 7fc0e03e8640 1 -- 172.21.15.92:0/1806383725 wait complete. 2024-09-11T00:14:55.754 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config dump 2024-09-11T00:14:55.854 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:55.852+0000 7f57eb2dd640 1 -- 172.21.15.92:0/466563153 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f57e4072680 msgr2=0x7f57e40ceb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:55.854 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:55.852+0000 7f57eb2dd640 1 --2- 172.21.15.92:0/466563153 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f57e4072680 0x7f57e40ceb00 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f57e40b2fc0 tx=0x7f57e002a4a0 comp rx=0 tx=0).stop 2024-09-11T00:14:55.855 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:55.852+0000 7f57eb2dd640 1 -- 172.21.15.92:0/466563153 shutdown_connections 2024-09-11T00:14:55.855 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:55.852+0000 7f57eb2dd640 1 --2- 172.21.15.92:0/466563153 >> v2:172.21.15.145:3300/0 conn(0x7f57e4072ad0 0x7f57e40cf040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:55.855 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:55.852+0000 7f57eb2dd640 1 --2- 172.21.15.92:0/466563153 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f57e4072680 0x7f57e40ceb00 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:55.855 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:55.852+0000 7f57eb2dd640 1 -- 172.21.15.92:0/466563153 >> 172.21.15.92:0/466563153 conn(0x7f57e40b1760 msgr2=0x7f57e40b1b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:14:55.855 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:55.852+0000 7f57eb2dd640 1 -- 172.21.15.92:0/466563153 shutdown_connections 2024-09-11T00:14:55.855 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:55.852+0000 7f57eb2dd640 1 -- 172.21.15.92:0/466563153 wait complete. 2024-09-11T00:14:55.857 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:55.853+0000 7f57eb2dd640 1 Processor -- start 2024-09-11T00:14:55.857 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:55.854+0000 7f57eb2dd640 1 -- start start 2024-09-11T00:14:55.858 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:55.854+0000 7f57eb2dd640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f57e4072680 0x7f57e413e210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:55.858 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:55.854+0000 7f57eb2dd640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f57e4072ad0 0x7f57e415b460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:55.858 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:55.854+0000 7f57eb2dd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f57e4144780 0x7f57e4139340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:55.858 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:55.854+0000 7f57eb2dd640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f57e415c8e0 con 0x7f57e4144780 2024-09-11T00:14:55.858 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:55.854+0000 7f57eb2dd640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f57e415c760 con 0x7f57e4072680 2024-09-11T00:14:55.858 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:55.854+0000 7f57eb2dd640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f57e415ca60 con 0x7f57e4072ad0 2024-09-11T00:14:55.858 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:55.854+0000 7f57e987a640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f57e4144780 0x7f57e4139340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:55.858 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:55.854+0000 7f57e987a640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f57e4144780 0x7f57e4139340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:43540/0 (socket says 172.21.15.92:43540) 2024-09-11T00:14:55.858 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:55.854+0000 7f57e987a640 1 -- 172.21.15.92:0/1651133560 learned_addr learned my addr 172.21.15.92:0/1651133560 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-11T00:14:55.858 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:55.855+0000 7f57e9079640 1 --2- 172.21.15.92:0/1651133560 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f57e4072680 0x7f57e413e210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:55.858 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:55.855+0000 7f57e8878640 1 --2- 172.21.15.92:0/1651133560 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f57e4072ad0 0x7f57e415b460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:55.858 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:55.855+0000 7f57e987a640 1 -- 172.21.15.92:0/1651133560 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f57e4072ad0 msgr2=0x7f57e415b460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:55.858 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:55.855+0000 7f57e987a640 1 --2- 172.21.15.92:0/1651133560 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f57e4072ad0 0x7f57e415b460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:55.859 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:55.855+0000 7f57e987a640 1 -- 172.21.15.92:0/1651133560 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f57e4072680 msgr2=0x7f57e413e210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:55.859 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:55.855+0000 7f57e987a640 1 --2- 172.21.15.92:0/1651133560 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f57e4072680 0x7f57e413e210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:55.859 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:55.855+0000 7f57e987a640 1 -- 172.21.15.92:0/1651133560 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57e41f8b40 con 0x7f57e4144780 2024-09-11T00:14:55.859 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:55.855+0000 7f57e9079640 1 --2- 172.21.15.92:0/1651133560 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f57e4072680 0x7f57e413e210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:14:55.859 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:55.855+0000 7f57e8878640 1 --2- 172.21.15.92:0/1651133560 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f57e4072ad0 0x7f57e415b460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:14:55.859 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:55.855+0000 7f57e987a640 1 --2- 172.21.15.92:0/1651133560 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f57e4144780 0x7f57e4139340 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f57dc00eaa0 tx=0x7f57dc00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:14:55.859 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:55.855+0000 7f57d5ffb640 1 -- 172.21.15.92:0/1651133560 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57dc00cdb0 con 0x7f57e4144780 2024-09-11T00:14:55.859 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:55.855+0000 7f57d5ffb640 1 -- 172.21.15.92:0/1651133560 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f57dc004c10 con 0x7f57e4144780 2024-09-11T00:14:55.859 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:55.855+0000 7f57eb2dd640 1 -- 172.21.15.92:0/1651133560 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f57e41f8e20 con 0x7f57e4144780 2024-09-11T00:14:55.859 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:55.855+0000 7f57d5ffb640 1 -- 172.21.15.92:0/1651133560 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57dc005020 con 0x7f57e4144780 2024-09-11T00:14:55.859 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:55.855+0000 7f57eb2dd640 1 -- 172.21.15.92:0/1651133560 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f57e413e750 con 0x7f57e4144780 2024-09-11T00:14:55.859 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:55.856+0000 7f57eb2dd640 1 -- 172.21.15.92:0/1651133560 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f57e41f9210 con 0x7f57e4144780 2024-09-11T00:14:55.860 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:55.857+0000 7f57d5ffb640 1 -- 172.21.15.92:0/1651133560 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f57dc00f040 con 0x7f57e4144780 2024-09-11T00:14:55.860 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:55.857+0000 7f57d5ffb640 1 --2- 172.21.15.92:0/1651133560 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f57c8077f70 0x7f57c807a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:55.860 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:55.857+0000 7f57d5ffb640 1 -- 172.21.15.92:0/1651133560 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f57dc09a690 con 0x7f57e4144780 2024-09-11T00:14:55.860 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:55.857+0000 7f57e9079640 1 --2- 172.21.15.92:0/1651133560 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f57c8077f70 0x7f57c807a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:55.861 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:55.858+0000 7f57e9079640 1 --2- 172.21.15.92:0/1651133560 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f57c8077f70 0x7f57c807a430 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f57d8000f60 tx=0x7f57d8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:14:55.863 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:55.861+0000 7f57d5ffb640 1 -- 172.21.15.92:0/1651133560 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f57dc016030 con 0x7f57e4144780 2024-09-11T00:14:56.037 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:56.035+0000 7f57eb2dd640 1 -- 172.21.15.92:0/1651133560 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "config dump"} v 0) -- 0x7f57e4073d60 con 0x7f57e4144780 2024-09-11T00:14:56.037 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:56.036+0000 7f57d5ffb640 1 -- 172.21.15.92:0/1651133560 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "config dump"}]=0 v27) ==== 59+0+1998 (secure 0 0 0) 0x7f57e4073d60 con 0x7f57e4144780 2024-09-11T00:14:56.038 INFO:teuthology.orchestra.run.smithi092.stdout:WHO MASK LEVEL OPTION VALUE RO 2024-09-11T00:14:56.038 INFO:teuthology.orchestra.run.smithi092.stdout:mon advanced mon_op_complaint_time 120 2024-09-11T00:14:56.038 INFO:teuthology.orchestra.run.smithi092.stdout:mon dev mon_warn_on_pool_no_app false 2024-09-11T00:14:56.038 INFO:teuthology.orchestra.run.smithi092.stdout:osd advanced osd_op_complaint_time 180.000000 2024-09-11T00:14:56.038 INFO:teuthology.orchestra.run.smithi092.stdout:osd.0 basic osd_mclock_max_capacity_iops_ssd 5691.804323 2024-09-11T00:14:56.038 INFO:teuthology.orchestra.run.smithi092.stdout:osd.1 basic osd_mclock_max_capacity_iops_ssd 5711.346264 2024-09-11T00:14:56.038 INFO:teuthology.orchestra.run.smithi092.stdout:osd.2 basic osd_mclock_max_capacity_iops_ssd 5625.493799 2024-09-11T00:14:56.038 INFO:teuthology.orchestra.run.smithi092.stdout:osd.3 basic osd_mclock_max_capacity_iops_ssd 5406.973116 2024-09-11T00:14:56.038 INFO:teuthology.orchestra.run.smithi092.stdout:osd.4 basic osd_mclock_max_capacity_iops_ssd 9313.333595 2024-09-11T00:14:56.039 INFO:teuthology.orchestra.run.smithi092.stdout:osd.5 basic osd_mclock_max_capacity_iops_ssd 5731.268445 2024-09-11T00:14:56.039 INFO:teuthology.orchestra.run.smithi092.stdout:osd.6 basic osd_mclock_max_capacity_iops_ssd 9358.961956 2024-09-11T00:14:56.039 INFO:teuthology.orchestra.run.smithi092.stdout:osd.7 basic osd_mclock_max_capacity_iops_ssd 6465.244795 2024-09-11T00:14:56.039 INFO:teuthology.orchestra.run.smithi092.stdout:mds advanced debug_mds 20/20 2024-09-11T00:14:56.039 INFO:teuthology.orchestra.run.smithi092.stdout:mds advanced debug_mds_balancer 20/20 2024-09-11T00:14:56.039 INFO:teuthology.orchestra.run.smithi092.stdout:mds advanced debug_ms 2/2 2024-09-11T00:14:56.039 INFO:teuthology.orchestra.run.smithi092.stdout:mds dev mds_debug_frag true 2024-09-11T00:14:56.039 INFO:teuthology.orchestra.run.smithi092.stdout:mds dev mds_debug_scatterstat true 2024-09-11T00:14:56.039 INFO:teuthology.orchestra.run.smithi092.stdout:mds advanced mds_op_complaint_time 180.000000 2024-09-11T00:14:56.039 INFO:teuthology.orchestra.run.smithi092.stdout:mds dev mds_verify_scatter true 2024-09-11T00:14:56.039 INFO:teuthology.orchestra.run.smithi092.stdout:mds advanced osd_op_complaint_time 180.000000 2024-09-11T00:14:56.039 INFO:teuthology.orchestra.run.smithi092.stdout:mds advanced rados_mon_op_timeout 900 2024-09-11T00:14:56.039 INFO:teuthology.orchestra.run.smithi092.stdout:mds advanced rados_osd_op_timeout 900 2024-09-11T00:14:56.039 INFO:teuthology.orchestra.run.smithi092.stdout:client advanced client_mount_timeout 600 2024-09-11T00:14:56.040 INFO:teuthology.orchestra.run.smithi092.stdout:client advanced debug_client 20/20 2024-09-11T00:14:56.040 INFO:teuthology.orchestra.run.smithi092.stdout:client advanced debug_ms 1/1 2024-09-11T00:14:56.040 INFO:teuthology.orchestra.run.smithi092.stdout:client advanced rados_mon_op_timeout 900 2024-09-11T00:14:56.040 INFO:teuthology.orchestra.run.smithi092.stdout:client advanced rados_osd_op_timeout 900 2024-09-11T00:14:56.041 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:56.038+0000 7f57eb2dd640 1 -- 172.21.15.92:0/1651133560 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f57c8077f70 msgr2=0x7f57c807a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:56.041 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:56.038+0000 7f57eb2dd640 1 --2- 172.21.15.92:0/1651133560 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f57c8077f70 0x7f57c807a430 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f57d8000f60 tx=0x7f57d8009040 comp rx=0 tx=0).stop 2024-09-11T00:14:56.041 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:56.038+0000 7f57eb2dd640 1 -- 172.21.15.92:0/1651133560 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f57e4144780 msgr2=0x7f57e4139340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:56.041 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:56.038+0000 7f57eb2dd640 1 --2- 172.21.15.92:0/1651133560 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f57e4144780 0x7f57e4139340 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f57dc00eaa0 tx=0x7f57dc00ef60 comp rx=0 tx=0).stop 2024-09-11T00:14:56.041 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:56.038+0000 7f57eb2dd640 1 -- 172.21.15.92:0/1651133560 shutdown_connections 2024-09-11T00:14:56.041 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:56.038+0000 7f57eb2dd640 1 --2- 172.21.15.92:0/1651133560 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f57c8077f70 0x7f57c807a430 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:56.041 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:56.038+0000 7f57eb2dd640 1 --2- 172.21.15.92:0/1651133560 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f57e4144780 0x7f57e4139340 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:56.041 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:56.038+0000 7f57eb2dd640 1 --2- 172.21.15.92:0/1651133560 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f57e4072ad0 0x7f57e415b460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:56.041 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:56.038+0000 7f57eb2dd640 1 --2- 172.21.15.92:0/1651133560 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f57e4072680 0x7f57e413e210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:56.042 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:56.038+0000 7f57eb2dd640 1 -- 172.21.15.92:0/1651133560 >> 172.21.15.92:0/1651133560 conn(0x7f57e40b1760 msgr2=0x7f57e415dfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:14:56.042 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:56.038+0000 7f57eb2dd640 1 -- 172.21.15.92:0/1651133560 shutdown_connections 2024-09-11T00:14:56.042 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:56.038+0000 7f57eb2dd640 1 -- 172.21.15.92:0/1651133560 wait complete. 2024-09-11T00:14:56.050 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-11T00:14:56.154 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:56.152+0000 7f727dd00640 1 -- 172.21.15.92:0/1936768941 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7260004b90 msgr2=0x7f7260004fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:56.154 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:56.152+0000 7f727dd00640 1 --2- 172.21.15.92:0/1936768941 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7260004b90 0x7f7260004fb0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f726800c4a0 tx=0x7f7260006940 comp rx=0 tx=0).stop 2024-09-11T00:14:56.154 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:56.152+0000 7f7277fff640 1 -- 172.21.15.92:0/1936768941 reap_dead start 2024-09-11T00:14:56.155 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:56.152+0000 7f727dd00640 1 -- 172.21.15.92:0/1936768941 shutdown_connections 2024-09-11T00:14:56.155 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:56.152+0000 7f727dd00640 1 -- 172.21.15.92:0/1936768941 >> 172.21.15.92:0/1936768941 conn(0x7f72780b1760 msgr2=0x7f72780b1b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:14:56.155 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:56.152+0000 7f727dd00640 1 -- 172.21.15.92:0/1936768941 shutdown_connections 2024-09-11T00:14:56.155 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:56.152+0000 7f727dd00640 1 -- 172.21.15.92:0/1936768941 wait complete. 2024-09-11T00:14:56.158 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:56.153+0000 7f727dd00640 1 Processor -- start 2024-09-11T00:14:56.159 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:56.153+0000 7f727dd00640 1 -- start start 2024-09-11T00:14:56.159 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:56.154+0000 7f727dd00640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7260004b90 0x7f7278141c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:56.159 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:56.154+0000 7f727dd00640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f727814d6a0 0x7f72781445d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:56.159 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:56.154+0000 7f727dd00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7278159450 0x7f72781598e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:56.159 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:56.154+0000 7f727dd00640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f72780b3f10 con 0x7f727814d6a0 2024-09-11T00:14:56.159 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:56.154+0000 7f727dd00640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f72780b3d90 con 0x7f7278159450 2024-09-11T00:14:56.159 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:56.154+0000 7f727dd00640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f72780cf450 con 0x7f7260004b90 2024-09-11T00:14:56.159 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:56.154+0000 7f7276ffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f727814d6a0 0x7f72781445d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:56.159 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:56.154+0000 7f7276ffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f727814d6a0 0x7f72781445d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:43562/0 (socket says 172.21.15.92:43562) 2024-09-11T00:14:56.160 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:56.154+0000 7f7276ffd640 1 -- 172.21.15.92:0/794525487 learned_addr learned my addr 172.21.15.92:0/794525487 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-11T00:14:56.160 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:56.154+0000 7f72777fe640 1 --2- 172.21.15.92:0/794525487 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7260004b90 0x7f7278141c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:56.160 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:56.154+0000 7f7277fff640 1 --2- 172.21.15.92:0/794525487 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7278159450 0x7f72781598e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:56.160 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:56.155+0000 7f7276ffd640 1 -- 172.21.15.92:0/794525487 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7260004b90 msgr2=0x7f7278141c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:56.160 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:56.155+0000 7f7276ffd640 1 --2- 172.21.15.92:0/794525487 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7260004b90 0x7f7278141c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:56.160 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:56.155+0000 7f7276ffd640 1 -- 172.21.15.92:0/794525487 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7278159450 msgr2=0x7f72781598e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:56.160 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:56.155+0000 7f7276ffd640 1 --2- 172.21.15.92:0/794525487 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7278159450 0x7f72781598e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:56.160 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:56.155+0000 7f7276ffd640 1 -- 172.21.15.92:0/794525487 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72781454e0 con 0x7f727814d6a0 2024-09-11T00:14:56.161 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:56.155+0000 7f7276ffd640 1 --2- 172.21.15.92:0/794525487 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f727814d6a0 0x7f72781445d0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f726c004e90 tx=0x7f726c001630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:14:56.161 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:56.155+0000 7f725ffff640 1 -- 172.21.15.92:0/794525487 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f726c015020 con 0x7f727814d6a0 2024-09-11T00:14:56.161 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:56.155+0000 7f725ffff640 1 -- 172.21.15.92:0/794525487 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f726c011960 con 0x7f727814d6a0 2024-09-11T00:14:56.161 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:56.155+0000 7f727dd00640 1 -- 172.21.15.92:0/794525487 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7278144f20 con 0x7f727814d6a0 2024-09-11T00:14:56.161 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:56.155+0000 7f725ffff640 1 -- 172.21.15.92:0/794525487 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f726c011d70 con 0x7f727814d6a0 2024-09-11T00:14:56.161 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:56.155+0000 7f727dd00640 1 -- 172.21.15.92:0/794525487 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72781425e0 con 0x7f727814d6a0 2024-09-11T00:14:56.161 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:56.156+0000 7f727dd00640 1 -- 172.21.15.92:0/794525487 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f72780b4a50 con 0x7f727814d6a0 2024-09-11T00:14:56.161 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:56.156+0000 7f725ffff640 1 -- 172.21.15.92:0/794525487 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f726c01a400 con 0x7f727814d6a0 2024-09-11T00:14:56.161 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:56.157+0000 7f725ffff640 1 --2- 172.21.15.92:0/794525487 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f7264077f70 0x7f726407a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:56.161 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:56.157+0000 7f725ffff640 1 -- 172.21.15.92:0/794525487 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f726c09ac70 con 0x7f727814d6a0 2024-09-11T00:14:56.162 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:56.157+0000 7f72777fe640 1 --2- 172.21.15.92:0/794525487 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f7264077f70 0x7f726407a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:56.162 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:56.158+0000 7f72777fe640 1 --2- 172.21.15.92:0/794525487 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f7264077f70 0x7f726407a430 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f726800c4a0 tx=0x7f7268001b00 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:14:56.163 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:56.161+0000 7f725ffff640 1 -- 172.21.15.92:0/794525487 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f726c01f020 con 0x7f727814d6a0 2024-09-11T00:14:56.337 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:56.335+0000 7f727dd00640 1 -- 172.21.15.92:0/794525487 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f72780b1be0 con 0x7f727814d6a0 2024-09-11T00:14:56.340 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:56.338+0000 7f725ffff640 1 -- 172.21.15.92:0/794525487 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v28)=0 v28) ==== 122+0+0 (secure 0 0 0) 0x7f726c062de0 con 0x7f727814d6a0 2024-09-11T00:14:56.342 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:56.341+0000 7f727dd00640 1 -- 172.21.15.92:0/794525487 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f7264077f70 msgr2=0x7f726407a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:56.342 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:56.341+0000 7f727dd00640 1 --2- 172.21.15.92:0/794525487 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f7264077f70 0x7f726407a430 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f726800c4a0 tx=0x7f7268001b00 comp rx=0 tx=0).stop 2024-09-11T00:14:56.343 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:56.341+0000 7f727dd00640 1 -- 172.21.15.92:0/794525487 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f727814d6a0 msgr2=0x7f72781445d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:56.343 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:56.341+0000 7f727dd00640 1 --2- 172.21.15.92:0/794525487 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f727814d6a0 0x7f72781445d0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f726c004e90 tx=0x7f726c001630 comp rx=0 tx=0).stop 2024-09-11T00:14:56.343 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:56.341+0000 7f727dd00640 1 -- 172.21.15.92:0/794525487 shutdown_connections 2024-09-11T00:14:56.343 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:56.341+0000 7f727dd00640 1 --2- 172.21.15.92:0/794525487 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f7264077f70 0x7f726407a430 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:56.343 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:56.341+0000 7f727dd00640 1 --2- 172.21.15.92:0/794525487 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7278159450 0x7f72781598e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:56.343 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:56.341+0000 7f727dd00640 1 --2- 172.21.15.92:0/794525487 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f727814d6a0 0x7f72781445d0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:56.343 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:56.341+0000 7f727dd00640 1 --2- 172.21.15.92:0/794525487 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7260004b90 0x7f7278141c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:56.343 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:56.341+0000 7f727dd00640 1 -- 172.21.15.92:0/794525487 >> 172.21.15.92:0/794525487 conn(0x7f72780b1760 msgr2=0x7f72781548b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:14:56.343 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:56.341+0000 7f727dd00640 1 -- 172.21.15.92:0/794525487 shutdown_connections 2024-09-11T00:14:56.343 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:56.341+0000 7f727dd00640 1 -- 172.21.15.92:0/794525487 wait complete. 2024-09-11T00:14:56.353 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-11T00:14:56.353 DEBUG:teuthology.orchestra.run.smithi092:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-11T00:14:56.390 DEBUG:teuthology.orchestra.run.smithi145:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-11T00:14:56.431 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-11T00:14:56.431 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2024-09-11T00:14:56.431 DEBUG:teuthology.orchestra.run.smithi092:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T00:14:56.447 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2024-09-11T00:14:56.448 DEBUG:teuthology.orchestra.run.smithi092:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T00:14:56.503 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2024-09-11T00:14:56.503 DEBUG:teuthology.orchestra.run.smithi092:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T00:14:56.561 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-11T00:14:56.702 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:56.700+0000 7fc957364640 1 -- 172.21.15.92:0/916151135 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc9380051c0 msgr2=0x7fc93800b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:56.702 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:56.700+0000 7fc957364640 1 --2- 172.21.15.92:0/916151135 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc9380051c0 0x7fc93800b9c0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fc948006fa0 tx=0x7fc938005830 comp rx=0 tx=0).stop 2024-09-11T00:14:56.702 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:56.700+0000 7fc957364640 1 -- 172.21.15.92:0/916151135 shutdown_connections 2024-09-11T00:14:56.703 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:56.700+0000 7fc957364640 1 --2- 172.21.15.92:0/916151135 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc9380051c0 0x7fc93800b9c0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:56.703 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:56.700+0000 7fc957364640 1 -- 172.21.15.92:0/916151135 >> 172.21.15.92:0/916151135 conn(0x7fc950074150 msgr2=0x7fc950074560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:14:56.703 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:56.700+0000 7fc957364640 1 -- 172.21.15.92:0/916151135 shutdown_connections 2024-09-11T00:14:56.703 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:56.700+0000 7fc957364640 1 -- 172.21.15.92:0/916151135 wait complete. 2024-09-11T00:14:56.703 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:56.702+0000 7fc957364640 1 Processor -- start 2024-09-11T00:14:56.703 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:56.702+0000 7fc957364640 1 -- start start 2024-09-11T00:14:56.705 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:56.702+0000 7fc957364640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc9380051c0 0x7fc9501f5000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:56.705 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:56.702+0000 7fc957364640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc9500c8440 0x7fc95009da80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:56.706 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:56.702+0000 7fc957364640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc950070040 0x7fc9500704a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:56.706 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:56.702+0000 7fc957364640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fc9500b1210 con 0x7fc9380051c0 2024-09-11T00:14:56.706 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:56.702+0000 7fc957364640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fc950069680 con 0x7fc9500c8440 2024-09-11T00:14:56.706 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:56.702+0000 7fc957364640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7fc9500b1390 con 0x7fc950070040 2024-09-11T00:14:56.706 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:56.702+0000 7fc955100640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc9380051c0 0x7fc9501f5000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:56.706 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:56.702+0000 7fc955100640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc9380051c0 0x7fc9501f5000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:43582/0 (socket says 172.21.15.92:43582) 2024-09-11T00:14:56.706 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:56.702+0000 7fc955100640 1 -- 172.21.15.92:0/1590367311 learned_addr learned my addr 172.21.15.92:0/1590367311 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-11T00:14:56.706 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:56.703+0000 7fc9548ff640 1 --2- 172.21.15.92:0/1590367311 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc9500c8440 0x7fc95009da80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:56.706 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:56.703+0000 7fc955901640 1 --2- 172.21.15.92:0/1590367311 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc950070040 0x7fc9500704a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:56.706 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:56.703+0000 7fc955100640 1 -- 172.21.15.92:0/1590367311 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc950070040 msgr2=0x7fc9500704a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:56.706 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:56.703+0000 7fc955100640 1 --2- 172.21.15.92:0/1590367311 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc950070040 0x7fc9500704a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:56.706 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:56.703+0000 7fc955100640 1 -- 172.21.15.92:0/1590367311 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc9500c8440 msgr2=0x7fc95009da80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:56.707 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:56.703+0000 7fc955100640 1 --2- 172.21.15.92:0/1590367311 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc9500c8440 0x7fc95009da80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:56.707 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:56.703+0000 7fc955100640 1 -- 172.21.15.92:0/1590367311 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9501f5540 con 0x7fc9380051c0 2024-09-11T00:14:56.707 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:56.703+0000 7fc9548ff640 1 --2- 172.21.15.92:0/1590367311 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc9500c8440 0x7fc95009da80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:14:56.707 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:56.703+0000 7fc955100640 1 --2- 172.21.15.92:0/1590367311 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc9380051c0 0x7fc9501f5000 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fc940003fd0 tx=0x7fc9400064f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:14:56.707 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:56.703+0000 7fc94dffb640 1 -- 172.21.15.92:0/1590367311 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc940015070 con 0x7fc9380051c0 2024-09-11T00:14:56.707 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:56.703+0000 7fc94dffb640 1 -- 172.21.15.92:0/1590367311 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc94000fa60 con 0x7fc9380051c0 2024-09-11T00:14:56.707 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:56.703+0000 7fc957364640 1 -- 172.21.15.92:0/1590367311 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9500c89c0 con 0x7fc9380051c0 2024-09-11T00:14:56.707 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:56.703+0000 7fc94dffb640 1 -- 172.21.15.92:0/1590367311 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc940011430 con 0x7fc9380051c0 2024-09-11T00:14:56.707 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:56.703+0000 7fc957364640 1 -- 172.21.15.92:0/1590367311 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9500c8f80 con 0x7fc9380051c0 2024-09-11T00:14:56.707 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:56.704+0000 7fc957364640 1 -- 172.21.15.92:0/1590367311 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc95006ca50 con 0x7fc9380051c0 2024-09-11T00:14:56.708 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:56.705+0000 7fc94dffb640 1 -- 172.21.15.92:0/1590367311 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fc9400115d0 con 0x7fc9380051c0 2024-09-11T00:14:56.708 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:56.705+0000 7fc94dffb640 1 --2- 172.21.15.92:0/1590367311 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7fc93c077f70 0x7fc93c07a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:56.708 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:56.706+0000 7fc94dffb640 1 -- 172.21.15.92:0/1590367311 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fc94009ae80 con 0x7fc9380051c0 2024-09-11T00:14:56.708 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:56.706+0000 7fc9548ff640 1 --2- 172.21.15.92:0/1590367311 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7fc93c077f70 0x7fc93c07a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:56.709 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:56.706+0000 7fc9548ff640 1 --2- 172.21.15.92:0/1590367311 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7fc93c077f70 0x7fc93c07a430 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fc9500b5e40 tx=0x7fc944005f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:14:56.711 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:56.709+0000 7fc94dffb640 1 -- 172.21.15.92:0/1590367311 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fc9501f5540 con 0x7fc9380051c0 2024-09-11T00:14:56.899 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:56.896+0000 7fc957364640 1 -- 172.21.15.92:0/1590367311 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fc9500cdd40 con 0x7fc9380051c0 2024-09-11T00:14:56.899 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:56.897+0000 7fc94dffb640 1 -- 172.21.15.92:0/1590367311 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v25) ==== 80+0+0 (secure 0 0 0) 0x7fc9400636d0 con 0x7fc9380051c0 2024-09-11T00:14:56.899 INFO:teuthology.orchestra.run.smithi092.stderr:listed 0 entries 2024-09-11T00:14:56.901 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:56.899+0000 7fc957364640 1 -- 172.21.15.92:0/1590367311 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7fc93c077f70 msgr2=0x7fc93c07a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:56.901 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:56.899+0000 7fc957364640 1 --2- 172.21.15.92:0/1590367311 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7fc93c077f70 0x7fc93c07a430 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fc9500b5e40 tx=0x7fc944005f90 comp rx=0 tx=0).stop 2024-09-11T00:14:56.901 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:56.899+0000 7fc957364640 1 -- 172.21.15.92:0/1590367311 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc9380051c0 msgr2=0x7fc9501f5000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:56.901 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:56.899+0000 7fc957364640 1 --2- 172.21.15.92:0/1590367311 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc9380051c0 0x7fc9501f5000 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fc940003fd0 tx=0x7fc9400064f0 comp rx=0 tx=0).stop 2024-09-11T00:14:56.901 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:56.899+0000 7fc957364640 1 -- 172.21.15.92:0/1590367311 shutdown_connections 2024-09-11T00:14:56.902 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:56.899+0000 7fc957364640 1 --2- 172.21.15.92:0/1590367311 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7fc93c077f70 0x7fc93c07a430 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:56.902 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:56.899+0000 7fc957364640 1 --2- 172.21.15.92:0/1590367311 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc950070040 0x7fc9500704a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:56.902 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:56.899+0000 7fc957364640 1 --2- 172.21.15.92:0/1590367311 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc9500c8440 0x7fc95009da80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:56.902 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:56.899+0000 7fc957364640 1 --2- 172.21.15.92:0/1590367311 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc9380051c0 0x7fc9501f5000 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:56.902 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:56.899+0000 7fc957364640 1 -- 172.21.15.92:0/1590367311 >> 172.21.15.92:0/1590367311 conn(0x7fc950074150 msgr2=0x7fc9500ce2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:14:56.902 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:56.899+0000 7fc957364640 1 -- 172.21.15.92:0/1590367311 shutdown_connections 2024-09-11T00:14:56.903 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:56.899+0000 7fc957364640 1 -- 172.21.15.92:0/1590367311 wait complete. 2024-09-11T00:14:56.911 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-11T00:14:56.911 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T00:14:56.911 DEBUG:teuthology.orchestra.run.smithi092:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2024-09-11T00:14:56.937 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi092.front.sepia.ceph.com 2024-09-11T00:14:56.937 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T00:14:56.938 DEBUG:teuthology.orchestra.run.smithi092:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-11T00:14:56.993 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2024-09-11T00:14:56.993 DEBUG:teuthology.orchestra.run.smithi145:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T00:14:57.013 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2024-09-11T00:14:57.013 DEBUG:teuthology.orchestra.run.smithi145:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T00:14:57.071 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2024-09-11T00:14:57.072 DEBUG:teuthology.orchestra.run.smithi145:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T00:14:57.130 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-11T00:14:57.232 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:57.230+0000 7fabb4c39640 1 -- 172.21.15.92:0/1882259308 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fabb015c470 msgr2=0x7fabb015c8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:57.233 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:57.230+0000 7fabb4c39640 1 --2- 172.21.15.92:0/1882259308 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fabb015c470 0x7fabb015c8e0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fab98005fd0 tx=0x7fab9802a5d0 comp rx=0 tx=0).stop 2024-09-11T00:14:57.233 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:57.230+0000 7fabb4c39640 1 -- 172.21.15.92:0/1882259308 shutdown_connections 2024-09-11T00:14:57.233 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:57.230+0000 7fabb4c39640 1 --2- 172.21.15.92:0/1882259308 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fabb015c470 0x7fabb015c8e0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:57.233 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:57.230+0000 7fabb4c39640 1 -- 172.21.15.92:0/1882259308 >> 172.21.15.92:0/1882259308 conn(0x7fabb00b1760 msgr2=0x7fabb00b1b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:14:57.233 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:57.230+0000 7fabb4c39640 1 -- 172.21.15.92:0/1882259308 shutdown_connections 2024-09-11T00:14:57.233 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:57.230+0000 7fabb4c39640 1 -- 172.21.15.92:0/1882259308 wait complete. 2024-09-11T00:14:57.235 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:57.232+0000 7fabb4c39640 1 Processor -- start 2024-09-11T00:14:57.235 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:57.232+0000 7fabb4c39640 1 -- start start 2024-09-11T00:14:57.235 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:57.232+0000 7fabb4c39640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fabb006f140 0x7fabb0152320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:57.236 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:57.232+0000 7fabb4c39640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fabb0073780 0x7fabb01e53a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:57.236 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:57.233+0000 7fabb4c39640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fabb015c470 0x7fabb015aca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:57.236 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:57.233+0000 7fabb4c39640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fabb006fe60 con 0x7fabb015c470 2024-09-11T00:14:57.236 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:57.233+0000 7fabb4c39640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fabb006fce0 con 0x7fabb006f140 2024-09-11T00:14:57.236 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:57.233+0000 7fabb4c39640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7fabb006ffe0 con 0x7fabb0073780 2024-09-11T00:14:57.236 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:57.233+0000 7fabaed9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fabb015c470 0x7fabb015aca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:57.236 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:57.233+0000 7fabaed9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fabb015c470 0x7fabb015aca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:43598/0 (socket says 172.21.15.92:43598) 2024-09-11T00:14:57.237 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:57.233+0000 7fabaed9d640 1 -- 172.21.15.92:0/638802891 learned_addr learned my addr 172.21.15.92:0/638802891 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-11T00:14:57.237 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:57.233+0000 7fabae59c640 1 --2- 172.21.15.92:0/638802891 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fabb006f140 0x7fabb0152320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:57.237 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:57.233+0000 7faba7fff640 1 --2- 172.21.15.92:0/638802891 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fabb0073780 0x7fabb01e53a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:57.237 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:57.233+0000 7fabaed9d640 1 -- 172.21.15.92:0/638802891 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fabb0073780 msgr2=0x7fabb01e53a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:57.237 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:57.233+0000 7fabaed9d640 1 --2- 172.21.15.92:0/638802891 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fabb0073780 0x7fabb01e53a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:57.237 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:57.233+0000 7fabaed9d640 1 -- 172.21.15.92:0/638802891 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fabb006f140 msgr2=0x7fabb0152320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:57.237 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:57.233+0000 7fabaed9d640 1 --2- 172.21.15.92:0/638802891 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fabb006f140 0x7fabb0152320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:57.237 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:57.233+0000 7fabaed9d640 1 -- 172.21.15.92:0/638802891 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fabb01e5e60 con 0x7fabb015c470 2024-09-11T00:14:57.237 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:57.233+0000 7faba7fff640 1 --2- 172.21.15.92:0/638802891 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fabb0073780 0x7fabb01e53a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:14:57.237 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:57.233+0000 7fabaed9d640 1 --2- 172.21.15.92:0/638802891 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fabb015c470 0x7fabb015aca0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7faba800c7b0 tx=0x7faba800cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:14:57.238 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:57.233+0000 7faba6ffd640 1 -- 172.21.15.92:0/638802891 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faba8004b60 con 0x7fabb015c470 2024-09-11T00:14:57.238 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:57.233+0000 7faba6ffd640 1 -- 172.21.15.92:0/638802891 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7faba8004df0 con 0x7fabb015c470 2024-09-11T00:14:57.238 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:57.233+0000 7fabb4c39640 1 -- 172.21.15.92:0/638802891 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fabb01f8350 con 0x7fabb015c470 2024-09-11T00:14:57.238 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:57.233+0000 7faba6ffd640 1 -- 172.21.15.92:0/638802891 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faba800aa30 con 0x7fabb015c470 2024-09-11T00:14:57.238 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:57.233+0000 7fabb4c39640 1 -- 172.21.15.92:0/638802891 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fabb0130c00 con 0x7fabb015c470 2024-09-11T00:14:57.239 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:57.234+0000 7fabb4c39640 1 -- 172.21.15.92:0/638802891 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fabb015c8e0 con 0x7fabb015c470 2024-09-11T00:14:57.239 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:57.235+0000 7faba6ffd640 1 -- 172.21.15.92:0/638802891 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7faba8023060 con 0x7fabb015c470 2024-09-11T00:14:57.239 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:57.235+0000 7faba6ffd640 1 --2- 172.21.15.92:0/638802891 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7fab90077f70 0x7fab9007a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:57.239 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:57.236+0000 7faba6ffd640 1 -- 172.21.15.92:0/638802891 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7faba809a210 con 0x7fabb015c470 2024-09-11T00:14:57.239 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:57.236+0000 7fabae59c640 1 --2- 172.21.15.92:0/638802891 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7fab90077f70 0x7fab9007a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:57.239 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:57.236+0000 7fabae59c640 1 --2- 172.21.15.92:0/638802891 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7fab90077f70 0x7fab9007a430 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7faba0000f60 tx=0x7faba0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:14:57.241 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:57.240+0000 7faba6ffd640 1 -- 172.21.15.92:0/638802891 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7faba8062a60 con 0x7fabb015c470 2024-09-11T00:14:57.426 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:57.425+0000 7fabb4c39640 1 -- 172.21.15.92:0/638802891 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fabb0070e70 con 0x7fabb015c470 2024-09-11T00:14:57.427 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:57.425+0000 7faba6ffd640 1 -- 172.21.15.92:0/638802891 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v25) ==== 80+0+0 (secure 0 0 0) 0x7faba8062360 con 0x7fabb015c470 2024-09-11T00:14:57.427 INFO:teuthology.orchestra.run.smithi092.stderr:listed 0 entries 2024-09-11T00:14:57.429 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:57.427+0000 7fabb4c39640 1 -- 172.21.15.92:0/638802891 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7fab90077f70 msgr2=0x7fab9007a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:57.429 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:57.427+0000 7fabb4c39640 1 --2- 172.21.15.92:0/638802891 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7fab90077f70 0x7fab9007a430 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7faba0000f60 tx=0x7faba0009040 comp rx=0 tx=0).stop 2024-09-11T00:14:57.430 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:57.427+0000 7fabb4c39640 1 -- 172.21.15.92:0/638802891 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fabb015c470 msgr2=0x7fabb015aca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:57.430 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:57.427+0000 7fabb4c39640 1 --2- 172.21.15.92:0/638802891 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fabb015c470 0x7fabb015aca0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7faba800c7b0 tx=0x7faba800cc70 comp rx=0 tx=0).stop 2024-09-11T00:14:57.430 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:57.427+0000 7fabb4c39640 1 -- 172.21.15.92:0/638802891 shutdown_connections 2024-09-11T00:14:57.430 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:57.427+0000 7fabb4c39640 1 --2- 172.21.15.92:0/638802891 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7fab90077f70 0x7fab9007a430 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:57.430 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:57.427+0000 7fabb4c39640 1 --2- 172.21.15.92:0/638802891 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fabb015c470 0x7fabb015aca0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:57.430 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:57.427+0000 7fabb4c39640 1 --2- 172.21.15.92:0/638802891 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fabb0073780 0x7fabb01e53a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:57.430 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:57.427+0000 7fabb4c39640 1 --2- 172.21.15.92:0/638802891 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fabb006f140 0x7fabb0152320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:57.430 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:57.427+0000 7fabb4c39640 1 -- 172.21.15.92:0/638802891 >> 172.21.15.92:0/638802891 conn(0x7fabb00b1760 msgr2=0x7fabb013f160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:14:57.430 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:57.427+0000 7fabb4c39640 1 -- 172.21.15.92:0/638802891 shutdown_connections 2024-09-11T00:14:57.430 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:57.427+0000 7fabb4c39640 1 -- 172.21.15.92:0/638802891 wait complete. 2024-09-11T00:14:57.440 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-09-11T00:14:57.440 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T00:14:57.440 DEBUG:teuthology.orchestra.run.smithi145:> sudo umount /home/ubuntu/cephtest/mnt.1 -f 2024-09-11T00:14:57.473 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi145.front.sepia.ceph.com 2024-09-11T00:14:57.473 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T00:14:57.473 DEBUG:teuthology.orchestra.run.smithi145:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-11T00:14:57.546 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2024-09-11T00:14:57.546 DEBUG:teuthology.orchestra.run.smithi092:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T00:14:57.564 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2024-09-11T00:14:57.564 DEBUG:teuthology.orchestra.run.smithi092:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T00:14:57.620 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2024-09-11T00:14:57.621 DEBUG:teuthology.orchestra.run.smithi092:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T00:14:57.678 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-11T00:14:57.822 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:57.819+0000 7fdfce018640 1 -- 172.21.15.92:0/4200699508 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdfc815c470 msgr2=0x7fdfc815c8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:57.822 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:57.819+0000 7fdfce018640 1 --2- 172.21.15.92:0/4200699508 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdfc815c470 0x7fdfc815c8e0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fdfc8076000 tx=0x7fdfbc02a560 comp rx=0 tx=0).stop 2024-09-11T00:14:57.822 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:57.819+0000 7fdfce018640 1 -- 172.21.15.92:0/4200699508 shutdown_connections 2024-09-11T00:14:57.823 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:57.819+0000 7fdfce018640 1 --2- 172.21.15.92:0/4200699508 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fdfc8072560 0x7fdfc80729f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:57.823 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:57.819+0000 7fdfce018640 1 --2- 172.21.15.92:0/4200699508 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdfc815c470 0x7fdfc815c8e0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:57.823 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:57.819+0000 7fdfce018640 1 --2- 172.21.15.92:0/4200699508 >> v2:172.21.15.145:3300/0 conn(0x7fdfc8073780 0x7fdfc8073b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:57.823 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:57.819+0000 7fdfce018640 1 -- 172.21.15.92:0/4200699508 >> 172.21.15.92:0/4200699508 conn(0x7fdfc80b1760 msgr2=0x7fdfc80b1b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:14:57.823 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:57.819+0000 7fdfce018640 1 -- 172.21.15.92:0/4200699508 shutdown_connections 2024-09-11T00:14:57.823 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:57.819+0000 7fdfce018640 1 -- 172.21.15.92:0/4200699508 wait complete. 2024-09-11T00:14:57.823 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:57.820+0000 7fdfce018640 1 Processor -- start 2024-09-11T00:14:57.823 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:57.820+0000 7fdfce018640 1 -- start start 2024-09-11T00:14:57.825 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:57.821+0000 7fdfce018640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fdfc8072560 0x7fdfc813d060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:57.825 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:57.821+0000 7fdfce018640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdfc8073780 0x7fdfc8155e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:57.825 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:57.821+0000 7fdfce018640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdfc815c470 0x7fdfc81f5180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:57.825 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:57.821+0000 7fdfce018640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fdfc815cfa0 con 0x7fdfc815c470 2024-09-11T00:14:57.825 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:57.821+0000 7fdfce018640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fdfc815ce20 con 0x7fdfc8073780 2024-09-11T00:14:57.826 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:57.821+0000 7fdfce018640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7fdfc8072f30 con 0x7fdfc8072560 2024-09-11T00:14:57.826 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:57.821+0000 7fdfc7fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdfc815c470 0x7fdfc81f5180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:57.826 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:57.821+0000 7fdfc7fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdfc815c470 0x7fdfc81f5180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:43624/0 (socket says 172.21.15.92:43624) 2024-09-11T00:14:57.826 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:57.821+0000 7fdfc7fff640 1 -- 172.21.15.92:0/208676155 learned_addr learned my addr 172.21.15.92:0/208676155 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-11T00:14:57.826 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:57.821+0000 7fdfc77fe640 1 --2- 172.21.15.92:0/208676155 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fdfc8072560 0x7fdfc813d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:57.826 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:57.821+0000 7fdfc6ffd640 1 --2- 172.21.15.92:0/208676155 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdfc8073780 0x7fdfc8155e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:57.826 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:57.822+0000 7fdfc7fff640 1 -- 172.21.15.92:0/208676155 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fdfc8072560 msgr2=0x7fdfc813d060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:57.826 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:57.822+0000 7fdfc7fff640 1 --2- 172.21.15.92:0/208676155 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fdfc8072560 0x7fdfc813d060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:57.826 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:57.822+0000 7fdfc7fff640 1 -- 172.21.15.92:0/208676155 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdfc8073780 msgr2=0x7fdfc8155e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:57.826 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:57.822+0000 7fdfc7fff640 1 --2- 172.21.15.92:0/208676155 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdfc8073780 0x7fdfc8155e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:57.826 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:57.822+0000 7fdfc7fff640 1 -- 172.21.15.92:0/208676155 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdfc8144630 con 0x7fdfc815c470 2024-09-11T00:14:57.826 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:57.822+0000 7fdfc6ffd640 1 --2- 172.21.15.92:0/208676155 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdfc8073780 0x7fdfc8155e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:14:57.826 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:57.822+0000 7fdfc77fe640 1 --2- 172.21.15.92:0/208676155 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fdfc8072560 0x7fdfc813d060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:14:57.826 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:57.822+0000 7fdfc7fff640 1 --2- 172.21.15.92:0/208676155 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdfc815c470 0x7fdfc81f5180 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fdfc000d750 tx=0x7fdfc000dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:14:57.827 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:57.822+0000 7fdfaffff640 1 -- 172.21.15.92:0/208676155 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfc0017070 con 0x7fdfc815c470 2024-09-11T00:14:57.827 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:57.822+0000 7fdfaffff640 1 -- 172.21.15.92:0/208676155 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdfc0009cc0 con 0x7fdfc815c470 2024-09-11T00:14:57.827 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:57.822+0000 7fdfaffff640 1 -- 172.21.15.92:0/208676155 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfc000de60 con 0x7fdfc815c470 2024-09-11T00:14:57.827 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:57.822+0000 7fdfce018640 1 -- 172.21.15.92:0/208676155 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdfc8144bf0 con 0x7fdfc815c470 2024-09-11T00:14:57.827 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:57.822+0000 7fdfce018640 1 -- 172.21.15.92:0/208676155 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdfc813d5a0 con 0x7fdfc815c470 2024-09-11T00:14:57.827 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:57.823+0000 7fdfce018640 1 -- 172.21.15.92:0/208676155 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdfc8073b60 con 0x7fdfc815c470 2024-09-11T00:14:57.827 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:57.824+0000 7fdfaffff640 1 -- 172.21.15.92:0/208676155 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fdfc0005280 con 0x7fdfc815c470 2024-09-11T00:14:57.828 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:57.824+0000 7fdfaffff640 1 --2- 172.21.15.92:0/208676155 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7fdfb4077f70 0x7fdfb407a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:57.828 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:57.824+0000 7fdfaffff640 1 -- 172.21.15.92:0/208676155 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fdfc009a120 con 0x7fdfc815c470 2024-09-11T00:14:57.828 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:57.824+0000 7fdfc77fe640 1 --2- 172.21.15.92:0/208676155 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7fdfb4077f70 0x7fdfb407a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:57.828 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:57.825+0000 7fdfc77fe640 1 --2- 172.21.15.92:0/208676155 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7fdfb4077f70 0x7fdfb407a430 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fdfb8005c40 tx=0x7fdfb8005bd0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:14:57.830 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:57.828+0000 7fdfaffff640 1 -- 172.21.15.92:0/208676155 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fdfc0062970 con 0x7fdfc815c470 2024-09-11T00:14:58.016 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:58.014+0000 7fdfce018640 1 -- 172.21.15.92:0/208676155 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fdfc80d02e0 con 0x7fdfc815c470 2024-09-11T00:14:58.016 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:58.014+0000 7fdfaffff640 1 -- 172.21.15.92:0/208676155 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v25) ==== 80+0+0 (secure 0 0 0) 0x7fdfc006b090 con 0x7fdfc815c470 2024-09-11T00:14:58.016 INFO:teuthology.orchestra.run.smithi092.stderr:listed 0 entries 2024-09-11T00:14:58.018 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:58.016+0000 7fdfce018640 1 -- 172.21.15.92:0/208676155 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7fdfb4077f70 msgr2=0x7fdfb407a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:58.018 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:58.017+0000 7fdfce018640 1 --2- 172.21.15.92:0/208676155 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7fdfb4077f70 0x7fdfb407a430 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fdfb8005c40 tx=0x7fdfb8005bd0 comp rx=0 tx=0).stop 2024-09-11T00:14:58.018 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:58.017+0000 7fdfce018640 1 -- 172.21.15.92:0/208676155 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdfc815c470 msgr2=0x7fdfc81f5180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:58.019 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:58.017+0000 7fdfce018640 1 --2- 172.21.15.92:0/208676155 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdfc815c470 0x7fdfc81f5180 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fdfc000d750 tx=0x7fdfc000dc10 comp rx=0 tx=0).stop 2024-09-11T00:14:58.019 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:58.017+0000 7fdfce018640 1 -- 172.21.15.92:0/208676155 shutdown_connections 2024-09-11T00:14:58.019 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:58.017+0000 7fdfce018640 1 --2- 172.21.15.92:0/208676155 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7fdfb4077f70 0x7fdfb407a430 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:58.019 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:58.017+0000 7fdfce018640 1 --2- 172.21.15.92:0/208676155 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdfc815c470 0x7fdfc81f5180 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:58.019 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:58.017+0000 7fdfce018640 1 --2- 172.21.15.92:0/208676155 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdfc8073780 0x7fdfc8155e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:58.019 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:58.017+0000 7fdfce018640 1 --2- 172.21.15.92:0/208676155 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fdfc8072560 0x7fdfc813d060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:58.019 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:58.017+0000 7fdfce018640 1 -- 172.21.15.92:0/208676155 >> 172.21.15.92:0/208676155 conn(0x7fdfc80b1760 msgr2=0x7fdfc80b1b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:14:58.019 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:58.017+0000 7fdfce018640 1 -- 172.21.15.92:0/208676155 shutdown_connections 2024-09-11T00:14:58.019 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:58.017+0000 7fdfce018640 1 -- 172.21.15.92:0/208676155 wait complete. 2024-09-11T00:14:58.029 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.2... 2024-09-11T00:14:58.029 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T00:14:58.029 DEBUG:teuthology.orchestra.run.smithi092:> sudo umount /home/ubuntu/cephtest/mnt.2 -f 2024-09-11T00:14:58.055 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi092.front.sepia.ceph.com 2024-09-11T00:14:58.055 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T00:14:58.055 DEBUG:teuthology.orchestra.run.smithi092:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-09-11T00:14:58.111 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2024-09-11T00:14:58.111 DEBUG:teuthology.orchestra.run.smithi145:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T00:14:58.131 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2024-09-11T00:14:58.131 DEBUG:teuthology.orchestra.run.smithi145:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T00:14:58.189 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2024-09-11T00:14:58.189 DEBUG:teuthology.orchestra.run.smithi145:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T00:14:58.247 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-11T00:14:58.349 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:58.347+0000 7fc53e717640 1 -- 172.21.15.92:0/2253783142 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc53815e060 msgr2=0x7fc5380b6dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:58.349 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:58.347+0000 7fc53e717640 1 --2- 172.21.15.92:0/2253783142 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc53815e060 0x7fc5380b6dc0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fc528009830 tx=0x7fc52802a510 comp rx=0 tx=0).stop 2024-09-11T00:14:58.349 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:58.348+0000 7fc53e717640 1 -- 172.21.15.92:0/2253783142 shutdown_connections 2024-09-11T00:14:58.350 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:58.348+0000 7fc53e717640 1 --2- 172.21.15.92:0/2253783142 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc5380d4af0 0x7fc5380cea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:58.350 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:58.348+0000 7fc53e717640 1 --2- 172.21.15.92:0/2253783142 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc53815e060 0x7fc5380b6dc0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:58.350 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:58.348+0000 7fc53e717640 1 -- 172.21.15.92:0/2253783142 >> 172.21.15.92:0/2253783142 conn(0x7fc5380d3f70 msgr2=0x7fc5380d4350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:14:58.350 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:58.348+0000 7fc53e717640 1 -- 172.21.15.92:0/2253783142 shutdown_connections 2024-09-11T00:14:58.350 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:58.348+0000 7fc53e717640 1 -- 172.21.15.92:0/2253783142 wait complete. 2024-09-11T00:14:58.350 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:58.349+0000 7fc53e717640 1 Processor -- start 2024-09-11T00:14:58.350 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:58.349+0000 7fc53e717640 1 -- start start 2024-09-11T00:14:58.352 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:58.349+0000 7fc53e717640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc5380d4af0 0x7fc5380cb040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:58.352 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:58.349+0000 7fc53e717640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc53815e060 0x7fc5380ca640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:58.352 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:58.349+0000 7fc53e717640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc5381f3f50 0x7fc5380cdc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:58.352 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:58.349+0000 7fc53e717640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fc5380cef80 con 0x7fc5380d4af0 2024-09-11T00:14:58.353 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:58.349+0000 7fc53e717640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fc5380d2eb0 con 0x7fc53815e060 2024-09-11T00:14:58.353 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:58.349+0000 7fc53e717640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7fc5380cf100 con 0x7fc5381f3f50 2024-09-11T00:14:58.353 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:58.350+0000 7fc537fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc5380d4af0 0x7fc5380cb040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:58.353 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:58.350+0000 7fc537fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc5380d4af0 0x7fc5380cb040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:43642/0 (socket says 172.21.15.92:43642) 2024-09-11T00:14:58.353 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:58.350+0000 7fc537fff640 1 -- 172.21.15.92:0/3511162385 learned_addr learned my addr 172.21.15.92:0/3511162385 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-11T00:14:58.353 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:58.350+0000 7fc53ccb4640 1 --2- 172.21.15.92:0/3511162385 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc5381f3f50 0x7fc5380cdc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:58.353 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:58.350+0000 7fc537fff640 1 -- 172.21.15.92:0/3511162385 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc5381f3f50 msgr2=0x7fc5380cdc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:58.353 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:58.350+0000 7fc537fff640 1 --2- 172.21.15.92:0/3511162385 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc5381f3f50 0x7fc5380cdc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:58.353 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:58.350+0000 7fc537fff640 1 -- 172.21.15.92:0/3511162385 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc53815e060 msgr2=0x7fc5380ca640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:58.353 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:58.350+0000 7fc52ffff640 1 --2- 172.21.15.92:0/3511162385 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc53815e060 0x7fc5380ca640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:58.353 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:58.350+0000 7fc537fff640 1 --2- 172.21.15.92:0/3511162385 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc53815e060 0x7fc5380ca640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:58.354 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:58.350+0000 7fc537fff640 1 -- 172.21.15.92:0/3511162385 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5380cce70 con 0x7fc5380d4af0 2024-09-11T00:14:58.354 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:58.350+0000 7fc53ccb4640 1 --2- 172.21.15.92:0/3511162385 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc5381f3f50 0x7fc5380cdc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:14:58.354 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:58.350+0000 7fc52ffff640 1 --2- 172.21.15.92:0/3511162385 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc53815e060 0x7fc5380ca640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:14:58.354 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:58.350+0000 7fc537fff640 1 --2- 172.21.15.92:0/3511162385 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc5380d4af0 0x7fc5380cb040 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fc528000c00 tx=0x7fc528033d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:14:58.354 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:58.350+0000 7fc5357fa640 1 -- 172.21.15.92:0/3511162385 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc528031d60 con 0x7fc5380d4af0 2024-09-11T00:14:58.354 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:58.350+0000 7fc5357fa640 1 -- 172.21.15.92:0/3511162385 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc5280330d0 con 0x7fc5380d4af0 2024-09-11T00:14:58.354 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:58.350+0000 7fc53e717640 1 -- 172.21.15.92:0/3511162385 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc5380cd150 con 0x7fc5380d4af0 2024-09-11T00:14:58.354 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:58.350+0000 7fc5357fa640 1 -- 172.21.15.92:0/3511162385 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc528033520 con 0x7fc5380d4af0 2024-09-11T00:14:58.354 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:58.350+0000 7fc53e717640 1 -- 172.21.15.92:0/3511162385 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc5380ce170 con 0x7fc5380d4af0 2024-09-11T00:14:58.355 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:58.351+0000 7fc53e717640 1 -- 172.21.15.92:0/3511162385 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc5380cea40 con 0x7fc5380d4af0 2024-09-11T00:14:58.355 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:58.352+0000 7fc5357fa640 1 -- 172.21.15.92:0/3511162385 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fc52804b030 con 0x7fc5380d4af0 2024-09-11T00:14:58.355 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:58.352+0000 7fc5357fa640 1 --2- 172.21.15.92:0/3511162385 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7fc518077f70 0x7fc51807a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:58.355 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:58.353+0000 7fc5357fa640 1 -- 172.21.15.92:0/3511162385 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fc5280bb2c0 con 0x7fc5380d4af0 2024-09-11T00:14:58.355 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:58.353+0000 7fc52ffff640 1 --2- 172.21.15.92:0/3511162385 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7fc518077f70 0x7fc51807a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:58.355 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:58.353+0000 7fc52ffff640 1 --2- 172.21.15.92:0/3511162385 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7fc518077f70 0x7fc51807a430 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fc53815ddc0 tx=0x7fc520009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:14:58.358 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:58.357+0000 7fc5357fa640 1 -- 172.21.15.92:0/3511162385 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fc52803f030 con 0x7fc5380d4af0 2024-09-11T00:14:58.545 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:58.543+0000 7fc53e717640 1 -- 172.21.15.92:0/3511162385 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fc53808dfa0 con 0x7fc5380d4af0 2024-09-11T00:14:58.545 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:58.543+0000 7fc5357fa640 1 -- 172.21.15.92:0/3511162385 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v25) ==== 80+0+0 (secure 0 0 0) 0x7fc5280839e0 con 0x7fc5380d4af0 2024-09-11T00:14:58.545 INFO:teuthology.orchestra.run.smithi092.stderr:listed 0 entries 2024-09-11T00:14:58.547 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:58.545+0000 7fc53e717640 1 -- 172.21.15.92:0/3511162385 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7fc518077f70 msgr2=0x7fc51807a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:58.547 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:58.545+0000 7fc53e717640 1 --2- 172.21.15.92:0/3511162385 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7fc518077f70 0x7fc51807a430 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fc53815ddc0 tx=0x7fc520009040 comp rx=0 tx=0).stop 2024-09-11T00:14:58.547 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:58.545+0000 7fc53e717640 1 -- 172.21.15.92:0/3511162385 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc5380d4af0 msgr2=0x7fc5380cb040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:58.547 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:58.545+0000 7fc53e717640 1 --2- 172.21.15.92:0/3511162385 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc5380d4af0 0x7fc5380cb040 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fc528000c00 tx=0x7fc528033d60 comp rx=0 tx=0).stop 2024-09-11T00:14:58.547 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:58.545+0000 7fc53e717640 1 -- 172.21.15.92:0/3511162385 shutdown_connections 2024-09-11T00:14:58.547 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:58.545+0000 7fc53e717640 1 --2- 172.21.15.92:0/3511162385 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7fc518077f70 0x7fc51807a430 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:58.548 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:58.545+0000 7fc53e717640 1 --2- 172.21.15.92:0/3511162385 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc5381f3f50 0x7fc5380cdc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:58.548 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:58.545+0000 7fc53e717640 1 --2- 172.21.15.92:0/3511162385 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc53815e060 0x7fc5380ca640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:58.548 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:58.545+0000 7fc53e717640 1 --2- 172.21.15.92:0/3511162385 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc5380d4af0 0x7fc5380cb040 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:58.548 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:58.545+0000 7fc53e717640 1 -- 172.21.15.92:0/3511162385 >> 172.21.15.92:0/3511162385 conn(0x7fc5380d3f70 msgr2=0x7fc5380b8550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:14:58.548 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:58.545+0000 7fc53e717640 1 -- 172.21.15.92:0/3511162385 shutdown_connections 2024-09-11T00:14:58.548 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:58.545+0000 7fc53e717640 1 -- 172.21.15.92:0/3511162385 wait complete. 2024-09-11T00:14:58.557 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.3... 2024-09-11T00:14:58.558 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T00:14:58.558 DEBUG:teuthology.orchestra.run.smithi145:> sudo umount /home/ubuntu/cephtest/mnt.3 -f 2024-09-11T00:14:58.588 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi145.front.sepia.ceph.com 2024-09-11T00:14:58.588 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T00:14:58.588 DEBUG:teuthology.orchestra.run.smithi145:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-09-11T00:14:58.646 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-11T00:14:58.647 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T00:14:58.748 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:58.746+0000 7f745c34b640 1 -- 172.21.15.92:0/3760319315 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f74540ceb00 msgr2=0x7f74540cef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:58.748 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:58.746+0000 7f745c34b640 1 --2- 172.21.15.92:0/3760319315 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f74540ceb00 0x7f74540cef90 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f7454076350 tx=0x7f744c02a980 comp rx=0 tx=0).stop 2024-09-11T00:14:58.748 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:58.746+0000 7f745c34b640 1 -- 172.21.15.92:0/3760319315 shutdown_connections 2024-09-11T00:14:58.748 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:58.746+0000 7f745c34b640 1 --2- 172.21.15.92:0/3760319315 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f74540ceb00 0x7f74540cef90 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:58.748 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:58.746+0000 7f745c34b640 1 --2- 172.21.15.92:0/3760319315 >> v2:172.21.15.145:3300/0 conn(0x7f7454072680 0x7f7454072aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:58.748 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:58.746+0000 7f745c34b640 1 --2- 172.21.15.92:0/3760319315 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7454144780 0x7f74540b3da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:58.748 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:58.746+0000 7f745c34b640 1 -- 172.21.15.92:0/3760319315 >> 172.21.15.92:0/3760319315 conn(0x7f74540b1760 msgr2=0x7f74540b1b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:14:58.748 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:58.746+0000 7f745c34b640 1 -- 172.21.15.92:0/3760319315 shutdown_connections 2024-09-11T00:14:58.748 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:58.746+0000 7f745c34b640 1 -- 172.21.15.92:0/3760319315 wait complete. 2024-09-11T00:14:58.749 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:58.747+0000 7f745c34b640 1 Processor -- start 2024-09-11T00:14:58.749 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:58.747+0000 7f745c34b640 1 -- start start 2024-09-11T00:14:58.751 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:58.748+0000 7f745c34b640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7454072680 0x7f745406f460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:58.751 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:58.748+0000 7f745c34b640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f74540ceb00 0x7f745406f9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:58.751 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:58.748+0000 7f745c34b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7454144780 0x7f74540c49d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:58.751 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:58.748+0000 7f745c34b640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f745415c8e0 con 0x7f7454144780 2024-09-11T00:14:58.751 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:58.748+0000 7f745c34b640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f745415c760 con 0x7f7454072680 2024-09-11T00:14:58.751 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:58.748+0000 7f745c34b640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f745415ca60 con 0x7f74540ceb00 2024-09-11T00:14:58.751 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:58.748+0000 7f745a8e8640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7454144780 0x7f74540c49d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:58.752 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:58.748+0000 7f745a8e8640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7454144780 0x7f74540c49d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:43664/0 (socket says 172.21.15.92:43664) 2024-09-11T00:14:58.752 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:58.748+0000 7f745a8e8640 1 -- 172.21.15.92:0/2647206985 learned_addr learned my addr 172.21.15.92:0/2647206985 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-11T00:14:58.752 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:58.748+0000 7f745a0e7640 1 --2- 172.21.15.92:0/2647206985 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7454072680 0x7f745406f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:58.752 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:58.748+0000 7f74598e6640 1 --2- 172.21.15.92:0/2647206985 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f74540ceb00 0x7f745406f9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:58.752 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:58.748+0000 7f745a8e8640 1 -- 172.21.15.92:0/2647206985 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f74540ceb00 msgr2=0x7f745406f9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:58.752 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:58.748+0000 7f745a8e8640 1 --2- 172.21.15.92:0/2647206985 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f74540ceb00 0x7f745406f9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:58.752 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:58.748+0000 7f745a8e8640 1 -- 172.21.15.92:0/2647206985 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7454072680 msgr2=0x7f745406f460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:58.752 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:58.748+0000 7f745a8e8640 1 --2- 172.21.15.92:0/2647206985 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7454072680 0x7f745406f460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:58.752 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:58.748+0000 7f745a8e8640 1 -- 172.21.15.92:0/2647206985 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74540ad340 con 0x7f7454144780 2024-09-11T00:14:58.752 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:58.748+0000 7f745a8e8640 1 --2- 172.21.15.92:0/2647206985 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7454144780 0x7f74540c49d0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f744c009d60 tx=0x7f744c003ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:14:58.753 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:58.748+0000 7f744affd640 1 -- 172.21.15.92:0/2647206985 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f744c034050 con 0x7f7454144780 2024-09-11T00:14:58.753 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:58.748+0000 7f744affd640 1 -- 172.21.15.92:0/2647206985 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f744c004550 con 0x7f7454144780 2024-09-11T00:14:58.753 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:58.749+0000 7f745c34b640 1 -- 172.21.15.92:0/2647206985 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f74540ad620 con 0x7f7454144780 2024-09-11T00:14:58.753 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:58.749+0000 7f744affd640 1 -- 172.21.15.92:0/2647206985 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f744c043440 con 0x7f7454144780 2024-09-11T00:14:58.753 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:58.749+0000 7f745c34b640 1 -- 172.21.15.92:0/2647206985 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74540adbe0 con 0x7f7454144780 2024-09-11T00:14:58.753 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:58.749+0000 7f745c34b640 1 -- 172.21.15.92:0/2647206985 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f745415cf10 con 0x7f7454144780 2024-09-11T00:14:58.754 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:58.750+0000 7f744affd640 1 -- 172.21.15.92:0/2647206985 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f744c041070 con 0x7f7454144780 2024-09-11T00:14:58.754 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:58.751+0000 7f744affd640 1 --2- 172.21.15.92:0/2647206985 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f7438077f70 0x7f743807a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:58.754 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:58.751+0000 7f744affd640 1 -- 172.21.15.92:0/2647206985 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f744c0bb520 con 0x7f7454144780 2024-09-11T00:14:58.754 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:58.751+0000 7f745a0e7640 1 --2- 172.21.15.92:0/2647206985 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f7438077f70 0x7f743807a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:58.754 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:58.752+0000 7f745a0e7640 1 --2- 172.21.15.92:0/2647206985 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f7438077f70 0x7f743807a430 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f74500098e0 tx=0x7f7450009060 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:14:58.758 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:58.756+0000 7f744affd640 1 -- 172.21.15.92:0/2647206985 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f744c083800 con 0x7f7454144780 2024-09-11T00:14:58.973 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:58.971+0000 7f745c34b640 1 -- 172.21.15.92:0/2647206985 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f745415c2d0 con 0x7f7454144780 2024-09-11T00:14:58.973 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:58.972+0000 7f744affd640 1 -- 172.21.15.92:0/2647206985 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5225 (secure 0 0 0) 0x7f744c088230 con 0x7f7454144780 2024-09-11T00:14:58.974 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:14:58.974 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":8,"btime":"2024-09-11T00:14:37:675941+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4286,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/2051794804","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":2051794804},{"type":"v1","addr":"172.21.15.92:6835","nonce":2051794804}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4295,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6835/1341143168","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6834","nonce":1341143168},{"type":"v1","addr":"172.21.15.145:6835","nonce":1341143168}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4356,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6833/3149311196","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":3149311196},{"type":"v1","addr":"172.21.15.92:6833","nonce":3149311196}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T00:14:17.969166+0000","modified":"2024-09-11T00:14:37.019981+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4374},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4374":{"gid":4374,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.145:6837/3236563974","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6836","nonce":3236563974},{"type":"v1","addr":"172.21.15.145:6837","nonce":3236563974}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4374,"qdb_cluster":[4374]},"id":1}]} 2024-09-11T00:14:58.974 INFO:teuthology.orchestra.run.smithi092.stderr:dumped fsmap epoch 8 2024-09-11T00:14:58.976 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:58.974+0000 7f745c34b640 1 -- 172.21.15.92:0/2647206985 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f7438077f70 msgr2=0x7f743807a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:58.976 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:58.974+0000 7f745c34b640 1 --2- 172.21.15.92:0/2647206985 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f7438077f70 0x7f743807a430 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f74500098e0 tx=0x7f7450009060 comp rx=0 tx=0).stop 2024-09-11T00:14:58.976 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:58.974+0000 7f745c34b640 1 -- 172.21.15.92:0/2647206985 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7454144780 msgr2=0x7f74540c49d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:58.976 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:58.974+0000 7f745c34b640 1 --2- 172.21.15.92:0/2647206985 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7454144780 0x7f74540c49d0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f744c009d60 tx=0x7f744c003ef0 comp rx=0 tx=0).stop 2024-09-11T00:14:58.976 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:58.974+0000 7f745c34b640 1 -- 172.21.15.92:0/2647206985 shutdown_connections 2024-09-11T00:14:58.976 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:58.974+0000 7f745c34b640 1 --2- 172.21.15.92:0/2647206985 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f7438077f70 0x7f743807a430 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:58.976 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:58.974+0000 7f745c34b640 1 --2- 172.21.15.92:0/2647206985 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7454144780 0x7f74540c49d0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:58.976 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:58.974+0000 7f745c34b640 1 --2- 172.21.15.92:0/2647206985 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f74540ceb00 0x7f745406f9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:58.976 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:58.974+0000 7f745c34b640 1 --2- 172.21.15.92:0/2647206985 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7454072680 0x7f745406f460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:58.976 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:58.974+0000 7f745c34b640 1 -- 172.21.15.92:0/2647206985 >> 172.21.15.92:0/2647206985 conn(0x7f74540b1760 msgr2=0x7f74540d02a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:14:58.977 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:58.974+0000 7f745c34b640 1 -- 172.21.15.92:0/2647206985 shutdown_connections 2024-09-11T00:14:58.977 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:58.974+0000 7f745c34b640 1 -- 172.21.15.92:0/2647206985 wait complete. 2024-09-11T00:14:58.987 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T00:14:59.088 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:59.086+0000 7f341ac08640 1 -- 172.21.15.92:0/2854626167 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3414072e80 msgr2=0x7f341415c410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:59.088 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:59.086+0000 7f341ac08640 1 --2- 172.21.15.92:0/2854626167 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3414072e80 0x7f341415c410 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f3414152320 tx=0x7f340802a8f0 comp rx=0 tx=0).stop 2024-09-11T00:14:59.088 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:59.086+0000 7f341ac08640 1 -- 172.21.15.92:0/2854626167 shutdown_connections 2024-09-11T00:14:59.088 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:59.086+0000 7f341ac08640 1 --2- 172.21.15.92:0/2854626167 >> v2:172.21.15.145:3300/0 conn(0x7f341415b200 0x7f341415b670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:59.088 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:59.086+0000 7f341ac08640 1 --2- 172.21.15.92:0/2854626167 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3414072e80 0x7f341415c410 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:59.088 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:59.086+0000 7f341ac08640 1 -- 172.21.15.92:0/2854626167 >> 172.21.15.92:0/2854626167 conn(0x7f34140b1760 msgr2=0x7f34140b1b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:14:59.088 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:59.086+0000 7f341ac08640 1 -- 172.21.15.92:0/2854626167 shutdown_connections 2024-09-11T00:14:59.088 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:59.086+0000 7f341ac08640 1 -- 172.21.15.92:0/2854626167 wait complete. 2024-09-11T00:14:59.089 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:59.087+0000 7f341ac08640 1 Processor -- start 2024-09-11T00:14:59.089 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:59.087+0000 7f341ac08640 1 -- start start 2024-09-11T00:14:59.090 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:59.088+0000 7f341ac08640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3414072e80 0x7f34141434e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:59.091 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:59.088+0000 7f341ac08640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f34140cf3d0 0x7f341414f200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:59.091 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:59.088+0000 7f341ac08640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f341415b200 0x7f341414d100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:59.091 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:59.088+0000 7f341ac08640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f34140b3ab0 con 0x7f3414072e80 2024-09-11T00:14:59.091 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:59.088+0000 7f341ac08640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f34140b3930 con 0x7f34140cf3d0 2024-09-11T00:14:59.091 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:59.088+0000 7f341ac08640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f34140b3c30 con 0x7f341415b200 2024-09-11T00:14:59.091 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:59.088+0000 7f34189a4640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3414072e80 0x7f34141434e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:59.091 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:59.088+0000 7f34189a4640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3414072e80 0x7f34141434e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:43680/0 (socket says 172.21.15.92:43680) 2024-09-11T00:14:59.091 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:59.088+0000 7f34189a4640 1 -- 172.21.15.92:0/753228141 learned_addr learned my addr 172.21.15.92:0/753228141 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-11T00:14:59.091 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:59.088+0000 7f34191a5640 1 --2- 172.21.15.92:0/753228141 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f341415b200 0x7f341414d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:59.091 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:59.088+0000 7f3413fff640 1 --2- 172.21.15.92:0/753228141 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f34140cf3d0 0x7f341414f200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:59.091 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:59.088+0000 7f34189a4640 1 -- 172.21.15.92:0/753228141 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f341415b200 msgr2=0x7f341414d100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:59.091 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:59.088+0000 7f34189a4640 1 --2- 172.21.15.92:0/753228141 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f341415b200 0x7f341414d100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:59.091 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:59.088+0000 7f34189a4640 1 -- 172.21.15.92:0/753228141 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f34140cf3d0 msgr2=0x7f341414f200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:59.092 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:59.088+0000 7f34189a4640 1 --2- 172.21.15.92:0/753228141 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f34140cf3d0 0x7f341414f200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:59.092 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:59.088+0000 7f34189a4640 1 -- 172.21.15.92:0/753228141 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3414152410 con 0x7f3414072e80 2024-09-11T00:14:59.092 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:59.088+0000 7f3413fff640 1 --2- 172.21.15.92:0/753228141 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f34140cf3d0 0x7f341414f200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:14:59.092 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:59.088+0000 7f34189a4640 1 --2- 172.21.15.92:0/753228141 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3414072e80 0x7f34141434e0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f340400c460 tx=0x7f340400c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:14:59.092 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:59.088+0000 7f34117fa640 1 -- 172.21.15.92:0/753228141 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3404016020 con 0x7f3414072e80 2024-09-11T00:14:59.092 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:59.088+0000 7f34117fa640 1 -- 172.21.15.92:0/753228141 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3404012960 con 0x7f3414072e80 2024-09-11T00:14:59.092 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:59.089+0000 7f34117fa640 1 -- 172.21.15.92:0/753228141 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3404012db0 con 0x7f3414072e80 2024-09-11T00:14:59.092 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:59.089+0000 7f341ac08640 1 -- 172.21.15.92:0/753228141 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f34141526f0 con 0x7f3414072e80 2024-09-11T00:14:59.093 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:59.089+0000 7f341ac08640 1 -- 172.21.15.92:0/753228141 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3414152cb0 con 0x7f3414072e80 2024-09-11T00:14:59.093 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:59.090+0000 7f341ac08640 1 -- 172.21.15.92:0/753228141 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f34141530e0 con 0x7f3414072e80 2024-09-11T00:14:59.094 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:59.090+0000 7f34117fa640 1 -- 172.21.15.92:0/753228141 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f340401a3b0 con 0x7f3414072e80 2024-09-11T00:14:59.094 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:59.091+0000 7f34117fa640 1 --2- 172.21.15.92:0/753228141 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f3400077f70 0x7f340007a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:59.094 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:59.091+0000 7f34117fa640 1 -- 172.21.15.92:0/753228141 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6743+0+0 (secure 0 0 0) 0x7f340409a0d0 con 0x7f3414072e80 2024-09-11T00:14:59.094 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:59.091+0000 7f3413fff640 1 --2- 172.21.15.92:0/753228141 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f3400077f70 0x7f340007a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:59.094 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:59.092+0000 7f3413fff640 1 --2- 172.21.15.92:0/753228141 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f3400077f70 0x7f340007a430 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f3408035000 tx=0x7f3408004ab0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:14:59.096 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:59.095+0000 7f34117fa640 1 -- 172.21.15.92:0/753228141 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f3404020030 con 0x7f3414072e80 2024-09-11T00:14:59.304 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:59.302+0000 7f341ac08640 1 -- 172.21.15.92:0/753228141 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f34140ce3b0 con 0x7f3414072e80 2024-09-11T00:14:59.304 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:59.303+0000 7f34117fa640 1 -- 172.21.15.92:0/753228141 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5225 (secure 0 0 0) 0x7f34040627c0 con 0x7f3414072e80 2024-09-11T00:14:59.305 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:14:59.305 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":8,"btime":"2024-09-11T00:14:37:675941+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4286,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/2051794804","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":2051794804},{"type":"v1","addr":"172.21.15.92:6835","nonce":2051794804}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4295,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6835/1341143168","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6834","nonce":1341143168},{"type":"v1","addr":"172.21.15.145:6835","nonce":1341143168}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4356,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6833/3149311196","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":3149311196},{"type":"v1","addr":"172.21.15.92:6833","nonce":3149311196}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T00:14:17.969166+0000","modified":"2024-09-11T00:14:37.019981+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4374},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4374":{"gid":4374,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.145:6837/3236563974","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6836","nonce":3236563974},{"type":"v1","addr":"172.21.15.145:6837","nonce":3236563974}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4374,"qdb_cluster":[4374]},"id":1}]} 2024-09-11T00:14:59.305 INFO:teuthology.orchestra.run.smithi092.stderr:dumped fsmap epoch 8 2024-09-11T00:14:59.307 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:59.305+0000 7f341ac08640 1 -- 172.21.15.92:0/753228141 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f3400077f70 msgr2=0x7f340007a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:59.307 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:59.305+0000 7f341ac08640 1 --2- 172.21.15.92:0/753228141 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f3400077f70 0x7f340007a430 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f3408035000 tx=0x7f3408004ab0 comp rx=0 tx=0).stop 2024-09-11T00:14:59.307 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:59.305+0000 7f341ac08640 1 -- 172.21.15.92:0/753228141 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3414072e80 msgr2=0x7f34141434e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:59.307 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:59.305+0000 7f341ac08640 1 --2- 172.21.15.92:0/753228141 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3414072e80 0x7f34141434e0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f340400c460 tx=0x7f340400c920 comp rx=0 tx=0).stop 2024-09-11T00:14:59.307 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:59.305+0000 7f341ac08640 1 -- 172.21.15.92:0/753228141 shutdown_connections 2024-09-11T00:14:59.307 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:59.305+0000 7f341ac08640 1 --2- 172.21.15.92:0/753228141 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f3400077f70 0x7f340007a430 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:59.307 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:59.305+0000 7f341ac08640 1 --2- 172.21.15.92:0/753228141 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f341415b200 0x7f341414d100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:59.307 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:59.305+0000 7f341ac08640 1 --2- 172.21.15.92:0/753228141 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f34140cf3d0 0x7f341414f200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:59.308 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:59.305+0000 7f341ac08640 1 --2- 172.21.15.92:0/753228141 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3414072e80 0x7f34141434e0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:59.308 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:59.305+0000 7f341ac08640 1 -- 172.21.15.92:0/753228141 >> 172.21.15.92:0/753228141 conn(0x7f34140b1760 msgr2=0x7f3414072770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:14:59.308 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:59.305+0000 7f341ac08640 1 -- 172.21.15.92:0/753228141 shutdown_connections 2024-09-11T00:14:59.308 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:59.305+0000 7f341ac08640 1 -- 172.21.15.92:0/753228141 wait complete. 2024-09-11T00:14:59.318 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T00:14:59.419 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:59.417+0000 7fbbd1652640 1 -- 172.21.15.92:0/2582556187 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbbcc073780 msgr2=0x7fbbcc073b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:59.419 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:59.417+0000 7fbbd1652640 1 --2- 172.21.15.92:0/2582556187 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbbcc073780 0x7fbbcc073b60 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fbbbc005fd0 tx=0x7fbbbc02aa90 comp rx=0 tx=0).stop 2024-09-11T00:14:59.419 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:59.417+0000 7fbbd1652640 1 -- 172.21.15.92:0/2582556187 shutdown_connections 2024-09-11T00:14:59.419 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:59.417+0000 7fbbd1652640 1 --2- 172.21.15.92:0/2582556187 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fbbcc06f140 0x7fbbcc06f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:59.419 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:59.417+0000 7fbbd1652640 1 --2- 172.21.15.92:0/2582556187 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbbcc073780 0x7fbbcc073b60 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:59.419 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:59.417+0000 7fbbd1652640 1 -- 172.21.15.92:0/2582556187 >> 172.21.15.92:0/2582556187 conn(0x7fbbcc0b1760 msgr2=0x7fbbcc0b1b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:14:59.419 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:59.417+0000 7fbbd1652640 1 -- 172.21.15.92:0/2582556187 shutdown_connections 2024-09-11T00:14:59.420 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:59.417+0000 7fbbd1652640 1 -- 172.21.15.92:0/2582556187 wait complete. 2024-09-11T00:14:59.422 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:59.418+0000 7fbbd1652640 1 Processor -- start 2024-09-11T00:14:59.422 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:59.418+0000 7fbbd1652640 1 -- start start 2024-09-11T00:14:59.422 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:59.419+0000 7fbbd1652640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fbbcc06f140 0x7fbbcc144f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:59.422 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:59.419+0000 7fbbd1652640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbbcc073780 0x7fbbcc1f4980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:59.422 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:59.419+0000 7fbbd1652640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbbcc15c470 0x7fbbcc1f8730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:59.422 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:59.419+0000 7fbbd1652640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fbbcc142260 con 0x7fbbcc073780 2024-09-11T00:14:59.422 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:59.419+0000 7fbbd1652640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fbbcc1420e0 con 0x7fbbcc15c470 2024-09-11T00:14:59.422 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:59.419+0000 7fbbd1652640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7fbbcc06fb10 con 0x7fbbcc06f140 2024-09-11T00:14:59.422 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:59.419+0000 7fbbca7fc640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbbcc073780 0x7fbbcc1f4980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:59.423 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:59.419+0000 7fbbca7fc640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbbcc073780 0x7fbbcc1f4980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:43706/0 (socket says 172.21.15.92:43706) 2024-09-11T00:14:59.423 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:59.419+0000 7fbbca7fc640 1 -- 172.21.15.92:0/448519703 learned_addr learned my addr 172.21.15.92:0/448519703 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-11T00:14:59.423 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:59.419+0000 7fbbcb7fe640 1 --2- 172.21.15.92:0/448519703 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbbcc15c470 0x7fbbcc1f8730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:59.423 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:59.419+0000 7fbbcaffd640 1 --2- 172.21.15.92:0/448519703 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fbbcc06f140 0x7fbbcc144f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:59.423 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:59.419+0000 7fbbca7fc640 1 -- 172.21.15.92:0/448519703 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fbbcc06f140 msgr2=0x7fbbcc144f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:59.423 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:59.419+0000 7fbbca7fc640 1 --2- 172.21.15.92:0/448519703 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fbbcc06f140 0x7fbbcc144f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:59.423 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:59.419+0000 7fbbca7fc640 1 -- 172.21.15.92:0/448519703 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbbcc15c470 msgr2=0x7fbbcc1f8730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:59.423 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:59.419+0000 7fbbca7fc640 1 --2- 172.21.15.92:0/448519703 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbbcc15c470 0x7fbbcc1f8730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:59.423 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:59.419+0000 7fbbca7fc640 1 -- 172.21.15.92:0/448519703 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbbcc1f91f0 con 0x7fbbcc073780 2024-09-11T00:14:59.423 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:59.420+0000 7fbbca7fc640 1 --2- 172.21.15.92:0/448519703 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbbcc073780 0x7fbbcc1f4980 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fbbc000c370 tx=0x7fbbc000c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:14:59.423 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:59.420+0000 7fbbb37fe640 1 -- 172.21.15.92:0/448519703 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbc0017070 con 0x7fbbcc073780 2024-09-11T00:14:59.423 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:59.420+0000 7fbbb37fe640 1 -- 172.21.15.92:0/448519703 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbbc00035f0 con 0x7fbbcc073780 2024-09-11T00:14:59.424 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:59.420+0000 7fbbd1652640 1 -- 172.21.15.92:0/448519703 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbbcc1f94d0 con 0x7fbbcc073780 2024-09-11T00:14:59.424 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:59.420+0000 7fbbb37fe640 1 -- 172.21.15.92:0/448519703 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbc0003a40 con 0x7fbbcc073780 2024-09-11T00:14:59.424 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:59.420+0000 7fbbd1652640 1 -- 172.21.15.92:0/448519703 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbbcc1454d0 con 0x7fbbcc073780 2024-09-11T00:14:59.425 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:59.421+0000 7fbbd1652640 1 -- 172.21.15.92:0/448519703 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbbcc070050 con 0x7fbbcc073780 2024-09-11T00:14:59.425 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:59.421+0000 7fbbb37fe640 1 -- 172.21.15.92:0/448519703 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fbbc0003be0 con 0x7fbbcc073780 2024-09-11T00:14:59.425 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:59.422+0000 7fbbb37fe640 1 --2- 172.21.15.92:0/448519703 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7fbbb8077f70 0x7fbbb807a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:59.425 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:59.422+0000 7fbbb37fe640 1 -- 172.21.15.92:0/448519703 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6743+0+0 (secure 0 0 0) 0x7fbbc00996f0 con 0x7fbbcc073780 2024-09-11T00:14:59.425 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:59.422+0000 7fbbcaffd640 1 --2- 172.21.15.92:0/448519703 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7fbbb8077f70 0x7fbbb807a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:59.425 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:59.422+0000 7fbbcaffd640 1 --2- 172.21.15.92:0/448519703 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7fbbb8077f70 0x7fbbb807a430 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fbbbc035000 tx=0x7fbbbc039040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:14:59.427 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:59.426+0000 7fbbb37fe640 1 -- 172.21.15.92:0/448519703 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fbbc0061de0 con 0x7fbbcc073780 2024-09-11T00:14:59.602 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:59.600+0000 7fbbd1652640 1 -- 172.21.15.92:0/448519703 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fbbcc15c9e0 con 0x7fbbcc073780 2024-09-11T00:14:59.603 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:59.602+0000 7fbbb37fe640 1 -- 172.21.15.92:0/448519703 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+19029 (secure 0 0 0) 0x7fbbc00616e0 con 0x7fbbcc073780 2024-09-11T00:14:59.604 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:14:59.604 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":26,"fsid":"47039cb3-5d2a-46bf-9066-8055b5dfc583","created":"2024-09-11T00:13:53.889939+0000","modified":"2024-09-11T00:14:58.750212+0000","last_up_change":"2024-09-11T00:14:06.563107+0000","last_in_change":"2024-09-11T00:13:56.982537+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T00:14:06.287223+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-11T00:14:15.739528+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-11T00:14:16.925480+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-11T00:14:20.639419+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"538af0ea-96c9-4999-9ccc-bee55f80ff76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":2860560077},{"type":"v1","addr":"172.21.15.92:6801","nonce":2860560077}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":2860560077},{"type":"v1","addr":"172.21.15.92:6803","nonce":2860560077}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":2860560077},{"type":"v1","addr":"172.21.15.92:6807","nonce":2860560077}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":2860560077},{"type":"v1","addr":"172.21.15.92:6805","nonce":2860560077}]},"public_addr":"172.21.15.92:6801/2860560077","cluster_addr":"172.21.15.92:6803/2860560077","heartbeat_back_addr":"172.21.15.92:6807/2860560077","heartbeat_front_addr":"172.21.15.92:6805/2860560077","state":["exists","up"]},{"osd":1,"uuid":"f9214f2c-ffe6-4447-9a13-9549a36e0537","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":2600417443},{"type":"v1","addr":"172.21.15.92:6817","nonce":2600417443}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6818","nonce":2600417443},{"type":"v1","addr":"172.21.15.92:6819","nonce":2600417443}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6822","nonce":2600417443},{"type":"v1","addr":"172.21.15.92:6823","nonce":2600417443}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":2600417443},{"type":"v1","addr":"172.21.15.92:6821","nonce":2600417443}]},"public_addr":"172.21.15.92:6817/2600417443","cluster_addr":"172.21.15.92:6819/2600417443","heartbeat_back_addr":"172.21.15.92:6823/2600417443","heartbeat_front_addr":"172.21.15.92:6821/2600417443","state":["exists","up"]},{"osd":2,"uuid":"b44dd849-fb85-42b1-8a1a-b6681bb1f467","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":3143892898},{"type":"v1","addr":"172.21.15.92:6809","nonce":3143892898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":3143892898},{"type":"v1","addr":"172.21.15.92:6811","nonce":3143892898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":3143892898},{"type":"v1","addr":"172.21.15.92:6815","nonce":3143892898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":3143892898},{"type":"v1","addr":"172.21.15.92:6813","nonce":3143892898}]},"public_addr":"172.21.15.92:6809/3143892898","cluster_addr":"172.21.15.92:6811/3143892898","heartbeat_back_addr":"172.21.15.92:6815/3143892898","heartbeat_front_addr":"172.21.15.92:6813/3143892898","state":["exists","up"]},{"osd":3,"uuid":"05a49d87-23b9-48dd-962c-d5c2686e7a32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":3913961488},{"type":"v1","addr":"172.21.15.92:6825","nonce":3913961488}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6826","nonce":3913961488},{"type":"v1","addr":"172.21.15.92:6827","nonce":3913961488}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":3913961488},{"type":"v1","addr":"172.21.15.92:6831","nonce":3913961488}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":3913961488},{"type":"v1","addr":"172.21.15.92:6829","nonce":3913961488}]},"public_addr":"172.21.15.92:6825/3913961488","cluster_addr":"172.21.15.92:6827/3913961488","heartbeat_back_addr":"172.21.15.92:6831/3913961488","heartbeat_front_addr":"172.21.15.92:6829/3913961488","state":["exists","up"]},{"osd":4,"uuid":"cf52b087-afe0-4f43-a4e7-db2ebc158815","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6826","nonce":2206798907},{"type":"v1","addr":"172.21.15.145:6827","nonce":2206798907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6828","nonce":2206798907},{"type":"v1","addr":"172.21.15.145:6829","nonce":2206798907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6832","nonce":2206798907},{"type":"v1","addr":"172.21.15.145:6833","nonce":2206798907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6830","nonce":2206798907},{"type":"v1","addr":"172.21.15.145:6831","nonce":2206798907}]},"public_addr":"172.21.15.145:6827/2206798907","cluster_addr":"172.21.15.145:6829/2206798907","heartbeat_back_addr":"172.21.15.145:6833/2206798907","heartbeat_front_addr":"172.21.15.145:6831/2206798907","state":["exists","up"]},{"osd":5,"uuid":"0e54adcd-2d1d-49fb-bf97-3dd7e9addd30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6810","nonce":2599548493},{"type":"v1","addr":"172.21.15.145:6811","nonce":2599548493}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6812","nonce":2599548493},{"type":"v1","addr":"172.21.15.145:6813","nonce":2599548493}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6816","nonce":2599548493},{"type":"v1","addr":"172.21.15.145:6817","nonce":2599548493}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6814","nonce":2599548493},{"type":"v1","addr":"172.21.15.145:6815","nonce":2599548493}]},"public_addr":"172.21.15.145:6811/2599548493","cluster_addr":"172.21.15.145:6813/2599548493","heartbeat_back_addr":"172.21.15.145:6817/2599548493","heartbeat_front_addr":"172.21.15.145:6815/2599548493","state":["exists","up"]},{"osd":6,"uuid":"4d5ae7a8-b3df-4c7a-9124-290f239f5b57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6802","nonce":4192380792},{"type":"v1","addr":"172.21.15.145:6803","nonce":4192380792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6804","nonce":4192380792},{"type":"v1","addr":"172.21.15.145:6805","nonce":4192380792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6808","nonce":4192380792},{"type":"v1","addr":"172.21.15.145:6809","nonce":4192380792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6806","nonce":4192380792},{"type":"v1","addr":"172.21.15.145:6807","nonce":4192380792}]},"public_addr":"172.21.15.145:6803/4192380792","cluster_addr":"172.21.15.145:6805/4192380792","heartbeat_back_addr":"172.21.15.145:6809/4192380792","heartbeat_front_addr":"172.21.15.145:6807/4192380792","state":["exists","up"]},{"osd":7,"uuid":"d7e36444-6e3f-4372-81d3-88e7b4e993f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6818","nonce":3010598400},{"type":"v1","addr":"172.21.15.145:6819","nonce":3010598400}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6820","nonce":3010598400},{"type":"v1","addr":"172.21.15.145:6821","nonce":3010598400}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6824","nonce":3010598400},{"type":"v1","addr":"172.21.15.145:6825","nonce":3010598400}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6822","nonce":3010598400},{"type":"v1","addr":"172.21.15.145:6823","nonce":3010598400}]},"public_addr":"172.21.15.145:6819/3010598400","cluster_addr":"172.21.15.145:6821/3010598400","heartbeat_back_addr":"172.21.15.145:6825/3010598400","heartbeat_front_addr":"172.21.15.145:6823/3010598400","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:14:03.281892+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:14:04.039021+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:14:03.045775+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:14:03.708856+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:14:04.425520+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:14:03.839369+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:14:03.029834+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:14:03.707529+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":3,"to":2}]},{"pgid":"3.16","mappings":[{"from":5,"to":2},{"from":7,"to":1}]},{"pgid":"3.2a","mappings":[{"from":5,"to":2}]},{"pgid":"3.38","mappings":[{"from":3,"to":1}]},{"pgid":"4.0","mappings":[{"from":1,"to":2}]},{"pgid":"4.17","mappings":[{"from":1,"to":2}]},{"pgid":"4.1e","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T00:14:59.606 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:59.604+0000 7fbbd1652640 1 -- 172.21.15.92:0/448519703 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7fbbb8077f70 msgr2=0x7fbbb807a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:59.606 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:59.604+0000 7fbbd1652640 1 --2- 172.21.15.92:0/448519703 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7fbbb8077f70 0x7fbbb807a430 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fbbbc035000 tx=0x7fbbbc039040 comp rx=0 tx=0).stop 2024-09-11T00:14:59.606 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:59.604+0000 7fbbd1652640 1 -- 172.21.15.92:0/448519703 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbbcc073780 msgr2=0x7fbbcc1f4980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:59.606 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:59.604+0000 7fbbd1652640 1 --2- 172.21.15.92:0/448519703 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbbcc073780 0x7fbbcc1f4980 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fbbc000c370 tx=0x7fbbc000c830 comp rx=0 tx=0).stop 2024-09-11T00:14:59.607 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:59.604+0000 7fbbd1652640 1 -- 172.21.15.92:0/448519703 shutdown_connections 2024-09-11T00:14:59.607 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:59.604+0000 7fbbd1652640 1 --2- 172.21.15.92:0/448519703 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7fbbb8077f70 0x7fbbb807a430 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:59.607 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:59.604+0000 7fbbd1652640 1 --2- 172.21.15.92:0/448519703 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbbcc15c470 0x7fbbcc1f8730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:59.607 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:59.604+0000 7fbbd1652640 1 --2- 172.21.15.92:0/448519703 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbbcc073780 0x7fbbcc1f4980 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:59.607 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:59.604+0000 7fbbd1652640 1 --2- 172.21.15.92:0/448519703 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fbbcc06f140 0x7fbbcc144f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:59.608 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:59.604+0000 7fbbd1652640 1 -- 172.21.15.92:0/448519703 >> 172.21.15.92:0/448519703 conn(0x7fbbcc0b1760 msgr2=0x7fbbcc0cfaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:14:59.608 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:59.604+0000 7fbbd1652640 1 -- 172.21.15.92:0/448519703 shutdown_connections 2024-09-11T00:14:59.608 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:59.604+0000 7fbbd1652640 1 -- 172.21.15.92:0/448519703 wait complete. 2024-09-11T00:14:59.618 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-11T00:14:59.618 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T00:14:59.719 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:59.717+0000 7f4a4392c640 1 -- 172.21.15.92:0/1104834419 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4a3c073780 msgr2=0x7f4a3c073b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:59.719 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:59.717+0000 7f4a4392c640 1 --2- 172.21.15.92:0/1104834419 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4a3c073780 0x7f4a3c073b60 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f4a3c072230 tx=0x7f4a3802a530 comp rx=0 tx=0).stop 2024-09-11T00:14:59.719 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:59.717+0000 7f4a4392c640 1 -- 172.21.15.92:0/1104834419 shutdown_connections 2024-09-11T00:14:59.719 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:59.717+0000 7f4a4392c640 1 --2- 172.21.15.92:0/1104834419 >> v2:172.21.15.145:3300/0 conn(0x7f4a3c06f140 0x7f4a3c06f5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:59.719 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:59.717+0000 7f4a4392c640 1 --2- 172.21.15.92:0/1104834419 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4a3c073780 0x7f4a3c073b60 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:59.719 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:59.717+0000 7f4a4392c640 1 -- 172.21.15.92:0/1104834419 >> 172.21.15.92:0/1104834419 conn(0x7f4a3c0b1760 msgr2=0x7f4a3c0b1b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:14:59.719 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:59.717+0000 7f4a4392c640 1 -- 172.21.15.92:0/1104834419 shutdown_connections 2024-09-11T00:14:59.719 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:59.717+0000 7f4a4392c640 1 -- 172.21.15.92:0/1104834419 wait complete. 2024-09-11T00:14:59.722 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:59.718+0000 7f4a4392c640 1 Processor -- start 2024-09-11T00:14:59.722 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:59.718+0000 7f4a4392c640 1 -- start start 2024-09-11T00:14:59.722 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:59.719+0000 7f4a4392c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4a3c06f140 0x7f4a3c143d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:59.722 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:59.719+0000 7f4a4392c640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4a3c073780 0x7f4a3c142e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:59.722 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:59.719+0000 7f4a4392c640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4a3c15c470 0x7f4a3c13abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:59.722 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:59.719+0000 7f4a4392c640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f4a3c142260 con 0x7f4a3c06f140 2024-09-11T00:14:59.722 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:59.719+0000 7f4a4392c640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f4a3c1420e0 con 0x7f4a3c073780 2024-09-11T00:14:59.722 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:59.719+0000 7f4a4392c640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f4a3c06faf0 con 0x7f4a3c15c470 2024-09-11T00:14:59.722 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:59.719+0000 7f4a416c8640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4a3c06f140 0x7f4a3c143d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:59.722 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:59.719+0000 7f4a416c8640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4a3c06f140 0x7f4a3c143d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:43724/0 (socket says 172.21.15.92:43724) 2024-09-11T00:14:59.722 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:59.719+0000 7f4a416c8640 1 -- 172.21.15.92:0/1303577141 learned_addr learned my addr 172.21.15.92:0/1303577141 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-11T00:14:59.723 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:59.719+0000 7f4a40ec7640 1 --2- 172.21.15.92:0/1303577141 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4a3c073780 0x7f4a3c142e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:59.723 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:59.719+0000 7f4a41ec9640 1 --2- 172.21.15.92:0/1303577141 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4a3c15c470 0x7f4a3c13abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:59.723 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:59.719+0000 7f4a416c8640 1 -- 172.21.15.92:0/1303577141 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4a3c15c470 msgr2=0x7f4a3c13abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:59.723 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:59.719+0000 7f4a416c8640 1 --2- 172.21.15.92:0/1303577141 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4a3c15c470 0x7f4a3c13abe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:59.723 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:59.719+0000 7f4a416c8640 1 -- 172.21.15.92:0/1303577141 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4a3c073780 msgr2=0x7f4a3c142e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:59.723 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:59.719+0000 7f4a416c8640 1 --2- 172.21.15.92:0/1303577141 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4a3c073780 0x7f4a3c142e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:59.723 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:59.719+0000 7f4a416c8640 1 -- 172.21.15.92:0/1303577141 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a3c0ab340 con 0x7f4a3c06f140 2024-09-11T00:14:59.723 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:59.719+0000 7f4a40ec7640 1 --2- 172.21.15.92:0/1303577141 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4a3c073780 0x7f4a3c142e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:14:59.723 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:59.719+0000 7f4a41ec9640 1 --2- 172.21.15.92:0/1303577141 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4a3c15c470 0x7f4a3c13abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:14:59.723 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:59.719+0000 7f4a416c8640 1 --2- 172.21.15.92:0/1303577141 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4a3c06f140 0x7f4a3c143d50 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f4a38009780 tx=0x7f4a38032d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:14:59.723 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:59.719+0000 7f4a31ffb640 1 -- 172.21.15.92:0/1303577141 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a38040070 con 0x7f4a3c06f140 2024-09-11T00:14:59.723 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:59.720+0000 7f4a31ffb640 1 -- 172.21.15.92:0/1303577141 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4a38005310 con 0x7f4a3c06f140 2024-09-11T00:14:59.723 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:59.720+0000 7f4a4392c640 1 -- 172.21.15.92:0/1303577141 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a3c143350 con 0x7f4a3c06f140 2024-09-11T00:14:59.723 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:59.720+0000 7f4a31ffb640 1 -- 172.21.15.92:0/1303577141 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a38003800 con 0x7f4a3c06f140 2024-09-11T00:14:59.724 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:59.720+0000 7f4a4392c640 1 -- 172.21.15.92:0/1303577141 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a3c1449a0 con 0x7f4a3c06f140 2024-09-11T00:14:59.724 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:59.721+0000 7f4a4392c640 1 -- 172.21.15.92:0/1303577141 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4a3c070080 con 0x7f4a3c06f140 2024-09-11T00:14:59.725 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:59.721+0000 7f4a31ffb640 1 -- 172.21.15.92:0/1303577141 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f4a3804c030 con 0x7f4a3c06f140 2024-09-11T00:14:59.725 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:59.722+0000 7f4a31ffb640 1 --2- 172.21.15.92:0/1303577141 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f4a20077f70 0x7f4a2007a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:59.725 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:59.722+0000 7f4a31ffb640 1 -- 172.21.15.92:0/1303577141 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6743+0+0 (secure 0 0 0) 0x7f4a380bb4a0 con 0x7f4a3c06f140 2024-09-11T00:14:59.725 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:59.722+0000 7f4a40ec7640 1 --2- 172.21.15.92:0/1303577141 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f4a20077f70 0x7f4a2007a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:59.725 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:59.723+0000 7f4a40ec7640 1 --2- 172.21.15.92:0/1303577141 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f4a20077f70 0x7f4a2007a430 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f4a3c13bc10 tx=0x7f4a2c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:14:59.727 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:59.726+0000 7f4a31ffb640 1 -- 172.21.15.92:0/1303577141 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f4a38083b90 con 0x7f4a3c06f140 2024-09-11T00:14:59.944 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:59.942+0000 7f4a4392c640 1 -- 172.21.15.92:0/1303577141 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4a3c140170 con 0x7f4a3c06f140 2024-09-11T00:14:59.944 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:59.943+0000 7f4a31ffb640 1 -- 172.21.15.92:0/1303577141 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5225 (secure 0 0 0) 0x7f4a38083490 con 0x7f4a3c06f140 2024-09-11T00:14:59.945 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:14:59.945 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":8,"btime":"2024-09-11T00:14:37:675941+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4286,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/2051794804","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":2051794804},{"type":"v1","addr":"172.21.15.92:6835","nonce":2051794804}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4295,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6835/1341143168","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6834","nonce":1341143168},{"type":"v1","addr":"172.21.15.145:6835","nonce":1341143168}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4356,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6833/3149311196","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":3149311196},{"type":"v1","addr":"172.21.15.92:6833","nonce":3149311196}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T00:14:17.969166+0000","modified":"2024-09-11T00:14:37.019981+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4374},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4374":{"gid":4374,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.145:6837/3236563974","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6836","nonce":3236563974},{"type":"v1","addr":"172.21.15.145:6837","nonce":3236563974}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4374,"qdb_cluster":[4374]},"id":1}]} 2024-09-11T00:14:59.945 INFO:teuthology.orchestra.run.smithi092.stderr:dumped fsmap epoch 8 2024-09-11T00:14:59.947 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:59.945+0000 7f4a4392c640 1 -- 172.21.15.92:0/1303577141 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f4a20077f70 msgr2=0x7f4a2007a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:59.948 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:59.945+0000 7f4a4392c640 1 --2- 172.21.15.92:0/1303577141 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f4a20077f70 0x7f4a2007a430 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f4a3c13bc10 tx=0x7f4a2c009040 comp rx=0 tx=0).stop 2024-09-11T00:14:59.948 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:59.945+0000 7f4a4392c640 1 -- 172.21.15.92:0/1303577141 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4a3c06f140 msgr2=0x7f4a3c143d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:59.948 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:59.945+0000 7f4a4392c640 1 --2- 172.21.15.92:0/1303577141 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4a3c06f140 0x7f4a3c143d50 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f4a38009780 tx=0x7f4a38032d50 comp rx=0 tx=0).stop 2024-09-11T00:14:59.948 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:59.945+0000 7f4a4392c640 1 -- 172.21.15.92:0/1303577141 shutdown_connections 2024-09-11T00:14:59.948 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:59.945+0000 7f4a4392c640 1 --2- 172.21.15.92:0/1303577141 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f4a20077f70 0x7f4a2007a430 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:59.948 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:59.945+0000 7f4a4392c640 1 --2- 172.21.15.92:0/1303577141 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4a3c15c470 0x7f4a3c13abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:59.949 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:59.945+0000 7f4a4392c640 1 --2- 172.21.15.92:0/1303577141 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4a3c073780 0x7f4a3c142e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:59.949 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:59.945+0000 7f4a4392c640 1 --2- 172.21.15.92:0/1303577141 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4a3c06f140 0x7f4a3c143d50 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:59.949 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:59.945+0000 7f4a4392c640 1 -- 172.21.15.92:0/1303577141 >> 172.21.15.92:0/1303577141 conn(0x7f4a3c0b1760 msgr2=0x7f4a3c0cec10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:14:59.949 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:59.945+0000 7f4a4392c640 1 -- 172.21.15.92:0/1303577141 shutdown_connections 2024-09-11T00:14:59.949 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:14:59.945+0000 7f4a4392c640 1 -- 172.21.15.92:0/1303577141 wait complete. 2024-09-11T00:14:59.958 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T00:15:00.059 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:00.057+0000 7f700b26e640 1 -- 172.21.15.92:0/2547310826 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6ff0003fd0 msgr2=0x7f6ff0004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:00.060 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:00.057+0000 7f700b26e640 1 --2- 172.21.15.92:0/2547310826 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6ff0003fd0 0x7f6ff0004800 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f6ff4009b80 tx=0x7f6ff0005830 comp rx=0 tx=0).stop 2024-09-11T00:15:00.060 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:00.057+0000 7f700980b640 1 -- 172.21.15.92:0/2547310826 reap_dead start 2024-09-11T00:15:00.060 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:00.057+0000 7f700b26e640 1 -- 172.21.15.92:0/2547310826 shutdown_connections 2024-09-11T00:15:00.060 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:00.057+0000 7f700b26e640 1 -- 172.21.15.92:0/2547310826 >> 172.21.15.92:0/2547310826 conn(0x7f70040b1760 msgr2=0x7f70040b1b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:15:00.060 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:00.057+0000 7f700b26e640 1 -- 172.21.15.92:0/2547310826 shutdown_connections 2024-09-11T00:15:00.060 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:00.057+0000 7f700b26e640 1 -- 172.21.15.92:0/2547310826 wait complete. 2024-09-11T00:15:00.062 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:00.059+0000 7f700b26e640 1 Processor -- start 2024-09-11T00:15:00.062 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:00.059+0000 7f700b26e640 1 -- start start 2024-09-11T00:15:00.062 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:00.059+0000 7f700b26e640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6ff0003fd0 0x7f7004145120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:00.062 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:00.059+0000 7f700b26e640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7004153fe0 0x7f7004155370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:00.062 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:00.059+0000 7f700b26e640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f70041558b0 0x7f7004152360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:00.063 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:00.059+0000 7f700b26e640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f700415e8c0 con 0x7f6ff0003fd0 2024-09-11T00:15:00.063 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:00.059+0000 7f700b26e640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f700415e740 con 0x7f7004153fe0 2024-09-11T00:15:00.063 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:00.059+0000 7f700b26e640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f70040cf110 con 0x7f70041558b0 2024-09-11T00:15:00.063 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:00.059+0000 7f700900a640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6ff0003fd0 0x7f7004145120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:00.063 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:00.059+0000 7f700900a640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6ff0003fd0 0x7f7004145120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:43732/0 (socket says 172.21.15.92:43732) 2024-09-11T00:15:00.063 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:00.059+0000 7f700900a640 1 -- 172.21.15.92:0/308830183 learned_addr learned my addr 172.21.15.92:0/308830183 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-11T00:15:00.063 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:00.060+0000 7f700900a640 1 -- 172.21.15.92:0/308830183 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f70041558b0 msgr2=0x7f7004152360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:00.063 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:00.060+0000 7f7008809640 1 --2- 172.21.15.92:0/308830183 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7004153fe0 0x7f7004155370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:00.063 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:00.060+0000 7f700980b640 1 --2- 172.21.15.92:0/308830183 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f70041558b0 0x7f7004152360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:00.063 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:00.060+0000 7f700900a640 1 --2- 172.21.15.92:0/308830183 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f70041558b0 0x7f7004152360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:00.063 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:00.060+0000 7f700900a640 1 -- 172.21.15.92:0/308830183 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7004153fe0 msgr2=0x7f7004155370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:00.063 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:00.060+0000 7f700900a640 1 --2- 172.21.15.92:0/308830183 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7004153fe0 0x7f7004155370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:00.063 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:00.060+0000 7f700900a640 1 -- 172.21.15.92:0/308830183 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7004152f40 con 0x7f6ff0003fd0 2024-09-11T00:15:00.063 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:00.060+0000 7f700900a640 1 --2- 172.21.15.92:0/308830183 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6ff0003fd0 0x7f7004145120 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f7000011a80 tx=0x7f7000011f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:15:00.064 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:00.060+0000 7f6ff9ffb640 1 -- 172.21.15.92:0/308830183 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f700000fe10 con 0x7f6ff0003fd0 2024-09-11T00:15:00.064 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:00.060+0000 7f6ff9ffb640 1 -- 172.21.15.92:0/308830183 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7000016070 con 0x7f6ff0003fd0 2024-09-11T00:15:00.064 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:00.060+0000 7f700b26e640 1 -- 172.21.15.92:0/308830183 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7004153220 con 0x7f6ff0003fd0 2024-09-11T00:15:00.064 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:00.060+0000 7f6ff9ffb640 1 -- 172.21.15.92:0/308830183 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7000012690 con 0x7f6ff0003fd0 2024-09-11T00:15:00.064 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:00.060+0000 7f700b26e640 1 -- 172.21.15.92:0/308830183 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70041537e0 con 0x7f6ff0003fd0 2024-09-11T00:15:00.065 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:00.061+0000 7f700b26e640 1 -- 172.21.15.92:0/308830183 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7004155cc0 con 0x7f6ff0003fd0 2024-09-11T00:15:00.065 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:00.062+0000 7f6ff9ffb640 1 -- 172.21.15.92:0/308830183 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f7000012830 con 0x7f6ff0003fd0 2024-09-11T00:15:00.065 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:00.062+0000 7f6ff9ffb640 1 --2- 172.21.15.92:0/308830183 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f6fe8077f70 0x7f6fe807a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:00.065 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:00.062+0000 7f6ff9ffb640 1 -- 172.21.15.92:0/308830183 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6743+0+0 (secure 0 0 0) 0x7f700009acf0 con 0x7f6ff0003fd0 2024-09-11T00:15:00.066 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:00.062+0000 7f7008809640 1 --2- 172.21.15.92:0/308830183 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f6fe8077f70 0x7f6fe807a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:00.066 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:00.063+0000 7f7008809640 1 --2- 172.21.15.92:0/308830183 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f6fe8077f70 0x7f6fe807a430 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f6ff4035000 tx=0x7f6ff402d040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:15:00.068 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:00.066+0000 7f6ff9ffb640 1 -- 172.21.15.92:0/308830183 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f7004155cc0 con 0x7f6ff0003fd0 2024-09-11T00:15:00.278 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:00.275+0000 7f700b26e640 1 -- 172.21.15.92:0/308830183 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f70040b47b0 con 0x7f6ff0003fd0 2024-09-11T00:15:00.278 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:00.276+0000 7f6ff9ffb640 1 -- 172.21.15.92:0/308830183 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5225 (secure 0 0 0) 0x7f700009f070 con 0x7f6ff0003fd0 2024-09-11T00:15:00.278 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:15:00.279 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":8,"btime":"2024-09-11T00:14:37:675941+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4286,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/2051794804","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":2051794804},{"type":"v1","addr":"172.21.15.92:6835","nonce":2051794804}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4295,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6835/1341143168","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6834","nonce":1341143168},{"type":"v1","addr":"172.21.15.145:6835","nonce":1341143168}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4356,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6833/3149311196","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":3149311196},{"type":"v1","addr":"172.21.15.92:6833","nonce":3149311196}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T00:14:17.969166+0000","modified":"2024-09-11T00:14:37.019981+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4374},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4374":{"gid":4374,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.145:6837/3236563974","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6836","nonce":3236563974},{"type":"v1","addr":"172.21.15.145:6837","nonce":3236563974}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4374,"qdb_cluster":[4374]},"id":1}]} 2024-09-11T00:15:00.279 INFO:teuthology.orchestra.run.smithi092.stderr:dumped fsmap epoch 8 2024-09-11T00:15:00.281 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:00.278+0000 7f700b26e640 1 -- 172.21.15.92:0/308830183 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f6fe8077f70 msgr2=0x7f6fe807a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:00.281 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:00.278+0000 7f700b26e640 1 --2- 172.21.15.92:0/308830183 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f6fe8077f70 0x7f6fe807a430 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f6ff4035000 tx=0x7f6ff402d040 comp rx=0 tx=0).stop 2024-09-11T00:15:00.281 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:00.278+0000 7f700b26e640 1 -- 172.21.15.92:0/308830183 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6ff0003fd0 msgr2=0x7f7004145120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:00.281 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:00.278+0000 7f700b26e640 1 --2- 172.21.15.92:0/308830183 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6ff0003fd0 0x7f7004145120 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f7000011a80 tx=0x7f7000011f40 comp rx=0 tx=0).stop 2024-09-11T00:15:00.281 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:00.278+0000 7f700b26e640 1 -- 172.21.15.92:0/308830183 shutdown_connections 2024-09-11T00:15:00.281 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:00.278+0000 7f700b26e640 1 --2- 172.21.15.92:0/308830183 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f6fe8077f70 0x7f6fe807a430 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:00.281 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:00.278+0000 7f700b26e640 1 --2- 172.21.15.92:0/308830183 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f70041558b0 0x7f7004152360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:00.282 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:00.278+0000 7f700b26e640 1 --2- 172.21.15.92:0/308830183 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7004153fe0 0x7f7004155370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:00.282 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:00.278+0000 7f700b26e640 1 --2- 172.21.15.92:0/308830183 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6ff0003fd0 0x7f7004145120 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:00.282 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:00.278+0000 7f700b26e640 1 -- 172.21.15.92:0/308830183 >> 172.21.15.92:0/308830183 conn(0x7f70040b1760 msgr2=0x7f70040b32c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:15:00.282 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:00.278+0000 7f700b26e640 1 -- 172.21.15.92:0/308830183 shutdown_connections 2024-09-11T00:15:00.282 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:00.278+0000 7f700b26e640 1 -- 172.21.15.92:0/308830183 wait complete. 2024-09-11T00:15:00.291 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T00:15:00.392 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:00.390+0000 7f03044a9640 1 -- 172.21.15.92:0/1288867484 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f02fc072680 msgr2=0x7f02fc0ceb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:00.392 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:00.390+0000 7f03044a9640 1 --2- 172.21.15.92:0/1288867484 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f02fc072680 0x7f02fc0ceb00 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f02fc06de10 tx=0x7f02ec02a560 comp rx=0 tx=0).stop 2024-09-11T00:15:00.393 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:00.390+0000 7f03044a9640 1 -- 172.21.15.92:0/1288867484 shutdown_connections 2024-09-11T00:15:00.393 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:00.390+0000 7f03044a9640 1 --2- 172.21.15.92:0/1288867484 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f02fc072680 0x7f02fc0ceb00 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:00.393 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:00.390+0000 7f03044a9640 1 --2- 172.21.15.92:0/1288867484 >> v2:172.21.15.145:3300/0 conn(0x7f02fc144780 0x7f02fc0b3da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:00.393 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:00.390+0000 7f03044a9640 1 -- 172.21.15.92:0/1288867484 >> 172.21.15.92:0/1288867484 conn(0x7f02fc0b1760 msgr2=0x7f02fc0b1b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:15:00.393 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:00.390+0000 7f03044a9640 1 -- 172.21.15.92:0/1288867484 shutdown_connections 2024-09-11T00:15:00.393 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:00.390+0000 7f03044a9640 1 -- 172.21.15.92:0/1288867484 wait complete. 2024-09-11T00:15:00.396 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:00.391+0000 7f03044a9640 1 Processor -- start 2024-09-11T00:15:00.396 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:00.391+0000 7f03044a9640 1 -- start start 2024-09-11T00:15:00.396 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:00.392+0000 7f03044a9640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f02fc072680 0x7f02fc141d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:00.396 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:00.392+0000 7f03044a9640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f02fc072ad0 0x7f02fc13d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:00.396 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:00.392+0000 7f03044a9640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f02fc144780 0x7f02fc1e8e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:00.396 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:00.392+0000 7f03044a9640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f02fc0cf3d0 con 0x7f02fc144780 2024-09-11T00:15:00.396 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:00.392+0000 7f03044a9640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f02fc0cf250 con 0x7f02fc072ad0 2024-09-11T00:15:00.397 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:00.392+0000 7f03044a9640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f02fc15cc60 con 0x7f02fc072680 2024-09-11T00:15:00.397 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:00.392+0000 7f0302a46640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f02fc144780 0x7f02fc1e8e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:00.397 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:00.392+0000 7f0302a46640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f02fc144780 0x7f02fc1e8e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:43738/0 (socket says 172.21.15.92:43738) 2024-09-11T00:15:00.397 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:00.392+0000 7f0302a46640 1 -- 172.21.15.92:0/1665413816 learned_addr learned my addr 172.21.15.92:0/1665413816 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-11T00:15:00.397 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:00.392+0000 7f0301a44640 1 --2- 172.21.15.92:0/1665413816 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f02fc072ad0 0x7f02fc13d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:00.397 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:00.392+0000 7f0302245640 1 --2- 172.21.15.92:0/1665413816 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f02fc072680 0x7f02fc141d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:00.397 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:00.392+0000 7f0302a46640 1 -- 172.21.15.92:0/1665413816 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f02fc072680 msgr2=0x7f02fc141d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:00.397 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:00.392+0000 7f0302a46640 1 --2- 172.21.15.92:0/1665413816 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f02fc072680 0x7f02fc141d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:00.397 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:00.392+0000 7f0302a46640 1 -- 172.21.15.92:0/1665413816 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f02fc072ad0 msgr2=0x7f02fc13d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:00.397 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:00.392+0000 7f0302a46640 1 --2- 172.21.15.92:0/1665413816 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f02fc072ad0 0x7f02fc13d680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:00.397 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:00.392+0000 7f0302a46640 1 -- 172.21.15.92:0/1665413816 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02fc13dbc0 con 0x7f02fc144780 2024-09-11T00:15:00.397 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:00.393+0000 7f0302245640 1 --2- 172.21.15.92:0/1665413816 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f02fc072680 0x7f02fc141d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:15:00.398 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:00.393+0000 7f0301a44640 1 --2- 172.21.15.92:0/1665413816 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f02fc072ad0 0x7f02fc13d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:15:00.398 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:00.393+0000 7f0302a46640 1 --2- 172.21.15.92:0/1665413816 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f02fc144780 0x7f02fc1e8e60 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f02f400c7d0 tx=0x7f02f400cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:15:00.398 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:00.393+0000 7f02f2ffd640 1 -- 172.21.15.92:0/1665413816 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02f4003b70 con 0x7f02fc144780 2024-09-11T00:15:00.398 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:00.393+0000 7f02f2ffd640 1 -- 172.21.15.92:0/1665413816 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f02f4003d10 con 0x7f02fc144780 2024-09-11T00:15:00.398 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:00.393+0000 7f03044a9640 1 -- 172.21.15.92:0/1665413816 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02fc1f8280 con 0x7f02fc144780 2024-09-11T00:15:00.398 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:00.393+0000 7f02f2ffd640 1 -- 172.21.15.92:0/1665413816 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02f400aab0 con 0x7f02fc144780 2024-09-11T00:15:00.399 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:00.393+0000 7f03044a9640 1 -- 172.21.15.92:0/1665413816 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02fc1f8840 con 0x7f02fc144780 2024-09-11T00:15:00.399 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:00.394+0000 7f03044a9640 1 -- 172.21.15.92:0/1665413816 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f02fc0ceb00 con 0x7f02fc144780 2024-09-11T00:15:00.399 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:00.395+0000 7f02f2ffd640 1 -- 172.21.15.92:0/1665413816 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f02f400ac50 con 0x7f02fc144780 2024-09-11T00:15:00.401 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:00.395+0000 7f02f2ffd640 1 --2- 172.21.15.92:0/1665413816 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f02e0077f70 0x7f02e007a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:00.401 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:00.395+0000 7f02f2ffd640 1 -- 172.21.15.92:0/1665413816 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6743+0+0 (secure 0 0 0) 0x7f02f4099f10 con 0x7f02fc144780 2024-09-11T00:15:00.401 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:00.395+0000 7f0302245640 1 --2- 172.21.15.92:0/1665413816 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f02e0077f70 0x7f02e007a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:00.401 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:00.396+0000 7f0302245640 1 --2- 172.21.15.92:0/1665413816 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f02e0077f70 0x7f02e007a430 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f02f800bbc0 tx=0x7f02f8005ef0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:15:00.401 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:00.399+0000 7f02f2ffd640 1 -- 172.21.15.92:0/1665413816 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f02f4062690 con 0x7f02fc144780 2024-09-11T00:15:00.579 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:00.577+0000 7f03044a9640 1 -- 172.21.15.92:0/1665413816 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f02fc0b4d40 con 0x7f02fc144780 2024-09-11T00:15:00.580 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:00.578+0000 7f02f2ffd640 1 -- 172.21.15.92:0/1665413816 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+19029 (secure 0 0 0) 0x7f02f4061f90 con 0x7f02fc144780 2024-09-11T00:15:00.580 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:15:00.581 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":27,"fsid":"47039cb3-5d2a-46bf-9066-8055b5dfc583","created":"2024-09-11T00:13:53.889939+0000","modified":"2024-09-11T00:14:59.757760+0000","last_up_change":"2024-09-11T00:14:06.563107+0000","last_in_change":"2024-09-11T00:13:56.982537+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T00:14:06.287223+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-11T00:14:15.739528+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-11T00:14:16.925480+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-11T00:14:20.639419+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"538af0ea-96c9-4999-9ccc-bee55f80ff76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":2860560077},{"type":"v1","addr":"172.21.15.92:6801","nonce":2860560077}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":2860560077},{"type":"v1","addr":"172.21.15.92:6803","nonce":2860560077}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":2860560077},{"type":"v1","addr":"172.21.15.92:6807","nonce":2860560077}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":2860560077},{"type":"v1","addr":"172.21.15.92:6805","nonce":2860560077}]},"public_addr":"172.21.15.92:6801/2860560077","cluster_addr":"172.21.15.92:6803/2860560077","heartbeat_back_addr":"172.21.15.92:6807/2860560077","heartbeat_front_addr":"172.21.15.92:6805/2860560077","state":["exists","up"]},{"osd":1,"uuid":"f9214f2c-ffe6-4447-9a13-9549a36e0537","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":2600417443},{"type":"v1","addr":"172.21.15.92:6817","nonce":2600417443}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6818","nonce":2600417443},{"type":"v1","addr":"172.21.15.92:6819","nonce":2600417443}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6822","nonce":2600417443},{"type":"v1","addr":"172.21.15.92:6823","nonce":2600417443}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":2600417443},{"type":"v1","addr":"172.21.15.92:6821","nonce":2600417443}]},"public_addr":"172.21.15.92:6817/2600417443","cluster_addr":"172.21.15.92:6819/2600417443","heartbeat_back_addr":"172.21.15.92:6823/2600417443","heartbeat_front_addr":"172.21.15.92:6821/2600417443","state":["exists","up"]},{"osd":2,"uuid":"b44dd849-fb85-42b1-8a1a-b6681bb1f467","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":3143892898},{"type":"v1","addr":"172.21.15.92:6809","nonce":3143892898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":3143892898},{"type":"v1","addr":"172.21.15.92:6811","nonce":3143892898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":3143892898},{"type":"v1","addr":"172.21.15.92:6815","nonce":3143892898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":3143892898},{"type":"v1","addr":"172.21.15.92:6813","nonce":3143892898}]},"public_addr":"172.21.15.92:6809/3143892898","cluster_addr":"172.21.15.92:6811/3143892898","heartbeat_back_addr":"172.21.15.92:6815/3143892898","heartbeat_front_addr":"172.21.15.92:6813/3143892898","state":["exists","up"]},{"osd":3,"uuid":"05a49d87-23b9-48dd-962c-d5c2686e7a32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":3913961488},{"type":"v1","addr":"172.21.15.92:6825","nonce":3913961488}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6826","nonce":3913961488},{"type":"v1","addr":"172.21.15.92:6827","nonce":3913961488}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":3913961488},{"type":"v1","addr":"172.21.15.92:6831","nonce":3913961488}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":3913961488},{"type":"v1","addr":"172.21.15.92:6829","nonce":3913961488}]},"public_addr":"172.21.15.92:6825/3913961488","cluster_addr":"172.21.15.92:6827/3913961488","heartbeat_back_addr":"172.21.15.92:6831/3913961488","heartbeat_front_addr":"172.21.15.92:6829/3913961488","state":["exists","up"]},{"osd":4,"uuid":"cf52b087-afe0-4f43-a4e7-db2ebc158815","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6826","nonce":2206798907},{"type":"v1","addr":"172.21.15.145:6827","nonce":2206798907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6828","nonce":2206798907},{"type":"v1","addr":"172.21.15.145:6829","nonce":2206798907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6832","nonce":2206798907},{"type":"v1","addr":"172.21.15.145:6833","nonce":2206798907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6830","nonce":2206798907},{"type":"v1","addr":"172.21.15.145:6831","nonce":2206798907}]},"public_addr":"172.21.15.145:6827/2206798907","cluster_addr":"172.21.15.145:6829/2206798907","heartbeat_back_addr":"172.21.15.145:6833/2206798907","heartbeat_front_addr":"172.21.15.145:6831/2206798907","state":["exists","up"]},{"osd":5,"uuid":"0e54adcd-2d1d-49fb-bf97-3dd7e9addd30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6810","nonce":2599548493},{"type":"v1","addr":"172.21.15.145:6811","nonce":2599548493}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6812","nonce":2599548493},{"type":"v1","addr":"172.21.15.145:6813","nonce":2599548493}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6816","nonce":2599548493},{"type":"v1","addr":"172.21.15.145:6817","nonce":2599548493}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6814","nonce":2599548493},{"type":"v1","addr":"172.21.15.145:6815","nonce":2599548493}]},"public_addr":"172.21.15.145:6811/2599548493","cluster_addr":"172.21.15.145:6813/2599548493","heartbeat_back_addr":"172.21.15.145:6817/2599548493","heartbeat_front_addr":"172.21.15.145:6815/2599548493","state":["exists","up"]},{"osd":6,"uuid":"4d5ae7a8-b3df-4c7a-9124-290f239f5b57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6802","nonce":4192380792},{"type":"v1","addr":"172.21.15.145:6803","nonce":4192380792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6804","nonce":4192380792},{"type":"v1","addr":"172.21.15.145:6805","nonce":4192380792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6808","nonce":4192380792},{"type":"v1","addr":"172.21.15.145:6809","nonce":4192380792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6806","nonce":4192380792},{"type":"v1","addr":"172.21.15.145:6807","nonce":4192380792}]},"public_addr":"172.21.15.145:6803/4192380792","cluster_addr":"172.21.15.145:6805/4192380792","heartbeat_back_addr":"172.21.15.145:6809/4192380792","heartbeat_front_addr":"172.21.15.145:6807/4192380792","state":["exists","up"]},{"osd":7,"uuid":"d7e36444-6e3f-4372-81d3-88e7b4e993f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6818","nonce":3010598400},{"type":"v1","addr":"172.21.15.145:6819","nonce":3010598400}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6820","nonce":3010598400},{"type":"v1","addr":"172.21.15.145:6821","nonce":3010598400}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6824","nonce":3010598400},{"type":"v1","addr":"172.21.15.145:6825","nonce":3010598400}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6822","nonce":3010598400},{"type":"v1","addr":"172.21.15.145:6823","nonce":3010598400}]},"public_addr":"172.21.15.145:6819/3010598400","cluster_addr":"172.21.15.145:6821/3010598400","heartbeat_back_addr":"172.21.15.145:6825/3010598400","heartbeat_front_addr":"172.21.15.145:6823/3010598400","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:14:03.281892+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:14:04.039021+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:14:03.045775+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:14:03.708856+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:14:04.425520+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:14:03.839369+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:14:03.029834+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:14:03.707529+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":3,"to":2}]},{"pgid":"3.16","mappings":[{"from":5,"to":2},{"from":7,"to":1}]},{"pgid":"3.2a","mappings":[{"from":5,"to":2}]},{"pgid":"3.38","mappings":[{"from":3,"to":1}]},{"pgid":"4.0","mappings":[{"from":1,"to":2}]},{"pgid":"4.17","mappings":[{"from":1,"to":2}]},{"pgid":"4.1e","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T00:15:00.583 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:00.581+0000 7f03044a9640 1 -- 172.21.15.92:0/1665413816 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f02e0077f70 msgr2=0x7f02e007a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:00.583 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:00.581+0000 7f03044a9640 1 --2- 172.21.15.92:0/1665413816 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f02e0077f70 0x7f02e007a430 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f02f800bbc0 tx=0x7f02f8005ef0 comp rx=0 tx=0).stop 2024-09-11T00:15:00.583 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:00.581+0000 7f03044a9640 1 -- 172.21.15.92:0/1665413816 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f02fc144780 msgr2=0x7f02fc1e8e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:00.583 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:00.581+0000 7f03044a9640 1 --2- 172.21.15.92:0/1665413816 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f02fc144780 0x7f02fc1e8e60 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f02f400c7d0 tx=0x7f02f400cc90 comp rx=0 tx=0).stop 2024-09-11T00:15:00.583 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:00.581+0000 7f03044a9640 1 -- 172.21.15.92:0/1665413816 shutdown_connections 2024-09-11T00:15:00.583 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:00.581+0000 7f03044a9640 1 --2- 172.21.15.92:0/1665413816 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f02e0077f70 0x7f02e007a430 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:00.583 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:00.581+0000 7f03044a9640 1 --2- 172.21.15.92:0/1665413816 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f02fc144780 0x7f02fc1e8e60 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:00.583 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:00.581+0000 7f03044a9640 1 --2- 172.21.15.92:0/1665413816 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f02fc072ad0 0x7f02fc13d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:00.583 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:00.581+0000 7f03044a9640 1 --2- 172.21.15.92:0/1665413816 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f02fc072680 0x7f02fc141d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:00.583 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:00.581+0000 7f03044a9640 1 -- 172.21.15.92:0/1665413816 >> 172.21.15.92:0/1665413816 conn(0x7f02fc0b1760 msgr2=0x7f02fc15e5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:15:00.584 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:00.581+0000 7f03044a9640 1 -- 172.21.15.92:0/1665413816 shutdown_connections 2024-09-11T00:15:00.584 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:00.581+0000 7f03044a9640 1 -- 172.21.15.92:0/1665413816 wait complete. 2024-09-11T00:15:00.594 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-11T00:15:00.695 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:00.694+0000 7f6a57059640 1 -- 172.21.15.92:0/177191660 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6a50161a20 msgr2=0x7f6a500b42e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:00.696 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:00.694+0000 7f6a57059640 1 --2- 172.21.15.92:0/177191660 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6a50161a20 0x7f6a500b42e0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f6a44009830 tx=0x7f6a4402a3f0 comp rx=0 tx=0).stop 2024-09-11T00:15:00.696 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:00.694+0000 7f6a57059640 1 -- 172.21.15.92:0/177191660 shutdown_connections 2024-09-11T00:15:00.696 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:00.694+0000 7f6a57059640 1 --2- 172.21.15.92:0/177191660 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6a500cff20 0x7f6a500d03d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:00.696 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:00.694+0000 7f6a57059640 1 --2- 172.21.15.92:0/177191660 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6a50161a20 0x7f6a500b42e0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:00.696 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:00.694+0000 7f6a57059640 1 -- 172.21.15.92:0/177191660 >> 172.21.15.92:0/177191660 conn(0x7f6a500b37c0 msgr2=0x7f6a500b3bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:15:00.696 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:00.694+0000 7f6a57059640 1 -- 172.21.15.92:0/177191660 shutdown_connections 2024-09-11T00:15:00.696 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:00.694+0000 7f6a57059640 1 -- 172.21.15.92:0/177191660 wait complete. 2024-09-11T00:15:00.699 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:00.695+0000 7f6a57059640 1 Processor -- start 2024-09-11T00:15:00.699 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:00.695+0000 7f6a57059640 1 -- start start 2024-09-11T00:15:00.699 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:00.696+0000 7f6a57059640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6a500b31c0 0x7f6a500c8d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:00.699 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:00.696+0000 7f6a57059640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6a500cff20 0x7f6a501f4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:00.699 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:00.696+0000 7f6a57059640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6a50161a20 0x7f6a501f8d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:00.699 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:00.696+0000 7f6a57059640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f6a500d0910 con 0x7f6a500cff20 2024-09-11T00:15:00.699 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:00.696+0000 7f6a57059640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f6a500d0a90 con 0x7f6a500b31c0 2024-09-11T00:15:00.699 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:00.696+0000 7f6a57059640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f6a500d0c10 con 0x7f6a50161a20 2024-09-11T00:15:00.699 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:00.696+0000 7f6a4ffff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6a500cff20 0x7f6a501f4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:00.700 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:00.696+0000 7f6a4ffff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6a500cff20 0x7f6a501f4d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:43748/0 (socket says 172.21.15.92:43748) 2024-09-11T00:15:00.700 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:00.696+0000 7f6a4ffff640 1 -- 172.21.15.92:0/709178045 learned_addr learned my addr 172.21.15.92:0/709178045 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-11T00:15:00.700 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:00.696+0000 7f6a54df5640 1 --2- 172.21.15.92:0/709178045 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6a500b31c0 0x7f6a500c8d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:00.700 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:00.696+0000 7f6a555f6640 1 --2- 172.21.15.92:0/709178045 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6a50161a20 0x7f6a501f8d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:00.700 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:00.696+0000 7f6a4ffff640 1 -- 172.21.15.92:0/709178045 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6a50161a20 msgr2=0x7f6a501f8d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:00.700 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:00.696+0000 7f6a4ffff640 1 --2- 172.21.15.92:0/709178045 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6a50161a20 0x7f6a501f8d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:00.700 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:00.696+0000 7f6a4ffff640 1 -- 172.21.15.92:0/709178045 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6a500b31c0 msgr2=0x7f6a500c8d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:00.700 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:00.696+0000 7f6a4ffff640 1 --2- 172.21.15.92:0/709178045 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6a500b31c0 0x7f6a500c8d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:00.700 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:00.696+0000 7f6a4ffff640 1 -- 172.21.15.92:0/709178045 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a501f92d0 con 0x7f6a500cff20 2024-09-11T00:15:00.700 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:00.696+0000 7f6a4ffff640 1 --2- 172.21.15.92:0/709178045 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6a500cff20 0x7f6a501f4d90 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f6a3c00c430 tx=0x7f6a3c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:15:00.700 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:00.696+0000 7f6a4d7fa640 1 -- 172.21.15.92:0/709178045 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a3c017070 con 0x7f6a500cff20 2024-09-11T00:15:00.700 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:00.696+0000 7f6a4d7fa640 1 -- 172.21.15.92:0/709178045 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6a3c0035f0 con 0x7f6a500cff20 2024-09-11T00:15:00.701 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:00.696+0000 7f6a4d7fa640 1 -- 172.21.15.92:0/709178045 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a3c003ac0 con 0x7f6a500cff20 2024-09-11T00:15:00.701 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:00.696+0000 7f6a57059640 1 -- 172.21.15.92:0/709178045 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a501f5450 con 0x7f6a500cff20 2024-09-11T00:15:00.701 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:00.697+0000 7f6a57059640 1 -- 172.21.15.92:0/709178045 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a501f5a10 con 0x7f6a500cff20 2024-09-11T00:15:00.701 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:00.697+0000 7f6a57059640 1 -- 172.21.15.92:0/709178045 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6a501f5d50 con 0x7f6a500cff20 2024-09-11T00:15:00.702 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:00.698+0000 7f6a4d7fa640 1 -- 172.21.15.92:0/709178045 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f6a3c003c60 con 0x7f6a500cff20 2024-09-11T00:15:00.702 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:00.699+0000 7f6a4d7fa640 1 --2- 172.21.15.92:0/709178045 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f6a34077f70 0x7f6a3407a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:00.702 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:00.699+0000 7f6a4d7fa640 1 -- 172.21.15.92:0/709178045 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6743+0+0 (secure 0 0 0) 0x7f6a3c0996f0 con 0x7f6a500cff20 2024-09-11T00:15:00.702 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:00.699+0000 7f6a54df5640 1 --2- 172.21.15.92:0/709178045 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f6a34077f70 0x7f6a3407a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:00.702 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:00.699+0000 7f6a54df5640 1 --2- 172.21.15.92:0/709178045 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f6a34077f70 0x7f6a3407a430 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f6a44034000 tx=0x7f6a44004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:15:00.704 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:00.703+0000 7f6a4d7fa640 1 -- 172.21.15.92:0/709178045 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f6a501f5d50 con 0x7f6a500cff20 2024-09-11T00:15:00.912 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:00.911+0000 7f6a57059640 1 -- 172.21.15.92:0/709178045 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f6a500ccf60 con 0x7f6a500cff20 2024-09-11T00:15:00.913 INFO:tasks.ceph.mon.a.smithi092.stderr:2024-09-11T00:15:00.912+0000 7fd1c705d640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-11T00:15:00.914 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:00.913+0000 7f6a4d7fa640 1 -- 172.21.15.92:0/709178045 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v9) ==== 161+0+0 (secure 0 0 0) 0x7f6a500ccf60 con 0x7f6a500cff20 2024-09-11T00:15:00.914 INFO:teuthology.orchestra.run.smithi092.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-11T00:15:00.917 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:00.916+0000 7f6a57059640 1 -- 172.21.15.92:0/709178045 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f6a34077f70 msgr2=0x7f6a3407a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:00.917 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:00.916+0000 7f6a57059640 1 --2- 172.21.15.92:0/709178045 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f6a34077f70 0x7f6a3407a430 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f6a44034000 tx=0x7f6a44004730 comp rx=0 tx=0).stop 2024-09-11T00:15:00.918 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:00.916+0000 7f6a57059640 1 -- 172.21.15.92:0/709178045 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6a500cff20 msgr2=0x7f6a501f4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:00.918 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:00.916+0000 7f6a57059640 1 --2- 172.21.15.92:0/709178045 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6a500cff20 0x7f6a501f4d90 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f6a3c00c430 tx=0x7f6a3c00c8f0 comp rx=0 tx=0).stop 2024-09-11T00:15:00.918 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:00.916+0000 7f6a57059640 1 -- 172.21.15.92:0/709178045 shutdown_connections 2024-09-11T00:15:00.918 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:00.916+0000 7f6a57059640 1 --2- 172.21.15.92:0/709178045 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f6a34077f70 0x7f6a3407a430 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:00.918 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:00.916+0000 7f6a57059640 1 --2- 172.21.15.92:0/709178045 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6a50161a20 0x7f6a501f8d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:00.918 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:00.916+0000 7f6a57059640 1 --2- 172.21.15.92:0/709178045 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6a500cff20 0x7f6a501f4d90 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:00.918 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:00.916+0000 7f6a57059640 1 --2- 172.21.15.92:0/709178045 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6a500b31c0 0x7f6a500c8d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:00.918 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:00.916+0000 7f6a57059640 1 -- 172.21.15.92:0/709178045 >> 172.21.15.92:0/709178045 conn(0x7f6a500b37c0 msgr2=0x7f6a500cc850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:15:00.918 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:00.916+0000 7f6a57059640 1 -- 172.21.15.92:0/709178045 shutdown_connections 2024-09-11T00:15:00.918 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:00.916+0000 7f6a57059640 1 -- 172.21.15.92:0/709178045 wait complete. 2024-09-11T00:15:00.921 INFO:tasks.ceph.mds.b.smithi145.stderr: -4353> 2024-09-11T00:14:23.537+0000 7ff8fb2e3640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-11T00:15:00.928 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-11T00:15:00.953 INFO:tasks.ceph.mds.b.smithi145.stdout:starting mds.b at 2024-09-11T00:15:01.032 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:01.030+0000 7fee7bf32640 1 -- 172.21.15.92:0/2603663976 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fee74144780 msgr2=0x7fee740b3da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:01.032 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:01.030+0000 7fee7bf32640 1 --2- 172.21.15.92:0/2603663976 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fee74144780 0x7fee740b3da0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fee7415e6b0 tx=0x7fee7002a4d0 comp rx=0 tx=0).stop 2024-09-11T00:15:01.032 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:01.030+0000 7fee7bf32640 1 -- 172.21.15.92:0/2603663976 shutdown_connections 2024-09-11T00:15:01.032 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:01.030+0000 7fee7bf32640 1 --2- 172.21.15.92:0/2603663976 >> v2:172.21.15.145:3300/0 conn(0x7fee74072680 0x7fee740ceb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:01.032 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:01.030+0000 7fee7bf32640 1 --2- 172.21.15.92:0/2603663976 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fee74144780 0x7fee740b3da0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:01.032 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:01.030+0000 7fee7bf32640 1 -- 172.21.15.92:0/2603663976 >> 172.21.15.92:0/2603663976 conn(0x7fee740b1760 msgr2=0x7fee740b1b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:15:01.032 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:01.030+0000 7fee7bf32640 1 -- 172.21.15.92:0/2603663976 shutdown_connections 2024-09-11T00:15:01.032 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:01.030+0000 7fee7bf32640 1 -- 172.21.15.92:0/2603663976 wait complete. 2024-09-11T00:15:01.033 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:01.031+0000 7fee7bf32640 1 Processor -- start 2024-09-11T00:15:01.033 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:01.031+0000 7fee7bf32640 1 -- start start 2024-09-11T00:15:01.035 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:01.032+0000 7fee7bf32640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fee74072680 0x7fee7413a450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:01.035 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:01.032+0000 7fee7bf32640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fee74072ad0 0x7fee740a9480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:01.035 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:01.032+0000 7fee7bf32640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fee74144780 0x7fee740a99c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:01.035 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:01.032+0000 7fee7bf32640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fee740cf3d0 con 0x7fee74072680 2024-09-11T00:15:01.035 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:01.032+0000 7fee7bf32640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fee740cf250 con 0x7fee74144780 2024-09-11T00:15:01.035 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:01.032+0000 7fee7bf32640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7fee7415cc60 con 0x7fee74072ad0 2024-09-11T00:15:01.035 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:01.032+0000 7fee79cce640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fee74072680 0x7fee7413a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:01.035 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:01.032+0000 7fee79cce640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fee74072680 0x7fee7413a450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:43764/0 (socket says 172.21.15.92:43764) 2024-09-11T00:15:01.035 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:01.032+0000 7fee79cce640 1 -- 172.21.15.92:0/442951345 learned_addr learned my addr 172.21.15.92:0/442951345 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-11T00:15:01.035 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:01.032+0000 7fee794cd640 1 --2- 172.21.15.92:0/442951345 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fee74072ad0 0x7fee740a9480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:01.036 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:01.032+0000 7fee7a4cf640 1 --2- 172.21.15.92:0/442951345 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fee74144780 0x7fee740a99c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:01.036 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:01.032+0000 7fee79cce640 1 -- 172.21.15.92:0/442951345 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fee74072ad0 msgr2=0x7fee740a9480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:01.036 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:01.032+0000 7fee79cce640 1 --2- 172.21.15.92:0/442951345 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fee74072ad0 0x7fee740a9480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:01.036 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:01.032+0000 7fee79cce640 1 -- 172.21.15.92:0/442951345 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fee74144780 msgr2=0x7fee740a99c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:01.036 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:01.032+0000 7fee79cce640 1 --2- 172.21.15.92:0/442951345 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fee74144780 0x7fee740a99c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:01.036 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:01.032+0000 7fee79cce640 1 -- 172.21.15.92:0/442951345 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee7414e150 con 0x7fee74072680 2024-09-11T00:15:01.036 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:01.032+0000 7fee794cd640 1 --2- 172.21.15.92:0/442951345 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fee74072ad0 0x7fee740a9480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:15:01.036 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:01.032+0000 7fee79cce640 1 --2- 172.21.15.92:0/442951345 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fee74072680 0x7fee7413a450 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fee70034040 tx=0x7fee700039e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:15:01.036 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:01.032+0000 7fee6a7fc640 1 -- 172.21.15.92:0/442951345 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee7003e030 con 0x7fee74072680 2024-09-11T00:15:01.036 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:01.032+0000 7fee6a7fc640 1 -- 172.21.15.92:0/442951345 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fee700047a0 con 0x7fee74072680 2024-09-11T00:15:01.036 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:01.032+0000 7fee6a7fc640 1 -- 172.21.15.92:0/442951345 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee70035040 con 0x7fee74072680 2024-09-11T00:15:01.036 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:01.032+0000 7fee7bf32640 1 -- 172.21.15.92:0/442951345 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee7414eed0 con 0x7fee74072680 2024-09-11T00:15:01.036 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:01.033+0000 7fee7bf32640 1 -- 172.21.15.92:0/442951345 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fee7414e6d0 con 0x7fee74072680 2024-09-11T00:15:01.037 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:01.034+0000 7fee7bf32640 1 -- 172.21.15.92:0/442951345 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fee740ceb00 con 0x7fee74072680 2024-09-11T00:15:01.037 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:01.034+0000 7fee6a7fc640 1 -- 172.21.15.92:0/442951345 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fee70004b70 con 0x7fee74072680 2024-09-11T00:15:01.037 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:01.035+0000 7fee6a7fc640 1 --2- 172.21.15.92:0/442951345 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7fee58077f70 0x7fee5807a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:01.037 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:01.035+0000 7fee6a7fc640 1 -- 172.21.15.92:0/442951345 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6829+0+0 (secure 0 0 0) 0x7fee700bacb0 con 0x7fee74072680 2024-09-11T00:15:01.038 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:01.035+0000 7fee794cd640 1 --2- 172.21.15.92:0/442951345 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7fee58077f70 0x7fee5807a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:01.038 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:01.035+0000 7fee794cd640 1 --2- 172.21.15.92:0/442951345 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7fee58077f70 0x7fee5807a430 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fee740af640 tx=0x7fee6400a5c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:15:01.040 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:01.039+0000 7fee6a7fc640 1 -- 172.21.15.92:0/442951345 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fee70083350 con 0x7fee74072680 2024-09-11T00:15:01.251 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:01.250+0000 7fee7bf32640 1 -- 172.21.15.92:0/442951345 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7fee740b4d40 con 0x7fee74072680 2024-09-11T00:15:01.916 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:01.915+0000 7fee6a7fc640 1 -- 172.21.15.92:0/442951345 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v10) ==== 104+0+0 (secure 0 0 0) 0x7fee70082c50 con 0x7fee74072680 2024-09-11T00:15:01.919 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:01.917+0000 7fee7bf32640 1 -- 172.21.15.92:0/442951345 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7fee58077f70 msgr2=0x7fee5807a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:01.919 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:01.917+0000 7fee7bf32640 1 --2- 172.21.15.92:0/442951345 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7fee58077f70 0x7fee5807a430 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fee740af640 tx=0x7fee6400a5c0 comp rx=0 tx=0).stop 2024-09-11T00:15:01.919 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:01.917+0000 7fee7bf32640 1 -- 172.21.15.92:0/442951345 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fee74072680 msgr2=0x7fee7413a450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:01.919 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:01.917+0000 7fee7bf32640 1 --2- 172.21.15.92:0/442951345 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fee74072680 0x7fee7413a450 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fee70034040 tx=0x7fee700039e0 comp rx=0 tx=0).stop 2024-09-11T00:15:01.919 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:01.917+0000 7fee7bf32640 1 -- 172.21.15.92:0/442951345 shutdown_connections 2024-09-11T00:15:01.920 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:01.917+0000 7fee7bf32640 1 --2- 172.21.15.92:0/442951345 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7fee58077f70 0x7fee5807a430 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:01.920 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:01.917+0000 7fee7bf32640 1 --2- 172.21.15.92:0/442951345 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fee74144780 0x7fee740a99c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:01.920 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:01.917+0000 7fee7bf32640 1 --2- 172.21.15.92:0/442951345 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fee74072ad0 0x7fee740a9480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:01.920 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:01.917+0000 7fee7bf32640 1 --2- 172.21.15.92:0/442951345 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fee74072680 0x7fee7413a450 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:01.920 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:01.917+0000 7fee7bf32640 1 -- 172.21.15.92:0/442951345 >> 172.21.15.92:0/442951345 conn(0x7fee740b1760 msgr2=0x7fee740cfd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:15:01.920 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:01.917+0000 7fee7bf32640 1 -- 172.21.15.92:0/442951345 shutdown_connections 2024-09-11T00:15:01.920 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:01.917+0000 7fee7bf32640 1 -- 172.21.15.92:0/442951345 wait complete. 2024-09-11T00:15:01.932 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-11T00:15:02.040 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:02.038+0000 7f814fbec640 1 -- 172.21.15.92:0/2550101716 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f814815f230 msgr2=0x7f81480b5950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:02.040 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:02.038+0000 7f814fbec640 1 --2- 172.21.15.92:0/2550101716 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f814815f230 0x7f81480b5950 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f8138005fd0 tx=0x7f813802a8b0 comp rx=0 tx=0).stop 2024-09-11T00:15:02.040 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:02.038+0000 7f814fbec640 1 -- 172.21.15.92:0/2550101716 shutdown_connections 2024-09-11T00:15:02.040 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:02.038+0000 7f814fbec640 1 --2- 172.21.15.92:0/2550101716 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f81480d09c0 0x7f81480b5e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:02.040 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:02.038+0000 7f814fbec640 1 --2- 172.21.15.92:0/2550101716 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f814815f230 0x7f81480b5950 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:02.040 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:02.038+0000 7f814fbec640 1 -- 172.21.15.92:0/2550101716 >> 172.21.15.92:0/2550101716 conn(0x7f8148074150 msgr2=0x7f8148074560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:15:02.040 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:02.038+0000 7f814fbec640 1 -- 172.21.15.92:0/2550101716 shutdown_connections 2024-09-11T00:15:02.041 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:02.038+0000 7f814fbec640 1 -- 172.21.15.92:0/2550101716 wait complete. 2024-09-11T00:15:02.043 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:02.039+0000 7f814fbec640 1 Processor -- start 2024-09-11T00:15:02.043 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:02.039+0000 7f814fbec640 1 -- start start 2024-09-11T00:15:02.043 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:02.040+0000 7f814fbec640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f81480694d0 0x7f81481e7210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:02.043 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:02.040+0000 7f814fbec640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f81480d09c0 0x7f81481e5d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:02.043 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:02.040+0000 7f814fbec640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f814815f230 0x7f81481f2be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:02.043 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:02.040+0000 7f814fbec640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f81480b0ed0 con 0x7f814815f230 2024-09-11T00:15:02.043 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:02.040+0000 7f814fbec640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f81480b0d50 con 0x7f81480694d0 2024-09-11T00:15:02.043 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:02.040+0000 7f814fbec640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f81480b1050 con 0x7f81480d09c0 2024-09-11T00:15:02.043 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:02.040+0000 7f814e189640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f814815f230 0x7f81481f2be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:02.043 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:02.040+0000 7f814e189640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f814815f230 0x7f81481f2be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:43782/0 (socket says 172.21.15.92:43782) 2024-09-11T00:15:02.043 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:02.040+0000 7f814e189640 1 -- 172.21.15.92:0/4068645736 learned_addr learned my addr 172.21.15.92:0/4068645736 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-11T00:15:02.044 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:02.040+0000 7f814d988640 1 --2- 172.21.15.92:0/4068645736 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f81480694d0 0x7f81481e7210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:02.044 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:02.040+0000 7f814d187640 1 --2- 172.21.15.92:0/4068645736 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f81480d09c0 0x7f81481e5d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:02.044 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:02.040+0000 7f814e189640 1 -- 172.21.15.92:0/4068645736 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f81480d09c0 msgr2=0x7f81481e5d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:02.044 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:02.040+0000 7f814e189640 1 --2- 172.21.15.92:0/4068645736 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f81480d09c0 0x7f81481e5d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:02.044 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:02.040+0000 7f814e189640 1 -- 172.21.15.92:0/4068645736 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f81480694d0 msgr2=0x7f81481e7210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:02.044 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:02.040+0000 7f814e189640 1 --2- 172.21.15.92:0/4068645736 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f81480694d0 0x7f81481e7210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:02.044 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:02.040+0000 7f814e189640 1 -- 172.21.15.92:0/4068645736 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81481f64c0 con 0x7f814815f230 2024-09-11T00:15:02.044 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:02.040+0000 7f814d187640 1 --2- 172.21.15.92:0/4068645736 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f81480d09c0 0x7f81481e5d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:15:02.044 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:02.040+0000 7f814d988640 1 --2- 172.21.15.92:0/4068645736 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f81480694d0 0x7f81481e7210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:15:02.044 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:02.041+0000 7f814e189640 1 --2- 172.21.15.92:0/4068645736 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f814815f230 0x7f81481f2be0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f814000c970 tx=0x7f814000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:15:02.044 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:02.041+0000 7f81467fc640 1 -- 172.21.15.92:0/4068645736 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8140007bb0 con 0x7f814815f230 2024-09-11T00:15:02.044 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:02.041+0000 7f81467fc640 1 -- 172.21.15.92:0/4068645736 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8140007e40 con 0x7f814815f230 2024-09-11T00:15:02.044 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:02.041+0000 7f81467fc640 1 -- 172.21.15.92:0/4068645736 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8140005280 con 0x7f814815f230 2024-09-11T00:15:02.044 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:02.041+0000 7f814fbec640 1 -- 172.21.15.92:0/4068645736 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81481f3810 con 0x7f814815f230 2024-09-11T00:15:02.045 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:02.041+0000 7f814fbec640 1 -- 172.21.15.92:0/4068645736 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81481e6730 con 0x7f814815f230 2024-09-11T00:15:02.045 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:02.042+0000 7f814fbec640 1 -- 172.21.15.92:0/4068645736 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f81480b1500 con 0x7f814815f230 2024-09-11T00:15:02.046 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:02.042+0000 7f81467fc640 1 -- 172.21.15.92:0/4068645736 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f8140005420 con 0x7f814815f230 2024-09-11T00:15:02.046 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:02.043+0000 7f81467fc640 1 --2- 172.21.15.92:0/4068645736 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f8134077f70 0x7f813407a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:02.046 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:02.043+0000 7f81467fc640 1 -- 172.21.15.92:0/4068645736 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6829+0+0 (secure 0 0 0) 0x7f814009a5a0 con 0x7f814815f230 2024-09-11T00:15:02.046 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:02.043+0000 7f814d988640 1 --2- 172.21.15.92:0/4068645736 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f8134077f70 0x7f813407a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:02.046 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:02.043+0000 7f814d988640 1 --2- 172.21.15.92:0/4068645736 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f8134077f70 0x7f813407a430 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f8138034000 tx=0x7f8138004ab0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:15:02.048 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:02.047+0000 7f81467fc640 1 -- 172.21.15.92:0/4068645736 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f8140014030 con 0x7f814815f230 2024-09-11T00:15:02.224 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:02.223+0000 7f814fbec640 1 -- 172.21.15.92:0/4068645736 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f81481e8950 con 0x7f814815f230 2024-09-11T00:15:02.921 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:02.919+0000 7f81467fc640 1 -- 172.21.15.92:0/4068645736 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v29) ==== 181+0+0 (secure 0 0 0) 0x7f8140062cd0 con 0x7f814815f230 2024-09-11T00:15:02.921 INFO:teuthology.orchestra.run.smithi092.stderr:pool 'cephfs_metadata' removed 2024-09-11T00:15:02.924 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:02.923+0000 7f814fbec640 1 -- 172.21.15.92:0/4068645736 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f8134077f70 msgr2=0x7f813407a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:02.925 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:02.923+0000 7f814fbec640 1 --2- 172.21.15.92:0/4068645736 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f8134077f70 0x7f813407a430 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f8138034000 tx=0x7f8138004ab0 comp rx=0 tx=0).stop 2024-09-11T00:15:02.925 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:02.923+0000 7f814fbec640 1 -- 172.21.15.92:0/4068645736 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f814815f230 msgr2=0x7f81481f2be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:02.925 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:02.923+0000 7f814fbec640 1 --2- 172.21.15.92:0/4068645736 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f814815f230 0x7f81481f2be0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f814000c970 tx=0x7f814000ce30 comp rx=0 tx=0).stop 2024-09-11T00:15:02.925 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:02.923+0000 7f814fbec640 1 -- 172.21.15.92:0/4068645736 shutdown_connections 2024-09-11T00:15:02.925 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:02.923+0000 7f814fbec640 1 --2- 172.21.15.92:0/4068645736 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f8134077f70 0x7f813407a430 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:02.925 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:02.923+0000 7f814fbec640 1 --2- 172.21.15.92:0/4068645736 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f814815f230 0x7f81481f2be0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:02.925 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:02.923+0000 7f814fbec640 1 --2- 172.21.15.92:0/4068645736 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f81480d09c0 0x7f81481e5d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:02.925 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:02.923+0000 7f814fbec640 1 --2- 172.21.15.92:0/4068645736 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f81480694d0 0x7f81481e7210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:02.925 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:02.923+0000 7f814fbec640 1 -- 172.21.15.92:0/4068645736 >> 172.21.15.92:0/4068645736 conn(0x7f8148074150 msgr2=0x7f814806f060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:15:02.925 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:02.923+0000 7f814fbec640 1 -- 172.21.15.92:0/4068645736 shutdown_connections 2024-09-11T00:15:02.925 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:02.923+0000 7f814fbec640 1 -- 172.21.15.92:0/4068645736 wait complete. 2024-09-11T00:15:02.937 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-11T00:15:03.048 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:03.046+0000 7fbbd6565640 1 -- 172.21.15.92:0/1030467016 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbbb8004800 msgr2=0x7fbbb8004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:03.048 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:03.046+0000 7fbbd6565640 1 --2- 172.21.15.92:0/1030467016 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbbb8004800 0x7fbbb8004c80 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fbbc400c290 tx=0x7fbbb8005830 comp rx=0 tx=0).stop 2024-09-11T00:15:03.048 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:03.046+0000 7fbbd4b02640 1 -- 172.21.15.92:0/1030467016 reap_dead start 2024-09-11T00:15:03.048 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:03.046+0000 7fbbd6565640 1 -- 172.21.15.92:0/1030467016 shutdown_connections 2024-09-11T00:15:03.048 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:03.046+0000 7fbbd6565640 1 -- 172.21.15.92:0/1030467016 >> 172.21.15.92:0/1030467016 conn(0x7fbbd00b2770 msgr2=0x7fbbd00b2b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:15:03.048 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:03.046+0000 7fbbd6565640 1 -- 172.21.15.92:0/1030467016 shutdown_connections 2024-09-11T00:15:03.048 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:03.046+0000 7fbbd6565640 1 -- 172.21.15.92:0/1030467016 wait complete. 2024-09-11T00:15:03.050 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:03.047+0000 7fbbd6565640 1 Processor -- start 2024-09-11T00:15:03.051 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:03.047+0000 7fbbd6565640 1 -- start start 2024-09-11T00:15:03.051 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:03.048+0000 7fbbd6565640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbbb8004800 0x7fbbd00af680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:03.051 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:03.048+0000 7fbbd6565640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbbd014f9d0 0x7fbbd014fe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:03.051 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:03.048+0000 7fbbd6565640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fbbd01f1760 0x7fbbd01f1be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:03.051 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:03.048+0000 7fbbd6565640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fbbd0070870 con 0x7fbbd014f9d0 2024-09-11T00:15:03.051 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:03.048+0000 7fbbd6565640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fbbd00b5210 con 0x7fbbb8004800 2024-09-11T00:15:03.051 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:03.048+0000 7fbbd6565640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7fbbd00709f0 con 0x7fbbd01f1760 2024-09-11T00:15:03.051 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:03.048+0000 7fbbcf7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbbd014f9d0 0x7fbbd014fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:03.051 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:03.048+0000 7fbbcf7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbbd014f9d0 0x7fbbd014fe50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:43808/0 (socket says 172.21.15.92:43808) 2024-09-11T00:15:03.051 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:03.048+0000 7fbbcf7fe640 1 -- 172.21.15.92:0/219907752 learned_addr learned my addr 172.21.15.92:0/219907752 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-11T00:15:03.051 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:03.048+0000 7fbbcffff640 1 --2- 172.21.15.92:0/219907752 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbbb8004800 0x7fbbd00af680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:03.051 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:03.048+0000 7fbbd4b02640 1 --2- 172.21.15.92:0/219907752 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fbbd01f1760 0x7fbbd01f1be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:03.051 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:03.048+0000 7fbbcf7fe640 1 -- 172.21.15.92:0/219907752 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fbbd01f1760 msgr2=0x7fbbd01f1be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:03.052 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:03.048+0000 7fbbcf7fe640 1 --2- 172.21.15.92:0/219907752 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fbbd01f1760 0x7fbbd01f1be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:03.052 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:03.048+0000 7fbbcf7fe640 1 -- 172.21.15.92:0/219907752 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbbb8004800 msgr2=0x7fbbd00af680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:03.052 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:03.048+0000 7fbbcf7fe640 1 --2- 172.21.15.92:0/219907752 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbbb8004800 0x7fbbd00af680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:03.052 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:03.048+0000 7fbbcf7fe640 1 -- 172.21.15.92:0/219907752 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbbd014e930 con 0x7fbbd014f9d0 2024-09-11T00:15:03.052 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:03.048+0000 7fbbcf7fe640 1 --2- 172.21.15.92:0/219907752 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbbd014f9d0 0x7fbbd014fe50 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fbbc4001d20 tx=0x7fbbc4001d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:15:03.052 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:03.049+0000 7fbbccff9640 1 -- 172.21.15.92:0/219907752 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbc4031040 con 0x7fbbd014f9d0 2024-09-11T00:15:03.052 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:03.049+0000 7fbbccff9640 1 -- 172.21.15.92:0/219907752 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbbc40065c0 con 0x7fbbd014f9d0 2024-09-11T00:15:03.052 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:03.049+0000 7fbbd6565640 1 -- 172.21.15.92:0/219907752 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbbd014ec10 con 0x7fbbd014f9d0 2024-09-11T00:15:03.052 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:03.049+0000 7fbbccff9640 1 -- 172.21.15.92:0/219907752 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbc4003a40 con 0x7fbbd014f9d0 2024-09-11T00:15:03.052 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:03.049+0000 7fbbd6565640 1 -- 172.21.15.92:0/219907752 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbbd014f1d0 con 0x7fbbd014f9d0 2024-09-11T00:15:03.053 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:03.050+0000 7fbbd6565640 1 -- 172.21.15.92:0/219907752 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbbd015f170 con 0x7fbbd014f9d0 2024-09-11T00:15:03.053 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:03.050+0000 7fbbccff9640 1 -- 172.21.15.92:0/219907752 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fbbc4048030 con 0x7fbbd014f9d0 2024-09-11T00:15:03.053 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:03.051+0000 7fbbccff9640 1 --2- 172.21.15.92:0/219907752 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7fbbbc077fa0 0x7fbbbc07a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:03.053 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:03.051+0000 7fbbccff9640 1 -- 172.21.15.92:0/219907752 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6391+0+0 (secure 0 0 0) 0x7fbbc40b9c50 con 0x7fbbd014f9d0 2024-09-11T00:15:03.053 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:03.051+0000 7fbbcffff640 1 --2- 172.21.15.92:0/219907752 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7fbbbc077fa0 0x7fbbbc07a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:03.054 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:03.052+0000 7fbbcffff640 1 --2- 172.21.15.92:0/219907752 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7fbbbc077fa0 0x7fbbbc07a460 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fbbc00099f0 tx=0x7fbbc0005f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:15:03.057 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:03.055+0000 7fbbccff9640 1 -- 172.21.15.92:0/219907752 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fbbc4081fc0 con 0x7fbbd014f9d0 2024-09-11T00:15:03.232 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:03.231+0000 7fbbd6565640 1 -- 172.21.15.92:0/219907752 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7fbbd00d0850 con 0x7fbbd014f9d0 2024-09-11T00:15:03.926 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:03.924+0000 7fbbccff9640 1 -- 172.21.15.92:0/219907752 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v30) ==== 169+0+0 (secure 0 0 0) 0x7fbbc40869f0 con 0x7fbbd014f9d0 2024-09-11T00:15:03.926 INFO:teuthology.orchestra.run.smithi092.stderr:pool 'cephfs_data' removed 2024-09-11T00:15:03.928 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:03.927+0000 7fbbd6565640 1 -- 172.21.15.92:0/219907752 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7fbbbc077fa0 msgr2=0x7fbbbc07a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:03.929 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:03.927+0000 7fbbd6565640 1 --2- 172.21.15.92:0/219907752 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7fbbbc077fa0 0x7fbbbc07a460 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fbbc00099f0 tx=0x7fbbc0005f90 comp rx=0 tx=0).stop 2024-09-11T00:15:03.929 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:03.927+0000 7fbbd6565640 1 -- 172.21.15.92:0/219907752 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbbd014f9d0 msgr2=0x7fbbd014fe50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:03.929 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:03.927+0000 7fbbd6565640 1 --2- 172.21.15.92:0/219907752 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbbd014f9d0 0x7fbbd014fe50 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fbbc4001d20 tx=0x7fbbc4001d50 comp rx=0 tx=0).stop 2024-09-11T00:15:03.930 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:03.928+0000 7fbbd6565640 1 -- 172.21.15.92:0/219907752 shutdown_connections 2024-09-11T00:15:03.930 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:03.928+0000 7fbbd6565640 1 --2- 172.21.15.92:0/219907752 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7fbbbc077fa0 0x7fbbbc07a460 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:03.930 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:03.928+0000 7fbbd6565640 1 --2- 172.21.15.92:0/219907752 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fbbd01f1760 0x7fbbd01f1be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:03.930 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:03.928+0000 7fbbd6565640 1 --2- 172.21.15.92:0/219907752 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbbd014f9d0 0x7fbbd014fe50 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:03.930 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:03.928+0000 7fbbd6565640 1 --2- 172.21.15.92:0/219907752 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbbb8004800 0x7fbbd00af680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:03.931 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:03.928+0000 7fbbd6565640 1 -- 172.21.15.92:0/219907752 >> 172.21.15.92:0/219907752 conn(0x7fbbd00b2770 msgr2=0x7fbbd00d0a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:15:03.931 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:03.928+0000 7fbbd6565640 1 -- 172.21.15.92:0/219907752 shutdown_connections 2024-09-11T00:15:03.931 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:03.928+0000 7fbbd6565640 1 -- 172.21.15.92:0/219907752 wait complete. 2024-09-11T00:15:03.943 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2024-09-11T00:15:04.048 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:04.046+0000 7f3dd72fe640 1 -- 172.21.15.92:0/533872111 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3dd00b7300 msgr2=0x7f3dd00d24e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:04.048 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:04.046+0000 7f3dd72fe640 1 --2- 172.21.15.92:0/533872111 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3dd00b7300 0x7f3dd00d24e0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f3dc0005fd0 tx=0x7f3dc002a540 comp rx=0 tx=0).stop 2024-09-11T00:15:04.048 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:04.046+0000 7f3dd72fe640 1 -- 172.21.15.92:0/533872111 shutdown_connections 2024-09-11T00:15:04.048 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:04.046+0000 7f3dd72fe640 1 --2- 172.21.15.92:0/533872111 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3dd00b7300 0x7f3dd00d24e0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:04.048 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:04.046+0000 7f3dd72fe640 1 --2- 172.21.15.92:0/533872111 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3dd015e060 0x7f3dd00b6dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:04.048 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:04.046+0000 7f3dd72fe640 1 -- 172.21.15.92:0/533872111 >> 172.21.15.92:0/533872111 conn(0x7f3dd00d3f70 msgr2=0x7f3dd00d4350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:15:04.048 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:04.046+0000 7f3dd72fe640 1 -- 172.21.15.92:0/533872111 shutdown_connections 2024-09-11T00:15:04.049 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:04.046+0000 7f3dd72fe640 1 -- 172.21.15.92:0/533872111 wait complete. 2024-09-11T00:15:04.050 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:04.047+0000 7f3dd72fe640 1 Processor -- start 2024-09-11T00:15:04.050 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:04.047+0000 7f3dd72fe640 1 -- start start 2024-09-11T00:15:04.050 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:04.048+0000 7f3dd72fe640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3dd00d4af0 0x7f3dd01546c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:04.051 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:04.048+0000 7f3dd72fe640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3dd015e060 0x7f3dd01f4940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:04.051 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:04.048+0000 7f3dd72fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3dd01f7f30 0x7f3dd015fe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:04.051 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:04.048+0000 7f3dd72fe640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f3dd00d2db0 con 0x7f3dd01f7f30 2024-09-11T00:15:04.051 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:04.048+0000 7f3dd72fe640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f3dd00d2c30 con 0x7f3dd00d4af0 2024-09-11T00:15:04.051 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:04.048+0000 7f3dd72fe640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f3dd00d2f30 con 0x7f3dd015e060 2024-09-11T00:15:04.051 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:04.048+0000 7f3dd589b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3dd01f7f30 0x7f3dd015fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:04.051 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:04.048+0000 7f3dd589b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3dd01f7f30 0x7f3dd015fe00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:43822/0 (socket says 172.21.15.92:43822) 2024-09-11T00:15:04.051 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:04.048+0000 7f3dd589b640 1 -- 172.21.15.92:0/1856763828 learned_addr learned my addr 172.21.15.92:0/1856763828 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-11T00:15:04.051 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:04.048+0000 7f3dd589b640 1 -- 172.21.15.92:0/1856763828 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3dd015e060 msgr2=0x7f3dd01f4940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:04.051 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:04.048+0000 7f3dd589b640 1 --2- 172.21.15.92:0/1856763828 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3dd015e060 0x7f3dd01f4940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:04.051 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:04.048+0000 7f3dd589b640 1 -- 172.21.15.92:0/1856763828 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3dd00d4af0 msgr2=0x7f3dd01546c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:04.051 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:04.048+0000 7f3dd589b640 1 --2- 172.21.15.92:0/1856763828 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3dd00d4af0 0x7f3dd01546c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:04.052 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:04.048+0000 7f3dd589b640 1 -- 172.21.15.92:0/1856763828 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3dd01f51e0 con 0x7f3dd01f7f30 2024-09-11T00:15:04.052 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:04.048+0000 7f3dd589b640 1 --2- 172.21.15.92:0/1856763828 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3dd01f7f30 0x7f3dd015fe00 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f3dc800c7a0 tx=0x7f3dc800cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:15:04.052 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:04.049+0000 7f3dc5ffb640 1 -- 172.21.15.92:0/1856763828 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dc8003b70 con 0x7f3dd01f7f30 2024-09-11T00:15:04.052 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:04.049+0000 7f3dc5ffb640 1 -- 172.21.15.92:0/1856763828 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3dc8003d30 con 0x7f3dd01f7f30 2024-09-11T00:15:04.052 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:04.049+0000 7f3dc5ffb640 1 -- 172.21.15.92:0/1856763828 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dc800aab0 con 0x7f3dd01f7f30 2024-09-11T00:15:04.052 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:04.049+0000 7f3dd72fe640 1 -- 172.21.15.92:0/1856763828 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3dd01f54c0 con 0x7f3dd01f7f30 2024-09-11T00:15:04.052 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:04.049+0000 7f3dd72fe640 1 -- 172.21.15.92:0/1856763828 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3dd015e5d0 con 0x7f3dd01f7f30 2024-09-11T00:15:04.053 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:04.050+0000 7f3dd72fe640 1 -- 172.21.15.92:0/1856763828 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3dd00d24e0 con 0x7f3dd01f7f30 2024-09-11T00:15:04.053 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:04.050+0000 7f3dc5ffb640 1 -- 172.21.15.92:0/1856763828 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f3dc800ac50 con 0x7f3dd01f7f30 2024-09-11T00:15:04.053 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:04.051+0000 7f3dc5ffb640 1 --2- 172.21.15.92:0/1856763828 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f3db4077f70 0x7f3db407a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:04.053 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:04.051+0000 7f3dc5ffb640 1 -- 172.21.15.92:0/1856763828 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5853+0+0 (secure 0 0 0) 0x7f3dc8099b90 con 0x7f3dd01f7f30 2024-09-11T00:15:04.053 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:04.051+0000 7f3dd509a640 1 --2- 172.21.15.92:0/1856763828 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f3db4077f70 0x7f3db407a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:04.053 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:04.052+0000 7f3dd509a640 1 --2- 172.21.15.92:0/1856763828 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f3db4077f70 0x7f3db407a430 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f3dd0158a50 tx=0x7f3dcc006bf0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:15:04.056 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:04.055+0000 7f3dc5ffb640 1 -- 172.21.15.92:0/1856763828 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f3dc8062690 con 0x7f3dd01f7f30 2024-09-11T00:15:04.231 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:04.228+0000 7f3dd72fe640 1 -- 172.21.15.92:0/1856763828 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) -- 0x7f3dd008dfa0 con 0x7f3dd01f7f30 2024-09-11T00:15:04.930 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:04.927+0000 7f3dc5ffb640 1 -- 172.21.15.92:0/1856763828 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v31) ==== 178+0+0 (secure 0 0 0) 0x7f3dc8061f90 con 0x7f3dd01f7f30 2024-09-11T00:15:04.930 INFO:teuthology.orchestra.run.smithi092.stderr:pool 'cephfs_data_ec' removed 2024-09-11T00:15:04.934 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:04.931+0000 7f3dd72fe640 1 -- 172.21.15.92:0/1856763828 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f3db4077f70 msgr2=0x7f3db407a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:04.934 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:04.931+0000 7f3dd72fe640 1 --2- 172.21.15.92:0/1856763828 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f3db4077f70 0x7f3db407a430 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f3dd0158a50 tx=0x7f3dcc006bf0 comp rx=0 tx=0).stop 2024-09-11T00:15:04.934 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:04.931+0000 7f3dd72fe640 1 -- 172.21.15.92:0/1856763828 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3dd01f7f30 msgr2=0x7f3dd015fe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:04.935 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:04.931+0000 7f3dd72fe640 1 --2- 172.21.15.92:0/1856763828 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3dd01f7f30 0x7f3dd015fe00 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f3dc800c7a0 tx=0x7f3dc800cc60 comp rx=0 tx=0).stop 2024-09-11T00:15:04.935 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:04.932+0000 7f3dd72fe640 1 -- 172.21.15.92:0/1856763828 shutdown_connections 2024-09-11T00:15:04.935 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:04.932+0000 7f3dd72fe640 1 --2- 172.21.15.92:0/1856763828 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f3db4077f70 0x7f3db407a430 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:04.935 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:04.932+0000 7f3dd72fe640 1 --2- 172.21.15.92:0/1856763828 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3dd01f7f30 0x7f3dd015fe00 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:04.935 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:04.932+0000 7f3dd72fe640 1 --2- 172.21.15.92:0/1856763828 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3dd015e060 0x7f3dd01f4940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:04.935 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:04.932+0000 7f3dd72fe640 1 --2- 172.21.15.92:0/1856763828 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3dd00d4af0 0x7f3dd01546c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:04.935 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:04.932+0000 7f3dd72fe640 1 -- 172.21.15.92:0/1856763828 >> 172.21.15.92:0/1856763828 conn(0x7f3dd00d3f70 msgr2=0x7f3dd00b76f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:15:04.935 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:04.932+0000 7f3dd72fe640 1 -- 172.21.15.92:0/1856763828 shutdown_connections 2024-09-11T00:15:04.935 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:04.932+0000 7f3dd72fe640 1 -- 172.21.15.92:0/1856763828 wait complete. 2024-09-11T00:15:04.949 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-11T00:15:04.950 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-11T00:15:04.950 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-11T00:15:04.950 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T00:15:04.950 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-11T00:15:04.951 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-11T00:15:04.951 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-11T00:15:04.951 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T00:15:04.951 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-11T00:15:04.951 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-11T00:15:04.951 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-11T00:15:04.952 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T00:15:04.952 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-11T00:15:04.952 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-11T00:15:04.952 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-11T00:15:04.952 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T00:15:04.960 INFO:tasks.ceph.mds.a:Stopped 2024-09-11T00:15:04.961 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-11T00:15:04.962 INFO:tasks.ceph.mds.c:Stopped 2024-09-11T00:15:04.962 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-11T00:15:04.964 INFO:tasks.ceph.mds.b:Stopped 2024-09-11T00:15:04.964 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-11T00:15:04.965 INFO:tasks.ceph.mds.d:Stopped 2024-09-11T00:15:04.965 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-11T00:15:05.005 INFO:tasks.ceph.mds.a:Started 2024-09-11T00:15:05.006 DEBUG:teuthology.parallel:result is None 2024-09-11T00:15:05.007 INFO:tasks.ceph.mds.c:Started 2024-09-11T00:15:05.008 DEBUG:teuthology.parallel:result is None 2024-09-11T00:15:05.008 INFO:tasks.ceph.mds.b:Started 2024-09-11T00:15:05.009 DEBUG:teuthology.parallel:result is None 2024-09-11T00:15:05.009 INFO:tasks.ceph.mds.d:Started 2024-09-11T00:15:05.010 DEBUG:teuthology.parallel:result is None 2024-09-11T00:15:05.010 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-11T00:15:05.084 INFO:tasks.ceph.mds.c.smithi092.stdout:starting mds.c at 2024-09-11T00:15:05.085 INFO:tasks.ceph.mds.a.smithi092.stdout:starting mds.a at 2024-09-11T00:15:05.091 INFO:tasks.ceph.mds.b.smithi145.stdout:starting mds.b at 2024-09-11T00:15:05.091 INFO:tasks.ceph.mds.d.smithi145.stdout:starting mds.d at 2024-09-11T00:15:05.121 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:05.119+0000 7f14021f8640 1 -- 172.21.15.92:0/2688541416 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f13fc0d0a00 msgr2=0x7f13fc070760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:05.122 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:05.119+0000 7f14021f8640 1 --2- 172.21.15.92:0/2688541416 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f13fc0d0a00 0x7f13fc070760 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f13fc06ae10 tx=0x7f13f002a560 comp rx=0 tx=0).stop 2024-09-11T00:15:05.122 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:05.119+0000 7f14021f8640 1 -- 172.21.15.92:0/2688541416 shutdown_connections 2024-09-11T00:15:05.122 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:05.119+0000 7f14021f8640 1 --2- 172.21.15.92:0/2688541416 >> v2:172.21.15.145:3300/0 conn(0x7f13fc0d2830 0x7f13fc0cf8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:05.122 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:05.119+0000 7f14021f8640 1 --2- 172.21.15.92:0/2688541416 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f13fc0d0a00 0x7f13fc070760 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:05.122 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:05.119+0000 7f14021f8640 1 -- 172.21.15.92:0/2688541416 >> 172.21.15.92:0/2688541416 conn(0x7f13fc0d1d10 msgr2=0x7f13fc0d2120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:15:05.122 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:05.119+0000 7f14021f8640 1 -- 172.21.15.92:0/2688541416 shutdown_connections 2024-09-11T00:15:05.122 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:05.119+0000 7f14021f8640 1 -- 172.21.15.92:0/2688541416 wait complete. 2024-09-11T00:15:05.123 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:05.120+0000 7f14021f8640 1 Processor -- start 2024-09-11T00:15:05.123 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:05.120+0000 7f14021f8640 1 -- start start 2024-09-11T00:15:05.125 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:05.121+0000 7f14021f8640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f13fc0d0a00 0x7f13fc15a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:05.125 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:05.121+0000 7f14021f8640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f13fc0d2830 0x7f13fc15e590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:05.126 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:05.121+0000 7f14021f8640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f13fc15be00 0x7f13fc1f5b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:05.126 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:05.121+0000 7f14021f8640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f13fc0cd1d0 con 0x7f13fc0d2830 2024-09-11T00:15:05.126 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:05.121+0000 7f14021f8640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f13fc0cd050 con 0x7f13fc15be00 2024-09-11T00:15:05.126 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:05.121+0000 7f14021f8640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f13fc0cd350 con 0x7f13fc0d0a00 2024-09-11T00:15:05.126 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:05.121+0000 7f13faffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f13fc0d2830 0x7f13fc15e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:05.126 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:05.121+0000 7f13faffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f13fc0d2830 0x7f13fc15e590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:45692/0 (socket says 172.21.15.92:45692) 2024-09-11T00:15:05.126 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:05.121+0000 7f13faffd640 1 -- 172.21.15.92:0/1025025654 learned_addr learned my addr 172.21.15.92:0/1025025654 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-11T00:15:05.126 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:05.121+0000 7f13fbfff640 1 --2- 172.21.15.92:0/1025025654 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f13fc15be00 0x7f13fc1f5b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:05.126 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:05.121+0000 7f13fb7fe640 1 --2- 172.21.15.92:0/1025025654 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f13fc0d0a00 0x7f13fc15a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:05.126 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:05.121+0000 7f13faffd640 1 -- 172.21.15.92:0/1025025654 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f13fc0d0a00 msgr2=0x7f13fc15a2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:05.126 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:05.121+0000 7f13faffd640 1 --2- 172.21.15.92:0/1025025654 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f13fc0d0a00 0x7f13fc15a2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:05.127 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:05.121+0000 7f13faffd640 1 -- 172.21.15.92:0/1025025654 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f13fc15be00 msgr2=0x7f13fc1f5b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:05.127 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:05.121+0000 7f13faffd640 1 --2- 172.21.15.92:0/1025025654 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f13fc15be00 0x7f13fc1f5b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:05.127 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:05.121+0000 7f13faffd640 1 -- 172.21.15.92:0/1025025654 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13fc1f6740 con 0x7f13fc0d2830 2024-09-11T00:15:05.127 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:05.121+0000 7f13fb7fe640 1 --2- 172.21.15.92:0/1025025654 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f13fc0d0a00 0x7f13fc15a2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:15:05.127 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:05.121+0000 7f13fbfff640 1 --2- 172.21.15.92:0/1025025654 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f13fc15be00 0x7f13fc1f5b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:15:05.127 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:05.122+0000 7f13faffd640 1 --2- 172.21.15.92:0/1025025654 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f13fc0d2830 0x7f13fc15e590 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f13f0009850 tx=0x7f13f00039e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:15:05.127 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:05.122+0000 7f13e3fff640 1 -- 172.21.15.92:0/1025025654 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13f003f070 con 0x7f13fc0d2830 2024-09-11T00:15:05.127 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:05.122+0000 7f13e3fff640 1 -- 172.21.15.92:0/1025025654 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f13f0004890 con 0x7f13fc0d2830 2024-09-11T00:15:05.127 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:05.122+0000 7f14021f8640 1 -- 172.21.15.92:0/1025025654 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13fc1f69e0 con 0x7f13fc0d2830 2024-09-11T00:15:05.127 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:05.122+0000 7f13e3fff640 1 -- 172.21.15.92:0/1025025654 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13f0035030 con 0x7f13fc0d2830 2024-09-11T00:15:05.127 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:05.122+0000 7f14021f8640 1 -- 172.21.15.92:0/1025025654 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13fc15dd90 con 0x7f13fc0d2830 2024-09-11T00:15:05.128 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:05.123+0000 7f14021f8640 1 -- 172.21.15.92:0/1025025654 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f13fc070760 con 0x7f13fc0d2830 2024-09-11T00:15:05.128 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:05.123+0000 7f13e3fff640 1 -- 172.21.15.92:0/1025025654 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f13f0004ca0 con 0x7f13fc0d2830 2024-09-11T00:15:05.128 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:05.124+0000 7f13e3fff640 1 --2- 172.21.15.92:0/1025025654 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f13e8077f70 0x7f13e807a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:05.128 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:05.124+0000 7f13e3fff640 1 -- 172.21.15.92:0/1025025654 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5335+0+0 (secure 0 0 0) 0x7f13f00bae90 con 0x7f13fc0d2830 2024-09-11T00:15:05.128 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:05.124+0000 7f13fb7fe640 1 --2- 172.21.15.92:0/1025025654 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f13e8077f70 0x7f13e807a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:05.129 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:05.125+0000 7f13fb7fe640 1 --2- 172.21.15.92:0/1025025654 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f13e8077f70 0x7f13e807a430 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f13fc0af600 tx=0x7f13ec0073e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:15:05.130 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:05.128+0000 7f13e3fff640 1 -- 172.21.15.92:0/1025025654 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f13f0083b90 con 0x7f13fc0d2830 2024-09-11T00:15:05.318 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:05.315+0000 7f14021f8640 1 -- 172.21.15.92:0/1025025654 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f13fc0b7c90 con 0x7f13fc0d2830 2024-09-11T00:15:05.947 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:05.944+0000 7f13e3fff640 1 -- 172.21.15.92:0/1025025654 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v33) ==== 97+0+0 (secure 0 0 0) 0x7f13f0083490 con 0x7f13fc0d2830 2024-09-11T00:15:05.947 INFO:teuthology.orchestra.run.smithi092.stderr: removed all blocklist entries 2024-09-11T00:15:05.953 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:05.947+0000 7f14021f8640 1 -- 172.21.15.92:0/1025025654 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f13e8077f70 msgr2=0x7f13e807a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:05.953 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:05.947+0000 7f14021f8640 1 --2- 172.21.15.92:0/1025025654 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f13e8077f70 0x7f13e807a430 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f13fc0af600 tx=0x7f13ec0073e0 comp rx=0 tx=0).stop 2024-09-11T00:15:05.953 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:05.947+0000 7f14021f8640 1 -- 172.21.15.92:0/1025025654 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f13fc0d2830 msgr2=0x7f13fc15e590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:05.953 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:05.947+0000 7f14021f8640 1 --2- 172.21.15.92:0/1025025654 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f13fc0d2830 0x7f13fc15e590 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f13f0009850 tx=0x7f13f00039e0 comp rx=0 tx=0).stop 2024-09-11T00:15:05.953 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:05.947+0000 7f14021f8640 1 -- 172.21.15.92:0/1025025654 shutdown_connections 2024-09-11T00:15:05.953 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:05.947+0000 7f14021f8640 1 --2- 172.21.15.92:0/1025025654 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f13e8077f70 0x7f13e807a430 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:05.953 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:05.947+0000 7f14021f8640 1 --2- 172.21.15.92:0/1025025654 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f13fc15be00 0x7f13fc1f5b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:05.954 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:05.947+0000 7f14021f8640 1 --2- 172.21.15.92:0/1025025654 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f13fc0d2830 0x7f13fc15e590 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:05.954 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:05.947+0000 7f14021f8640 1 --2- 172.21.15.92:0/1025025654 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f13fc0d0a00 0x7f13fc15a2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:05.954 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:05.948+0000 7f14021f8640 1 -- 172.21.15.92:0/1025025654 >> 172.21.15.92:0/1025025654 conn(0x7f13fc0d1d10 msgr2=0x7f13fc0aeaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:15:05.954 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:05.948+0000 7f14021f8640 1 -- 172.21.15.92:0/1025025654 shutdown_connections 2024-09-11T00:15:05.954 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:05.948+0000 7f14021f8640 1 -- 172.21.15.92:0/1025025654 wait complete. 2024-09-11T00:15:05.963 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-11T00:15:06.067 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:06.064+0000 7f1d31724640 1 -- 172.21.15.92:0/512643526 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1d2c0b55a0 msgr2=0x7f1d2c0b3f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:06.067 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:06.064+0000 7f1d31724640 1 --2- 172.21.15.92:0/512643526 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1d2c0b55a0 0x7f1d2c0b3f70 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f1d2c0b54f0 tx=0x7f1d2402a980 comp rx=0 tx=0).stop 2024-09-11T00:15:06.068 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:06.064+0000 7f1d31724640 1 -- 172.21.15.92:0/512643526 shutdown_connections 2024-09-11T00:15:06.068 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:06.064+0000 7f1d31724640 1 --2- 172.21.15.92:0/512643526 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1d2c0b55a0 0x7f1d2c0b3f70 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:06.068 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:06.064+0000 7f1d31724640 1 --2- 172.21.15.92:0/512643526 >> v2:172.21.15.145:3300/0 conn(0x7f1d2c0d2a70 0x7f1d2c0b3a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:06.068 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:06.064+0000 7f1d31724640 1 -- 172.21.15.92:0/512643526 >> 172.21.15.92:0/512643526 conn(0x7f1d2c09d170 msgr2=0x7f1d2c0d3f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:15:06.068 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:06.064+0000 7f1d31724640 1 -- 172.21.15.92:0/512643526 shutdown_connections 2024-09-11T00:15:06.068 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:06.064+0000 7f1d31724640 1 -- 172.21.15.92:0/512643526 wait complete. 2024-09-11T00:15:06.068 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:06.066+0000 7f1d31724640 1 Processor -- start 2024-09-11T00:15:06.068 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:06.066+0000 7f1d31724640 1 -- start start 2024-09-11T00:15:06.070 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:06.066+0000 7f1d31724640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1d2c0b55a0 0x7f1d2c1533a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:06.071 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:06.066+0000 7f1d31724640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1d2c0d2a70 0x7f1d2c15b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:06.071 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:06.066+0000 7f1d31724640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1d2c161560 0x7f1d2c15d650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:06.071 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:06.066+0000 7f1d31724640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f1d2c0d0450 con 0x7f1d2c0d2a70 2024-09-11T00:15:06.071 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:06.066+0000 7f1d31724640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f1d2c0d4830 con 0x7f1d2c161560 2024-09-11T00:15:06.071 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:06.066+0000 7f1d31724640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f1d2c0b44b0 con 0x7f1d2c0b55a0 2024-09-11T00:15:06.071 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:06.067+0000 7f1d227fc640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1d2c0d2a70 0x7f1d2c15b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:06.071 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:06.067+0000 7f1d227fc640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1d2c0d2a70 0x7f1d2c15b5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:45704/0 (socket says 172.21.15.92:45704) 2024-09-11T00:15:06.071 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:06.067+0000 7f1d227fc640 1 -- 172.21.15.92:0/168308334 learned_addr learned my addr 172.21.15.92:0/168308334 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-11T00:15:06.071 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:06.067+0000 7f1d2b7fe640 1 --2- 172.21.15.92:0/168308334 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1d2c161560 0x7f1d2c15d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:06.071 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:06.067+0000 7f1d2affd640 1 --2- 172.21.15.92:0/168308334 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1d2c0b55a0 0x7f1d2c1533a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:06.071 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:06.067+0000 7f1d227fc640 1 -- 172.21.15.92:0/168308334 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1d2c0b55a0 msgr2=0x7f1d2c1533a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:06.071 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:06.067+0000 7f1d227fc640 1 --2- 172.21.15.92:0/168308334 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1d2c0b55a0 0x7f1d2c1533a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:06.071 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:06.067+0000 7f1d227fc640 1 -- 172.21.15.92:0/168308334 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1d2c161560 msgr2=0x7f1d2c15d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:06.072 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:06.067+0000 7f1d227fc640 1 --2- 172.21.15.92:0/168308334 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1d2c161560 0x7f1d2c15d650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:06.072 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:06.067+0000 7f1d227fc640 1 -- 172.21.15.92:0/168308334 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d2c15a870 con 0x7f1d2c0d2a70 2024-09-11T00:15:06.072 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:06.067+0000 7f1d2b7fe640 1 --2- 172.21.15.92:0/168308334 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1d2c161560 0x7f1d2c15d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:15:06.072 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:06.067+0000 7f1d227fc640 1 --2- 172.21.15.92:0/168308334 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1d2c0d2a70 0x7f1d2c15b5c0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f1d1400b4d0 tx=0x7f1d1400b990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:15:06.072 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:06.067+0000 7f1d23fff640 1 -- 172.21.15.92:0/168308334 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d14014070 con 0x7f1d2c0d2a70 2024-09-11T00:15:06.072 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:06.067+0000 7f1d23fff640 1 -- 172.21.15.92:0/168308334 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1d14010960 con 0x7f1d2c0d2a70 2024-09-11T00:15:06.072 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:06.067+0000 7f1d31724640 1 -- 172.21.15.92:0/168308334 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1d2c1538e0 con 0x7f1d2c0d2a70 2024-09-11T00:15:06.072 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:06.067+0000 7f1d23fff640 1 -- 172.21.15.92:0/168308334 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d14010db0 con 0x7f1d2c0d2a70 2024-09-11T00:15:06.073 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:06.067+0000 7f1d31724640 1 -- 172.21.15.92:0/168308334 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1d2c15aae0 con 0x7f1d2c0d2a70 2024-09-11T00:15:06.073 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:06.068+0000 7f1d31724640 1 -- 172.21.15.92:0/168308334 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1d2c0b4990 con 0x7f1d2c0d2a70 2024-09-11T00:15:06.073 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:06.069+0000 7f1d23fff640 1 -- 172.21.15.92:0/168308334 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f1d1400f3c0 con 0x7f1d2c0d2a70 2024-09-11T00:15:06.073 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:06.069+0000 7f1d23fff640 1 --2- 172.21.15.92:0/168308334 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f1d0c077f70 0x7f1d0c07a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:06.074 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:06.069+0000 7f1d23fff640 1 -- 172.21.15.92:0/168308334 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5249+0+0 (secure 0 0 0) 0x7f1d14099cb0 con 0x7f1d2c0d2a70 2024-09-11T00:15:06.074 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:06.070+0000 7f1d2affd640 1 --2- 172.21.15.92:0/168308334 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f1d0c077f70 0x7f1d0c07a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:06.074 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:06.070+0000 7f1d2affd640 1 --2- 172.21.15.92:0/168308334 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f1d0c077f70 0x7f1d0c07a430 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f1d1c006fd0 tx=0x7f1d1c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:15:06.076 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:06.073+0000 7f1d23fff640 1 -- 172.21.15.92:0/168308334 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f1d2c1538e0 con 0x7f1d2c0d2a70 2024-09-11T00:15:06.316 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:06.313+0000 7f1d31724640 1 -- 172.21.15.92:0/168308334 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f1d2c0b4db0 con 0x7f1d2c0d2a70 2024-09-11T00:15:06.317 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:06.314+0000 7f1d23fff640 1 -- 172.21.15.92:0/168308334 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v4) ==== 80+0+6645 (secure 0 0 0) 0x7f1d14062a00 con 0x7f1d2c0d2a70 2024-09-11T00:15:06.317 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:15:06.317 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2024-09-11T00:15:06.317 INFO:teuthology.orchestra.run.smithi092.stdout: "auth_dump": [ 2024-09-11T00:15:06.317 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-11T00:15:06.317 INFO:teuthology.orchestra.run.smithi092.stdout: "entity": "mds.a", 2024-09-11T00:15:06.317 INFO:teuthology.orchestra.run.smithi092.stdout: "key": "AQCe4OBmmT0yFxAA8GmXJ+YS1BYWN4Mkk5cMkg==", 2024-09-11T00:15:06.317 INFO:teuthology.orchestra.run.smithi092.stdout: "caps": { 2024-09-11T00:15:06.317 INFO:teuthology.orchestra.run.smithi092.stdout: "mds": "allow", 2024-09-11T00:15:06.317 INFO:teuthology.orchestra.run.smithi092.stdout: "mgr": "allow *", 2024-09-11T00:15:06.318 INFO:teuthology.orchestra.run.smithi092.stdout: "mon": "allow *", 2024-09-11T00:15:06.318 INFO:teuthology.orchestra.run.smithi092.stdout: "osd": "allow *" 2024-09-11T00:15:06.318 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-11T00:15:06.318 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-11T00:15:06.318 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-11T00:15:06.318 INFO:teuthology.orchestra.run.smithi092.stdout: "entity": "mds.b", 2024-09-11T00:15:06.318 INFO:teuthology.orchestra.run.smithi092.stdout: "key": "AQCe4OBmozHpIhAA9/Si4L5wwVt64OQFAKnkdw==", 2024-09-11T00:15:06.318 INFO:teuthology.orchestra.run.smithi092.stdout: "caps": { 2024-09-11T00:15:06.318 INFO:teuthology.orchestra.run.smithi092.stdout: "mds": "allow", 2024-09-11T00:15:06.319 INFO:teuthology.orchestra.run.smithi092.stdout: "mgr": "allow *", 2024-09-11T00:15:06.319 INFO:teuthology.orchestra.run.smithi092.stdout: "mon": "allow *", 2024-09-11T00:15:06.319 INFO:teuthology.orchestra.run.smithi092.stdout: "osd": "allow *" 2024-09-11T00:15:06.319 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-11T00:15:06.319 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-11T00:15:06.320 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-11T00:15:06.320 INFO:teuthology.orchestra.run.smithi092.stdout: "entity": "mds.c", 2024-09-11T00:15:06.320 INFO:teuthology.orchestra.run.smithi092.stdout: "key": "AQCe4OBm1sdBHhAAxxAg+qrd5wYAlbu0ihkzkw==", 2024-09-11T00:15:06.320 INFO:teuthology.orchestra.run.smithi092.stdout: "caps": { 2024-09-11T00:15:06.320 INFO:teuthology.orchestra.run.smithi092.stdout: "mds": "allow", 2024-09-11T00:15:06.320 INFO:teuthology.orchestra.run.smithi092.stdout: "mgr": "allow *", 2024-09-11T00:15:06.321 INFO:teuthology.orchestra.run.smithi092.stdout: "mon": "allow *", 2024-09-11T00:15:06.321 INFO:teuthology.orchestra.run.smithi092.stdout: "osd": "allow *" 2024-09-11T00:15:06.321 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-11T00:15:06.321 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-11T00:15:06.321 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-11T00:15:06.321 INFO:teuthology.orchestra.run.smithi092.stdout: "entity": "mds.d", 2024-09-11T00:15:06.321 INFO:teuthology.orchestra.run.smithi092.stdout: "key": "AQCe4OBmxAr4KRAA9Cx/xqXkLHfCLWwOQ53rDw==", 2024-09-11T00:15:06.321 INFO:teuthology.orchestra.run.smithi092.stdout: "caps": { 2024-09-11T00:15:06.322 INFO:teuthology.orchestra.run.smithi092.stdout: "mds": "allow", 2024-09-11T00:15:06.322 INFO:teuthology.orchestra.run.smithi092.stdout: "mgr": "allow *", 2024-09-11T00:15:06.322 INFO:teuthology.orchestra.run.smithi092.stdout: "mon": "allow *", 2024-09-11T00:15:06.322 INFO:teuthology.orchestra.run.smithi092.stdout: "osd": "allow *" 2024-09-11T00:15:06.322 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-11T00:15:06.322 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-11T00:15:06.322 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-11T00:15:06.322 INFO:teuthology.orchestra.run.smithi092.stdout: "entity": "osd.0", 2024-09-11T00:15:06.322 INFO:teuthology.orchestra.run.smithi092.stdout: "key": "AQCi4OBmtDqPDhAAx12Cm9ty3MItAY+7G5KUZA==", 2024-09-11T00:15:06.323 INFO:teuthology.orchestra.run.smithi092.stdout: "caps": { 2024-09-11T00:15:06.323 INFO:teuthology.orchestra.run.smithi092.stdout: "mgr": "allow profile osd", 2024-09-11T00:15:06.323 INFO:teuthology.orchestra.run.smithi092.stdout: "mon": "allow profile osd", 2024-09-11T00:15:06.323 INFO:teuthology.orchestra.run.smithi092.stdout: "osd": "allow *" 2024-09-11T00:15:06.323 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-11T00:15:06.323 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-11T00:15:06.323 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-11T00:15:06.323 INFO:teuthology.orchestra.run.smithi092.stdout: "entity": "osd.1", 2024-09-11T00:15:06.324 INFO:teuthology.orchestra.run.smithi092.stdout: "key": "AQCl4OBmMX1lHxAA9gNthXojiV/CwkzNV4EtsA==", 2024-09-11T00:15:06.324 INFO:teuthology.orchestra.run.smithi092.stdout: "caps": { 2024-09-11T00:15:06.324 INFO:teuthology.orchestra.run.smithi092.stdout: "mgr": "allow profile osd", 2024-09-11T00:15:06.324 INFO:teuthology.orchestra.run.smithi092.stdout: "mon": "allow profile osd", 2024-09-11T00:15:06.324 INFO:teuthology.orchestra.run.smithi092.stdout: "osd": "allow *" 2024-09-11T00:15:06.324 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-11T00:15:06.324 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-11T00:15:06.324 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-11T00:15:06.324 INFO:teuthology.orchestra.run.smithi092.stdout: "entity": "osd.2", 2024-09-11T00:15:06.324 INFO:teuthology.orchestra.run.smithi092.stdout: "key": "AQCp4OBmT8GXAhAAI02baR11qQP8BQgP5EuuHw==", 2024-09-11T00:15:06.325 INFO:teuthology.orchestra.run.smithi092.stdout: "caps": { 2024-09-11T00:15:06.325 INFO:teuthology.orchestra.run.smithi092.stdout: "mgr": "allow profile osd", 2024-09-11T00:15:06.325 INFO:teuthology.orchestra.run.smithi092.stdout: "mon": "allow profile osd", 2024-09-11T00:15:06.325 INFO:teuthology.orchestra.run.smithi092.stdout: "osd": "allow *" 2024-09-11T00:15:06.325 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-11T00:15:06.325 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-11T00:15:06.325 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-11T00:15:06.325 INFO:teuthology.orchestra.run.smithi092.stdout: "entity": "osd.3", 2024-09-11T00:15:06.325 INFO:teuthology.orchestra.run.smithi092.stdout: "key": "AQCs4OBmbDILExAA8hH1qACKd2U2EVwQ1NxPgA==", 2024-09-11T00:15:06.325 INFO:teuthology.orchestra.run.smithi092.stdout: "caps": { 2024-09-11T00:15:06.325 INFO:teuthology.orchestra.run.smithi092.stdout: "mgr": "allow profile osd", 2024-09-11T00:15:06.325 INFO:teuthology.orchestra.run.smithi092.stdout: "mon": "allow profile osd", 2024-09-11T00:15:06.325 INFO:teuthology.orchestra.run.smithi092.stdout: "osd": "allow *" 2024-09-11T00:15:06.326 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-11T00:15:06.326 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-11T00:15:06.326 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-11T00:15:06.326 INFO:teuthology.orchestra.run.smithi092.stdout: "entity": "osd.4", 2024-09-11T00:15:06.326 INFO:teuthology.orchestra.run.smithi092.stdout: "key": "AQCy4OBmgYt7GRAAyseePTbu7tElPtVIHEC8jA==", 2024-09-11T00:15:06.326 INFO:teuthology.orchestra.run.smithi092.stdout: "caps": { 2024-09-11T00:15:06.326 INFO:teuthology.orchestra.run.smithi092.stdout: "mgr": "allow profile osd", 2024-09-11T00:15:06.326 INFO:teuthology.orchestra.run.smithi092.stdout: "mon": "allow profile osd", 2024-09-11T00:15:06.326 INFO:teuthology.orchestra.run.smithi092.stdout: "osd": "allow *" 2024-09-11T00:15:06.326 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-11T00:15:06.326 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-11T00:15:06.326 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-11T00:15:06.327 INFO:teuthology.orchestra.run.smithi092.stdout: "entity": "osd.5", 2024-09-11T00:15:06.327 INFO:teuthology.orchestra.run.smithi092.stdout: "key": "AQC14OBmVjcPKhAA8ORCTlHOMqPi2BqXV39qug==", 2024-09-11T00:15:06.327 INFO:teuthology.orchestra.run.smithi092.stdout: "caps": { 2024-09-11T00:15:06.327 INFO:teuthology.orchestra.run.smithi092.stdout: "mgr": "allow profile osd", 2024-09-11T00:15:06.327 INFO:teuthology.orchestra.run.smithi092.stdout: "mon": "allow profile osd", 2024-09-11T00:15:06.327 INFO:teuthology.orchestra.run.smithi092.stdout: "osd": "allow *" 2024-09-11T00:15:06.327 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-11T00:15:06.327 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-11T00:15:06.327 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-11T00:15:06.327 INFO:teuthology.orchestra.run.smithi092.stdout: "entity": "osd.6", 2024-09-11T00:15:06.327 INFO:teuthology.orchestra.run.smithi092.stdout: "key": "AQC44OBmuWgaLBAASsJt9EZ9WqxQBe8peGQELg==", 2024-09-11T00:15:06.327 INFO:teuthology.orchestra.run.smithi092.stdout: "caps": { 2024-09-11T00:15:06.328 INFO:teuthology.orchestra.run.smithi092.stdout: "mgr": "allow profile osd", 2024-09-11T00:15:06.328 INFO:teuthology.orchestra.run.smithi092.stdout: "mon": "allow profile osd", 2024-09-11T00:15:06.328 INFO:teuthology.orchestra.run.smithi092.stdout: "osd": "allow *" 2024-09-11T00:15:06.328 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-11T00:15:06.328 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-11T00:15:06.328 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-11T00:15:06.328 INFO:teuthology.orchestra.run.smithi092.stdout: "entity": "osd.7", 2024-09-11T00:15:06.328 INFO:teuthology.orchestra.run.smithi092.stdout: "key": "AQC84OBmNLgLARAAeES0seHW36ArPyi8E0bCKw==", 2024-09-11T00:15:06.328 INFO:teuthology.orchestra.run.smithi092.stdout: "caps": { 2024-09-11T00:15:06.328 INFO:teuthology.orchestra.run.smithi092.stdout: "mgr": "allow profile osd", 2024-09-11T00:15:06.328 INFO:teuthology.orchestra.run.smithi092.stdout: "mon": "allow profile osd", 2024-09-11T00:15:06.328 INFO:teuthology.orchestra.run.smithi092.stdout: "osd": "allow *" 2024-09-11T00:15:06.328 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-11T00:15:06.329 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-11T00:15:06.329 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-11T00:15:06.329 INFO:teuthology.orchestra.run.smithi092.stdout: "entity": "client.0", 2024-09-11T00:15:06.329 INFO:teuthology.orchestra.run.smithi092.stdout: "key": "AQCe4OBmiRAJLhAATruvtg1BGyubuDnFLT3rug==", 2024-09-11T00:15:06.329 INFO:teuthology.orchestra.run.smithi092.stdout: "caps": { 2024-09-11T00:15:06.329 INFO:teuthology.orchestra.run.smithi092.stdout: "mds": "allow", 2024-09-11T00:15:06.329 INFO:teuthology.orchestra.run.smithi092.stdout: "mgr": "allow r", 2024-09-11T00:15:06.329 INFO:teuthology.orchestra.run.smithi092.stdout: "mon": "allow rw", 2024-09-11T00:15:06.329 INFO:teuthology.orchestra.run.smithi092.stdout: "osd": "allow rwx" 2024-09-11T00:15:06.329 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-11T00:15:06.329 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-11T00:15:06.329 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-11T00:15:06.329 INFO:teuthology.orchestra.run.smithi092.stdout: "entity": "client.1", 2024-09-11T00:15:06.329 INFO:teuthology.orchestra.run.smithi092.stdout: "key": "AQCe4OBm5/DWNhAABWcFpCDqMTspKGv+BnvGqg==", 2024-09-11T00:15:06.330 INFO:teuthology.orchestra.run.smithi092.stdout: "caps": { 2024-09-11T00:15:06.330 INFO:teuthology.orchestra.run.smithi092.stdout: "mds": "allow", 2024-09-11T00:15:06.330 INFO:teuthology.orchestra.run.smithi092.stdout: "mgr": "allow r", 2024-09-11T00:15:06.330 INFO:teuthology.orchestra.run.smithi092.stdout: "mon": "allow rw", 2024-09-11T00:15:06.330 INFO:teuthology.orchestra.run.smithi092.stdout: "osd": "allow rwx" 2024-09-11T00:15:06.330 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-11T00:15:06.330 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-11T00:15:06.330 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-11T00:15:06.330 INFO:teuthology.orchestra.run.smithi092.stdout: "entity": "client.2", 2024-09-11T00:15:06.330 INFO:teuthology.orchestra.run.smithi092.stdout: "key": "AQCe4OBmtbGpMxAAV0wJY70pS7DRP9+z+U0joQ==", 2024-09-11T00:15:06.330 INFO:teuthology.orchestra.run.smithi092.stdout: "caps": { 2024-09-11T00:15:06.331 INFO:teuthology.orchestra.run.smithi092.stdout: "mds": "allow", 2024-09-11T00:15:06.331 INFO:teuthology.orchestra.run.smithi092.stdout: "mgr": "allow r", 2024-09-11T00:15:06.331 INFO:teuthology.orchestra.run.smithi092.stdout: "mon": "allow rw", 2024-09-11T00:15:06.331 INFO:teuthology.orchestra.run.smithi092.stdout: "osd": "allow rwx" 2024-09-11T00:15:06.331 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-11T00:15:06.331 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-11T00:15:06.331 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-11T00:15:06.331 INFO:teuthology.orchestra.run.smithi092.stdout: "entity": "client.3", 2024-09-11T00:15:06.331 INFO:teuthology.orchestra.run.smithi092.stdout: "key": "AQCf4OBm1ofPABAA4PD7UowE1Ou30IvhXc5H4Q==", 2024-09-11T00:15:06.331 INFO:teuthology.orchestra.run.smithi092.stdout: "caps": { 2024-09-11T00:15:06.331 INFO:teuthology.orchestra.run.smithi092.stdout: "mds": "allow", 2024-09-11T00:15:06.331 INFO:teuthology.orchestra.run.smithi092.stdout: "mgr": "allow r", 2024-09-11T00:15:06.331 INFO:teuthology.orchestra.run.smithi092.stdout: "mon": "allow rw", 2024-09-11T00:15:06.331 INFO:teuthology.orchestra.run.smithi092.stdout: "osd": "allow rwx" 2024-09-11T00:15:06.331 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-11T00:15:06.332 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-11T00:15:06.332 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-11T00:15:06.332 INFO:teuthology.orchestra.run.smithi092.stdout: "entity": "client.admin", 2024-09-11T00:15:06.332 INFO:teuthology.orchestra.run.smithi092.stdout: "key": "AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg==", 2024-09-11T00:15:06.332 INFO:teuthology.orchestra.run.smithi092.stdout: "caps": { 2024-09-11T00:15:06.332 INFO:teuthology.orchestra.run.smithi092.stdout: "mds": "allow *", 2024-09-11T00:15:06.332 INFO:teuthology.orchestra.run.smithi092.stdout: "mgr": "allow *", 2024-09-11T00:15:06.332 INFO:teuthology.orchestra.run.smithi092.stdout: "mon": "allow *", 2024-09-11T00:15:06.332 INFO:teuthology.orchestra.run.smithi092.stdout: "osd": "allow *" 2024-09-11T00:15:06.332 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-11T00:15:06.332 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-11T00:15:06.333 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-11T00:15:06.333 INFO:teuthology.orchestra.run.smithi092.stdout: "entity": "client.bootstrap-mds", 2024-09-11T00:15:06.333 INFO:teuthology.orchestra.run.smithi092.stdout: "key": "AQDB4OBm7/QSNRAAFxz0ZNAWNH8AwHop7Z+YQA==", 2024-09-11T00:15:06.333 INFO:teuthology.orchestra.run.smithi092.stdout: "caps": { 2024-09-11T00:15:06.333 INFO:teuthology.orchestra.run.smithi092.stdout: "mon": "allow profile bootstrap-mds" 2024-09-11T00:15:06.333 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-11T00:15:06.333 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-11T00:15:06.333 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-11T00:15:06.333 INFO:teuthology.orchestra.run.smithi092.stdout: "entity": "client.bootstrap-mgr", 2024-09-11T00:15:06.333 INFO:teuthology.orchestra.run.smithi092.stdout: "key": "AQDB4OBmkf0SNRAA5Wc9wLVjABz6H42bV3d5Pw==", 2024-09-11T00:15:06.334 INFO:teuthology.orchestra.run.smithi092.stdout: "caps": { 2024-09-11T00:15:06.334 INFO:teuthology.orchestra.run.smithi092.stdout: "mon": "allow profile bootstrap-mgr" 2024-09-11T00:15:06.334 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-11T00:15:06.334 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-11T00:15:06.334 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-11T00:15:06.334 INFO:teuthology.orchestra.run.smithi092.stdout: "entity": "client.bootstrap-osd", 2024-09-11T00:15:06.334 INFO:teuthology.orchestra.run.smithi092.stdout: "key": "AQDB4OBmKwQTNRAARJZlARWFjFi7GcXTMxaCZw==", 2024-09-11T00:15:06.334 INFO:teuthology.orchestra.run.smithi092.stdout: "caps": { 2024-09-11T00:15:06.334 INFO:teuthology.orchestra.run.smithi092.stdout: "mon": "allow profile bootstrap-osd" 2024-09-11T00:15:06.335 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-11T00:15:06.335 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-11T00:15:06.335 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-11T00:15:06.335 INFO:teuthology.orchestra.run.smithi092.stdout: "entity": "client.bootstrap-rbd", 2024-09-11T00:15:06.336 INFO:teuthology.orchestra.run.smithi092.stdout: "key": "AQDB4OBm4QoTNRAAic+lMJOH/S3wdBBGdRMAfg==", 2024-09-11T00:15:06.336 INFO:teuthology.orchestra.run.smithi092.stdout: "caps": { 2024-09-11T00:15:06.336 INFO:teuthology.orchestra.run.smithi092.stdout: "mon": "allow profile bootstrap-rbd" 2024-09-11T00:15:06.336 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-11T00:15:06.336 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-11T00:15:06.336 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-11T00:15:06.337 INFO:teuthology.orchestra.run.smithi092.stdout: "entity": "client.bootstrap-rbd-mirror", 2024-09-11T00:15:06.337 INFO:teuthology.orchestra.run.smithi092.stdout: "key": "AQDB4OBmPRQTNRAAYYsKXuuZ6lnAgsfyQFynfA==", 2024-09-11T00:15:06.337 INFO:teuthology.orchestra.run.smithi092.stdout: "caps": { 2024-09-11T00:15:06.337 INFO:teuthology.orchestra.run.smithi092.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2024-09-11T00:15:06.337 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-11T00:15:06.337 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-11T00:15:06.338 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-11T00:15:06.338 INFO:teuthology.orchestra.run.smithi092.stdout: "entity": "client.bootstrap-rgw", 2024-09-11T00:15:06.338 INFO:teuthology.orchestra.run.smithi092.stdout: "key": "AQDB4OBmYhsTNRAAFU0rMVkTP3qNK3VnDiXoEQ==", 2024-09-11T00:15:06.338 INFO:teuthology.orchestra.run.smithi092.stdout: "caps": { 2024-09-11T00:15:06.339 INFO:teuthology.orchestra.run.smithi092.stdout: "mon": "allow profile bootstrap-rgw" 2024-09-11T00:15:06.339 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-11T00:15:06.339 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-11T00:15:06.339 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-11T00:15:06.339 INFO:teuthology.orchestra.run.smithi092.stdout: "entity": "mgr.x", 2024-09-11T00:15:06.339 INFO:teuthology.orchestra.run.smithi092.stdout: "key": "AQCe4OBmYXf5ExAAX8zEBI+7JeYIxOVBdgi2uw==", 2024-09-11T00:15:06.339 INFO:teuthology.orchestra.run.smithi092.stdout: "caps": { 2024-09-11T00:15:06.340 INFO:teuthology.orchestra.run.smithi092.stdout: "mds": "allow *", 2024-09-11T00:15:06.340 INFO:teuthology.orchestra.run.smithi092.stdout: "mon": "allow profile mgr", 2024-09-11T00:15:06.340 INFO:teuthology.orchestra.run.smithi092.stdout: "osd": "allow *" 2024-09-11T00:15:06.340 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-11T00:15:06.340 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-11T00:15:06.340 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-11T00:15:06.341 INFO:teuthology.orchestra.run.smithi092.stdout: "entity": "mgr.y", 2024-09-11T00:15:06.341 INFO:teuthology.orchestra.run.smithi092.stdout: "key": "AQCe4OBmV1tkEBAA2jhMKrgxcO6OGKvnusmviA==", 2024-09-11T00:15:06.341 INFO:teuthology.orchestra.run.smithi092.stdout: "caps": { 2024-09-11T00:15:06.341 INFO:teuthology.orchestra.run.smithi092.stdout: "mds": "allow *", 2024-09-11T00:15:06.341 INFO:teuthology.orchestra.run.smithi092.stdout: "mon": "allow profile mgr", 2024-09-11T00:15:06.341 INFO:teuthology.orchestra.run.smithi092.stdout: "osd": "allow *" 2024-09-11T00:15:06.341 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-11T00:15:06.341 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-11T00:15:06.341 INFO:teuthology.orchestra.run.smithi092.stdout: ] 2024-09-11T00:15:06.341 INFO:teuthology.orchestra.run.smithi092.stdout:} 2024-09-11T00:15:06.344 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:06.316+0000 7f1d31724640 1 -- 172.21.15.92:0/168308334 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f1d0c077f70 msgr2=0x7f1d0c07a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:06.344 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:06.316+0000 7f1d31724640 1 --2- 172.21.15.92:0/168308334 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f1d0c077f70 0x7f1d0c07a430 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f1d1c006fd0 tx=0x7f1d1c008040 comp rx=0 tx=0).stop 2024-09-11T00:15:06.344 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:06.316+0000 7f1d31724640 1 -- 172.21.15.92:0/168308334 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1d2c0d2a70 msgr2=0x7f1d2c15b5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:06.344 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:06.316+0000 7f1d31724640 1 --2- 172.21.15.92:0/168308334 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1d2c0d2a70 0x7f1d2c15b5c0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f1d1400b4d0 tx=0x7f1d1400b990 comp rx=0 tx=0).stop 2024-09-11T00:15:06.344 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:06.316+0000 7f1d31724640 1 -- 172.21.15.92:0/168308334 shutdown_connections 2024-09-11T00:15:06.344 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:06.316+0000 7f1d31724640 1 --2- 172.21.15.92:0/168308334 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f1d0c077f70 0x7f1d0c07a430 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:06.344 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:06.316+0000 7f1d31724640 1 --2- 172.21.15.92:0/168308334 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1d2c161560 0x7f1d2c15d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:06.344 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:06.316+0000 7f1d31724640 1 --2- 172.21.15.92:0/168308334 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1d2c0d2a70 0x7f1d2c15b5c0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:06.344 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:06.316+0000 7f1d31724640 1 --2- 172.21.15.92:0/168308334 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1d2c0b55a0 0x7f1d2c1533a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:06.345 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:06.316+0000 7f1d31724640 1 -- 172.21.15.92:0/168308334 >> 172.21.15.92:0/168308334 conn(0x7f1d2c09d170 msgr2=0x7f1d2c0b3d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:15:06.345 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:06.316+0000 7f1d31724640 1 -- 172.21.15.92:0/168308334 shutdown_connections 2024-09-11T00:15:06.345 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:06.316+0000 7f1d31724640 1 -- 172.21.15.92:0/168308334 wait complete. 2024-09-11T00:15:06.345 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2024-09-11T00:15:06.450 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:06.447+0000 7f90a9839640 1 -- 172.21.15.92:0/3672746878 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f90a415dea0 msgr2=0x7f90a40d18f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:06.450 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:06.447+0000 7f90a9839640 1 --2- 172.21.15.92:0/3672746878 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f90a415dea0 0x7f90a40d18f0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f9094009830 tx=0x7f909402a530 comp rx=0 tx=0).stop 2024-09-11T00:15:06.450 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:06.447+0000 7f90a9839640 1 -- 172.21.15.92:0/3672746878 shutdown_connections 2024-09-11T00:15:06.450 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:06.447+0000 7f90a9839640 1 --2- 172.21.15.92:0/3672746878 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f90a415dea0 0x7f90a40d18f0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:06.450 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:06.447+0000 7f90a9839640 1 -- 172.21.15.92:0/3672746878 >> 172.21.15.92:0/3672746878 conn(0x7f90a40d3db0 msgr2=0x7f90a40d4190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:15:06.450 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:06.447+0000 7f90a9839640 1 -- 172.21.15.92:0/3672746878 shutdown_connections 2024-09-11T00:15:06.450 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:06.447+0000 7f90a9839640 1 -- 172.21.15.92:0/3672746878 wait complete. 2024-09-11T00:15:06.451 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:06.448+0000 7f90a9839640 1 Processor -- start 2024-09-11T00:15:06.451 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:06.448+0000 7f90a9839640 1 -- start start 2024-09-11T00:15:06.453 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:06.449+0000 7f90a9839640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f90a40d1e30 0x7f90a40ca3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:06.453 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:06.449+0000 7f90a9839640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f90a40d2a10 0x7f90a40a1160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:06.453 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:06.449+0000 7f90a9839640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f90a415dea0 0x7f90a41f8370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:06.453 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:06.449+0000 7f90a9839640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f90a40b2ca0 con 0x7f90a40d2a10 2024-09-11T00:15:06.453 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:06.449+0000 7f90a9839640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f90a40b2b20 con 0x7f90a40d1e30 2024-09-11T00:15:06.453 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:06.449+0000 7f90a9839640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f90a40b2e20 con 0x7f90a415dea0 2024-09-11T00:15:06.453 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:06.449+0000 7f909bfff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f90a40d2a10 0x7f90a40a1160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:06.454 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:06.449+0000 7f909bfff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f90a40d2a10 0x7f90a40a1160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:45714/0 (socket says 172.21.15.92:45714) 2024-09-11T00:15:06.454 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:06.449+0000 7f909bfff640 1 -- 172.21.15.92:0/3530659410 learned_addr learned my addr 172.21.15.92:0/3530659410 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-11T00:15:06.454 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:06.449+0000 7f90a2ffd640 1 --2- 172.21.15.92:0/3530659410 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f90a40d1e30 0x7f90a40ca3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:06.454 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:06.449+0000 7f90a37fe640 1 --2- 172.21.15.92:0/3530659410 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f90a415dea0 0x7f90a41f8370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:06.454 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:06.449+0000 7f909bfff640 1 -- 172.21.15.92:0/3530659410 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f90a415dea0 msgr2=0x7f90a41f8370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:06.454 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:06.449+0000 7f909bfff640 1 --2- 172.21.15.92:0/3530659410 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f90a415dea0 0x7f90a41f8370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:06.454 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:06.449+0000 7f909bfff640 1 -- 172.21.15.92:0/3530659410 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f90a40d1e30 msgr2=0x7f90a40ca3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:06.454 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:06.449+0000 7f909bfff640 1 --2- 172.21.15.92:0/3530659410 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f90a40d1e30 0x7f90a40ca3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:06.454 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:06.449+0000 7f909bfff640 1 -- 172.21.15.92:0/3530659410 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90a40ce020 con 0x7f90a40d2a10 2024-09-11T00:15:06.454 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:06.449+0000 7f90a2ffd640 1 --2- 172.21.15.92:0/3530659410 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f90a40d1e30 0x7f90a40ca3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:15:06.454 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:06.449+0000 7f909bfff640 1 --2- 172.21.15.92:0/3530659410 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f90a40d2a10 0x7f90a40a1160 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f908c00c530 tx=0x7f908c00c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:15:06.454 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:06.449+0000 7f90a0ff9640 1 -- 172.21.15.92:0/3530659410 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f908c0052d0 con 0x7f90a40d2a10 2024-09-11T00:15:06.454 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:06.449+0000 7f90a0ff9640 1 -- 172.21.15.92:0/3530659410 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f908c005470 con 0x7f90a40d2a10 2024-09-11T00:15:06.455 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:06.449+0000 7f90a9839640 1 -- 172.21.15.92:0/3530659410 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f90a40cd4a0 con 0x7f90a40d2a10 2024-09-11T00:15:06.455 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:06.449+0000 7f90a0ff9640 1 -- 172.21.15.92:0/3530659410 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f908c012870 con 0x7f90a40d2a10 2024-09-11T00:15:06.455 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:06.450+0000 7f90a9839640 1 -- 172.21.15.92:0/3530659410 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90a40cda60 con 0x7f90a40d2a10 2024-09-11T00:15:06.455 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:06.450+0000 7f90a9839640 1 -- 172.21.15.92:0/3530659410 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f90a40d14a0 con 0x7f90a40d2a10 2024-09-11T00:15:06.455 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:06.451+0000 7f90a0ff9640 1 -- 172.21.15.92:0/3530659410 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f908c0035f0 con 0x7f90a40d2a10 2024-09-11T00:15:06.456 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:06.451+0000 7f90a0ff9640 1 --2- 172.21.15.92:0/3530659410 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f9084077f70 0x7f908407a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:06.456 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:06.452+0000 7f90a0ff9640 1 -- 172.21.15.92:0/3530659410 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5249+0+0 (secure 0 0 0) 0x7f908c099750 con 0x7f90a40d2a10 2024-09-11T00:15:06.456 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:06.452+0000 7f90a2ffd640 1 --2- 172.21.15.92:0/3530659410 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f9084077f70 0x7f908407a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:06.456 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:06.452+0000 7f90a2ffd640 1 --2- 172.21.15.92:0/3530659410 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f9084077f70 0x7f908407a430 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f9094034000 tx=0x7f9094004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:15:06.458 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:06.456+0000 7f90a0ff9640 1 -- 172.21.15.92:0/3530659410 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f90a40d14a0 con 0x7f90a40d2a10 2024-09-11T00:15:06.699 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:06.696+0000 7f90a9839640 1 -- 172.21.15.92:0/3530659410 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) -- 0x7f90a415d430 con 0x7f90a40d2a10 2024-09-11T00:15:06.701 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:06.698+0000 7f90a0ff9640 1 -- 172.21.15.92:0/3530659410 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v5) ==== 90+0+0 (secure 0 0 0) 0x7f90a415d430 con 0x7f90a40d2a10 2024-09-11T00:15:06.704 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:06.701+0000 7f90a9839640 1 -- 172.21.15.92:0/3530659410 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f9084077f70 msgr2=0x7f908407a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:06.704 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:06.701+0000 7f90a9839640 1 --2- 172.21.15.92:0/3530659410 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f9084077f70 0x7f908407a430 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f9094034000 tx=0x7f9094004730 comp rx=0 tx=0).stop 2024-09-11T00:15:06.704 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:06.701+0000 7f90a9839640 1 -- 172.21.15.92:0/3530659410 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f90a40d2a10 msgr2=0x7f90a40a1160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:06.704 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:06.701+0000 7f90a9839640 1 --2- 172.21.15.92:0/3530659410 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f90a40d2a10 0x7f90a40a1160 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f908c00c530 tx=0x7f908c00c9f0 comp rx=0 tx=0).stop 2024-09-11T00:15:06.704 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:06.701+0000 7f90a9839640 1 -- 172.21.15.92:0/3530659410 shutdown_connections 2024-09-11T00:15:06.704 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:06.701+0000 7f90a9839640 1 --2- 172.21.15.92:0/3530659410 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f9084077f70 0x7f908407a430 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:06.704 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:06.701+0000 7f90a9839640 1 --2- 172.21.15.92:0/3530659410 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f90a415dea0 0x7f90a41f8370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:06.704 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:06.701+0000 7f90a9839640 1 --2- 172.21.15.92:0/3530659410 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f90a40d2a10 0x7f90a40a1160 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:06.704 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:06.701+0000 7f90a9839640 1 --2- 172.21.15.92:0/3530659410 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f90a40d1e30 0x7f90a40ca3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:06.704 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:06.701+0000 7f90a9839640 1 -- 172.21.15.92:0/3530659410 >> 172.21.15.92:0/3530659410 conn(0x7f90a40d3db0 msgr2=0x7f90a40688e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:15:06.704 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:06.701+0000 7f90a9839640 1 -- 172.21.15.92:0/3530659410 shutdown_connections 2024-09-11T00:15:06.704 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:06.701+0000 7f90a9839640 1 -- 172.21.15.92:0/3530659410 wait complete. 2024-09-11T00:15:06.714 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2024-09-11T00:15:06.816 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:06.813+0000 7fcf26d52640 1 -- 172.21.15.92:0/1164867281 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcf2006f140 msgr2=0x7fcf2006f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:06.816 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:06.813+0000 7fcf26d52640 1 --2- 172.21.15.92:0/1164867281 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcf2006f140 0x7fcf2006f5d0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fcf18005fd0 tx=0x7fcf1802a530 comp rx=0 tx=0).stop 2024-09-11T00:15:06.816 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:06.813+0000 7fcf26d52640 1 -- 172.21.15.92:0/1164867281 shutdown_connections 2024-09-11T00:15:06.816 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:06.813+0000 7fcf26d52640 1 --2- 172.21.15.92:0/1164867281 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcf2006f140 0x7fcf2006f5d0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:06.816 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:06.813+0000 7fcf26d52640 1 --2- 172.21.15.92:0/1164867281 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fcf2015c470 0x7fcf2015c8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:06.816 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:06.813+0000 7fcf26d52640 1 -- 172.21.15.92:0/1164867281 >> 172.21.15.92:0/1164867281 conn(0x7fcf200b1760 msgr2=0x7fcf200b1b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:15:06.816 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:06.813+0000 7fcf26d52640 1 -- 172.21.15.92:0/1164867281 shutdown_connections 2024-09-11T00:15:06.816 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:06.813+0000 7fcf26d52640 1 -- 172.21.15.92:0/1164867281 wait complete. 2024-09-11T00:15:06.818 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:06.814+0000 7fcf26d52640 1 Processor -- start 2024-09-11T00:15:06.818 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:06.814+0000 7fcf26d52640 1 -- start start 2024-09-11T00:15:06.819 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:06.815+0000 7fcf26d52640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fcf2006f140 0x7fcf201f2490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:06.819 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:06.815+0000 7fcf26d52640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcf20073780 0x7fcf201392b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:06.819 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:06.815+0000 7fcf26d52640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fcf2015c470 0x7fcf201397f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:06.819 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:06.815+0000 7fcf26d52640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fcf2006fc90 con 0x7fcf20073780 2024-09-11T00:15:06.819 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:06.815+0000 7fcf26d52640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fcf2006fb10 con 0x7fcf2015c470 2024-09-11T00:15:06.819 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:06.815+0000 7fcf26d52640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7fcf2006fe10 con 0x7fcf2006f140 2024-09-11T00:15:06.819 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:06.815+0000 7fcf1ffff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcf20073780 0x7fcf201392b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:06.819 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:06.815+0000 7fcf1ffff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcf20073780 0x7fcf201392b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:45744/0 (socket says 172.21.15.92:45744) 2024-09-11T00:15:06.819 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:06.815+0000 7fcf1ffff640 1 -- 172.21.15.92:0/851328451 learned_addr learned my addr 172.21.15.92:0/851328451 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-11T00:15:06.819 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:06.815+0000 7fcf252ef640 1 --2- 172.21.15.92:0/851328451 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fcf2015c470 0x7fcf201397f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:06.819 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:06.815+0000 7fcf24aee640 1 --2- 172.21.15.92:0/851328451 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fcf2006f140 0x7fcf201f2490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:06.819 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:06.815+0000 7fcf1ffff640 1 -- 172.21.15.92:0/851328451 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fcf2006f140 msgr2=0x7fcf201f2490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:06.819 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:06.815+0000 7fcf1ffff640 1 --2- 172.21.15.92:0/851328451 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fcf2006f140 0x7fcf201f2490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:06.819 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:06.815+0000 7fcf1ffff640 1 -- 172.21.15.92:0/851328451 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fcf2015c470 msgr2=0x7fcf201397f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:06.820 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:06.815+0000 7fcf1ffff640 1 --2- 172.21.15.92:0/851328451 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fcf2015c470 0x7fcf201397f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:06.820 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:06.815+0000 7fcf1ffff640 1 -- 172.21.15.92:0/851328451 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf20138120 con 0x7fcf20073780 2024-09-11T00:15:06.820 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:06.815+0000 7fcf1ffff640 1 --2- 172.21.15.92:0/851328451 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcf20073780 0x7fcf201392b0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fcf1400cd10 tx=0x7fcf140075f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:15:06.820 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:06.815+0000 7fcf1d7fa640 1 -- 172.21.15.92:0/851328451 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf14004b20 con 0x7fcf20073780 2024-09-11T00:15:06.820 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:06.815+0000 7fcf1d7fa640 1 -- 172.21.15.92:0/851328451 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcf14004ce0 con 0x7fcf20073780 2024-09-11T00:15:06.820 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:06.815+0000 7fcf26d52640 1 -- 172.21.15.92:0/851328451 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcf20138400 con 0x7fcf20073780 2024-09-11T00:15:06.820 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:06.816+0000 7fcf1d7fa640 1 -- 172.21.15.92:0/851328451 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf14005280 con 0x7fcf20073780 2024-09-11T00:15:06.820 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:06.816+0000 7fcf26d52640 1 -- 172.21.15.92:0/851328451 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcf201389c0 con 0x7fcf20073780 2024-09-11T00:15:06.821 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:06.816+0000 7fcf26d52640 1 -- 172.21.15.92:0/851328451 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcf20069f60 con 0x7fcf20073780 2024-09-11T00:15:06.821 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:06.817+0000 7fcf1d7fa640 1 -- 172.21.15.92:0/851328451 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fcf14005420 con 0x7fcf20073780 2024-09-11T00:15:06.821 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:06.817+0000 7fcf1d7fa640 1 --2- 172.21.15.92:0/851328451 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7fcf0c077f70 0x7fcf0c07a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:06.821 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:06.818+0000 7fcf1d7fa640 1 -- 172.21.15.92:0/851328451 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5249+0+0 (secure 0 0 0) 0x7fcf1409a3a0 con 0x7fcf20073780 2024-09-11T00:15:06.821 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:06.818+0000 7fcf24aee640 1 --2- 172.21.15.92:0/851328451 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7fcf0c077f70 0x7fcf0c07a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:06.821 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:06.818+0000 7fcf24aee640 1 --2- 172.21.15.92:0/851328451 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7fcf0c077f70 0x7fcf0c07a430 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fcf10004f60 tx=0x7fcf10007e30 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:15:06.824 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:06.822+0000 7fcf1d7fa640 1 -- 172.21.15.92:0/851328451 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fcf20069f60 con 0x7fcf20073780 2024-09-11T00:15:07.073 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:07.070+0000 7fcf26d52640 1 -- 172.21.15.92:0/851328451 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) -- 0x7fcf2006f5d0 con 0x7fcf20073780 2024-09-11T00:15:07.074 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:07.072+0000 7fcf1d7fa640 1 -- 172.21.15.92:0/851328451 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v6) ==== 90+0+0 (secure 0 0 0) 0x7fcf14014030 con 0x7fcf20073780 2024-09-11T00:15:07.077 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:07.074+0000 7fcf26d52640 1 -- 172.21.15.92:0/851328451 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7fcf0c077f70 msgr2=0x7fcf0c07a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:07.077 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:07.074+0000 7fcf26d52640 1 --2- 172.21.15.92:0/851328451 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7fcf0c077f70 0x7fcf0c07a430 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fcf10004f60 tx=0x7fcf10007e30 comp rx=0 tx=0).stop 2024-09-11T00:15:07.077 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:07.074+0000 7fcf26d52640 1 -- 172.21.15.92:0/851328451 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcf20073780 msgr2=0x7fcf201392b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:07.077 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:07.074+0000 7fcf26d52640 1 --2- 172.21.15.92:0/851328451 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcf20073780 0x7fcf201392b0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fcf1400cd10 tx=0x7fcf140075f0 comp rx=0 tx=0).stop 2024-09-11T00:15:07.078 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:07.074+0000 7fcf26d52640 1 -- 172.21.15.92:0/851328451 shutdown_connections 2024-09-11T00:15:07.078 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:07.074+0000 7fcf26d52640 1 --2- 172.21.15.92:0/851328451 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7fcf0c077f70 0x7fcf0c07a430 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:07.078 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:07.074+0000 7fcf26d52640 1 --2- 172.21.15.92:0/851328451 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fcf2015c470 0x7fcf201397f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:07.078 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:07.074+0000 7fcf26d52640 1 --2- 172.21.15.92:0/851328451 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcf20073780 0x7fcf201392b0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:07.078 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:07.074+0000 7fcf26d52640 1 --2- 172.21.15.92:0/851328451 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fcf2006f140 0x7fcf201f2490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:07.078 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:07.075+0000 7fcf26d52640 1 -- 172.21.15.92:0/851328451 >> 172.21.15.92:0/851328451 conn(0x7fcf200b1760 msgr2=0x7fcf200cfaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:15:07.078 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:07.075+0000 7fcf26d52640 1 -- 172.21.15.92:0/851328451 shutdown_connections 2024-09-11T00:15:07.078 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:07.075+0000 7fcf26d52640 1 -- 172.21.15.92:0/851328451 wait complete. 2024-09-11T00:15:07.088 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2024-09-11T00:15:07.190 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:07.187+0000 7f649c457640 1 -- 172.21.15.92:0/2236173553 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f649406cb70 msgr2=0x7f64940cb080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:07.191 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:07.187+0000 7f649c457640 1 --2- 172.21.15.92:0/2236173553 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f649406cb70 0x7f64940cb080 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f648c005fd0 tx=0x7f648c02a780 comp rx=0 tx=0).stop 2024-09-11T00:15:07.191 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:07.188+0000 7f649c457640 1 -- 172.21.15.92:0/2236173553 shutdown_connections 2024-09-11T00:15:07.191 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:07.188+0000 7f649c457640 1 --2- 172.21.15.92:0/2236173553 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f649406cb70 0x7f64940cb080 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:07.191 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:07.188+0000 7f649c457640 1 --2- 172.21.15.92:0/2236173553 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f649406e0a0 0x7f64940b1740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:07.191 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:07.188+0000 7f649c457640 1 -- 172.21.15.92:0/2236173553 >> 172.21.15.92:0/2236173553 conn(0x7f6494074150 msgr2=0x7f6494074560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:15:07.191 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:07.188+0000 7f649c457640 1 -- 172.21.15.92:0/2236173553 shutdown_connections 2024-09-11T00:15:07.192 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:07.188+0000 7f649c457640 1 -- 172.21.15.92:0/2236173553 wait complete. 2024-09-11T00:15:07.197 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:07.189+0000 7f649c457640 1 Processor -- start 2024-09-11T00:15:07.197 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:07.189+0000 7f649c457640 1 -- start start 2024-09-11T00:15:07.197 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:07.189+0000 7f649c457640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f649406cb70 0x7f64941fcd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:07.197 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:07.189+0000 7f649c457640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f649406dcc0 0x7f64941f6150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:07.197 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:07.189+0000 7f649c457640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f649406e0a0 0x7f649415e5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:07.198 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:07.189+0000 7f649c457640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f64940b5010 con 0x7f649406cb70 2024-09-11T00:15:07.198 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:07.189+0000 7f649c457640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f6494069490 con 0x7f649406e0a0 2024-09-11T00:15:07.198 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:07.189+0000 7f649c457640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f64940b5190 con 0x7f649406dcc0 2024-09-11T00:15:07.198 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:07.190+0000 7f649a1f3640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f649406cb70 0x7f64941fcd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:07.198 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:07.190+0000 7f649a1f3640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f649406cb70 0x7f64941fcd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:45764/0 (socket says 172.21.15.92:45764) 2024-09-11T00:15:07.198 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:07.190+0000 7f649a1f3640 1 -- 172.21.15.92:0/902163680 learned_addr learned my addr 172.21.15.92:0/902163680 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-11T00:15:07.199 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:07.190+0000 7f649a9f4640 1 --2- 172.21.15.92:0/902163680 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f649406e0a0 0x7f649415e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:07.199 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:07.190+0000 7f64999f2640 1 --2- 172.21.15.92:0/902163680 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f649406dcc0 0x7f64941f6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:07.199 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:07.190+0000 7f649a1f3640 1 -- 172.21.15.92:0/902163680 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f649406dcc0 msgr2=0x7f64941f6150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:07.199 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:07.190+0000 7f649a1f3640 1 --2- 172.21.15.92:0/902163680 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f649406dcc0 0x7f64941f6150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:07.199 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:07.190+0000 7f649a1f3640 1 -- 172.21.15.92:0/902163680 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f649406e0a0 msgr2=0x7f649415e5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:07.199 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:07.190+0000 7f649a1f3640 1 --2- 172.21.15.92:0/902163680 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f649406e0a0 0x7f649415e5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:07.199 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:07.190+0000 7f649a1f3640 1 -- 172.21.15.92:0/902163680 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6494155350 con 0x7f649406cb70 2024-09-11T00:15:07.199 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:07.190+0000 7f649a9f4640 1 --2- 172.21.15.92:0/902163680 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f649406e0a0 0x7f649415e5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:15:07.200 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:07.190+0000 7f649a1f3640 1 --2- 172.21.15.92:0/902163680 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f649406cb70 0x7f64941fcd00 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f649000c500 tx=0x7f649000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:15:07.200 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:07.190+0000 7f648affd640 1 -- 172.21.15.92:0/902163680 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6490017070 con 0x7f649406cb70 2024-09-11T00:15:07.200 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:07.190+0000 7f648affd640 1 -- 172.21.15.92:0/902163680 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f64900035f0 con 0x7f649406cb70 2024-09-11T00:15:07.200 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:07.190+0000 7f648affd640 1 -- 172.21.15.92:0/902163680 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6490003a40 con 0x7f649406cb70 2024-09-11T00:15:07.200 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:07.190+0000 7f649c457640 1 -- 172.21.15.92:0/902163680 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6494155630 con 0x7f649406cb70 2024-09-11T00:15:07.200 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:07.190+0000 7f649c457640 1 -- 172.21.15.92:0/902163680 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6494155bf0 con 0x7f649406cb70 2024-09-11T00:15:07.200 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:07.191+0000 7f649c457640 1 -- 172.21.15.92:0/902163680 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6494069a50 con 0x7f649406cb70 2024-09-11T00:15:07.200 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:07.192+0000 7f648affd640 1 -- 172.21.15.92:0/902163680 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f6490003be0 con 0x7f649406cb70 2024-09-11T00:15:07.200 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:07.192+0000 7f648affd640 1 --2- 172.21.15.92:0/902163680 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f6478077f70 0x7f647807a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:07.200 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:07.193+0000 7f648affd640 1 -- 172.21.15.92:0/902163680 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5249+0+0 (secure 0 0 0) 0x7f6490099360 con 0x7f649406cb70 2024-09-11T00:15:07.200 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:07.193+0000 7f64999f2640 1 --2- 172.21.15.92:0/902163680 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f6478077f70 0x7f647807a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:07.200 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:07.193+0000 7f64999f2640 1 --2- 172.21.15.92:0/902163680 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f6478077f70 0x7f647807a430 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f64840058c0 tx=0x7f6484005850 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:15:07.201 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:07.197+0000 7f648affd640 1 -- 172.21.15.92:0/902163680 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f6494069a50 con 0x7f649406cb70 2024-09-11T00:15:07.439 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:07.436+0000 7f649c457640 1 -- 172.21.15.92:0/902163680 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) -- 0x7f64940b06a0 con 0x7f649406cb70 2024-09-11T00:15:07.443 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:07.441+0000 7f648affd640 1 -- 172.21.15.92:0/902163680 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v7) ==== 90+0+0 (secure 0 0 0) 0x7f64940b06a0 con 0x7f649406cb70 2024-09-11T00:15:07.445 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:07.442+0000 7f649c457640 1 -- 172.21.15.92:0/902163680 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f6478077f70 msgr2=0x7f647807a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:07.445 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:07.442+0000 7f649c457640 1 --2- 172.21.15.92:0/902163680 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f6478077f70 0x7f647807a430 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f64840058c0 tx=0x7f6484005850 comp rx=0 tx=0).stop 2024-09-11T00:15:07.445 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:07.442+0000 7f649c457640 1 -- 172.21.15.92:0/902163680 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f649406cb70 msgr2=0x7f64941fcd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:07.446 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:07.442+0000 7f649c457640 1 --2- 172.21.15.92:0/902163680 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f649406cb70 0x7f64941fcd00 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f649000c500 tx=0x7f649000c9c0 comp rx=0 tx=0).stop 2024-09-11T00:15:07.446 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:07.442+0000 7f649c457640 1 -- 172.21.15.92:0/902163680 shutdown_connections 2024-09-11T00:15:07.446 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:07.442+0000 7f649c457640 1 --2- 172.21.15.92:0/902163680 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f6478077f70 0x7f647807a430 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:07.446 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:07.442+0000 7f649c457640 1 --2- 172.21.15.92:0/902163680 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f649406e0a0 0x7f649415e5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:07.446 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:07.442+0000 7f649c457640 1 --2- 172.21.15.92:0/902163680 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f649406dcc0 0x7f64941f6150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:07.446 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:07.442+0000 7f649c457640 1 --2- 172.21.15.92:0/902163680 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f649406cb70 0x7f64941fcd00 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:07.446 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:07.442+0000 7f649c457640 1 -- 172.21.15.92:0/902163680 >> 172.21.15.92:0/902163680 conn(0x7f6494074150 msgr2=0x7f649406ee00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:15:07.446 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:07.443+0000 7f649c457640 1 -- 172.21.15.92:0/902163680 shutdown_connections 2024-09-11T00:15:07.446 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:07.443+0000 7f649c457640 1 -- 172.21.15.92:0/902163680 wait complete. 2024-09-11T00:15:07.456 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2024-09-11T00:15:07.559 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:07.556+0000 7f83c75e2640 1 -- 172.21.15.92:0/1420524375 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f83c0072680 msgr2=0x7f83c0072aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:07.560 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:07.556+0000 7f83c75e2640 1 --2- 172.21.15.92:0/1420524375 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f83c0072680 0x7f83c0072aa0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f83b4005fd0 tx=0x7f83b402a540 comp rx=0 tx=0).stop 2024-09-11T00:15:07.560 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:07.556+0000 7f83c75e2640 1 -- 172.21.15.92:0/1420524375 shutdown_connections 2024-09-11T00:15:07.560 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:07.556+0000 7f83c75e2640 1 --2- 172.21.15.92:0/1420524375 >> v2:172.21.15.145:3300/0 conn(0x7f83c00ceb00 0x7f83c00cef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:07.560 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:07.556+0000 7f83c75e2640 1 --2- 172.21.15.92:0/1420524375 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f83c0072680 0x7f83c0072aa0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:07.560 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:07.556+0000 7f83c75e2640 1 -- 172.21.15.92:0/1420524375 >> 172.21.15.92:0/1420524375 conn(0x7f83c00b1760 msgr2=0x7f83c00b1b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:15:07.560 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:07.557+0000 7f83c75e2640 1 -- 172.21.15.92:0/1420524375 shutdown_connections 2024-09-11T00:15:07.560 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:07.557+0000 7f83c75e2640 1 -- 172.21.15.92:0/1420524375 wait complete. 2024-09-11T00:15:07.563 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:07.558+0000 7f83c75e2640 1 Processor -- start 2024-09-11T00:15:07.563 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:07.558+0000 7f83c75e2640 1 -- start start 2024-09-11T00:15:07.563 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:07.558+0000 7f83c75e2640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f83c0072680 0x7f83c00af000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:07.563 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:07.558+0000 7f83c75e2640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f83c00ceb00 0x7f83c01f67e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:07.563 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:07.558+0000 7f83c75e2640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f83c0144780 0x7f83c006f330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:07.563 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:07.558+0000 7f83c75e2640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f83c015c960 con 0x7f83c00ceb00 2024-09-11T00:15:07.564 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:07.558+0000 7f83c75e2640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f83c015c7e0 con 0x7f83c0144780 2024-09-11T00:15:07.564 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:07.558+0000 7f83c75e2640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f83c015cae0 con 0x7f83c0072680 2024-09-11T00:15:07.564 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:07.559+0000 7f83c4b7d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f83c00ceb00 0x7f83c01f67e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:07.564 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:07.559+0000 7f83c4b7d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f83c00ceb00 0x7f83c01f67e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:45766/0 (socket says 172.21.15.92:45766) 2024-09-11T00:15:07.564 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:07.559+0000 7f83c4b7d640 1 -- 172.21.15.92:0/3224919117 learned_addr learned my addr 172.21.15.92:0/3224919117 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-11T00:15:07.564 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:07.559+0000 7f83c5b7f640 1 --2- 172.21.15.92:0/3224919117 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f83c0144780 0x7f83c006f330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:07.564 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:07.559+0000 7f83c537e640 1 --2- 172.21.15.92:0/3224919117 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f83c0072680 0x7f83c00af000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:07.564 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:07.559+0000 7f83c4b7d640 1 -- 172.21.15.92:0/3224919117 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f83c0072680 msgr2=0x7f83c00af000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:07.564 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:07.559+0000 7f83c4b7d640 1 --2- 172.21.15.92:0/3224919117 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f83c0072680 0x7f83c00af000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:07.564 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:07.559+0000 7f83c4b7d640 1 -- 172.21.15.92:0/3224919117 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f83c0144780 msgr2=0x7f83c006f330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:07.564 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:07.559+0000 7f83c4b7d640 1 --2- 172.21.15.92:0/3224919117 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f83c0144780 0x7f83c006f330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:07.564 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:07.559+0000 7f83c4b7d640 1 -- 172.21.15.92:0/3224919117 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83c0140980 con 0x7f83c00ceb00 2024-09-11T00:15:07.565 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:07.559+0000 7f83c4b7d640 1 --2- 172.21.15.92:0/3224919117 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f83c00ceb00 0x7f83c01f67e0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f83b4000c00 tx=0x7f83b40038a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:15:07.565 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:07.559+0000 7f83bdffb640 1 -- 172.21.15.92:0/3224919117 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83b403f070 con 0x7f83c00ceb00 2024-09-11T00:15:07.565 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:07.559+0000 7f83c75e2640 1 -- 172.21.15.92:0/3224919117 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83c01e6cb0 con 0x7f83c00ceb00 2024-09-11T00:15:07.565 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:07.559+0000 7f83bdffb640 1 -- 172.21.15.92:0/3224919117 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f83b40047a0 con 0x7f83c00ceb00 2024-09-11T00:15:07.565 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:07.559+0000 7f83bdffb640 1 -- 172.21.15.92:0/3224919117 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83b4035030 con 0x7f83c00ceb00 2024-09-11T00:15:07.565 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:07.560+0000 7f83c75e2640 1 -- 172.21.15.92:0/3224919117 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83c01e7270 con 0x7f83c00ceb00 2024-09-11T00:15:07.565 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:07.561+0000 7f83c75e2640 1 -- 172.21.15.92:0/3224919117 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f83c015d000 con 0x7f83c00ceb00 2024-09-11T00:15:07.566 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:07.561+0000 7f83bdffb640 1 -- 172.21.15.92:0/3224919117 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f83b4004bf0 con 0x7f83c00ceb00 2024-09-11T00:15:07.566 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:07.561+0000 7f83bdffb640 1 --2- 172.21.15.92:0/3224919117 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f83ac077f70 0x7f83ac07a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:07.566 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:07.562+0000 7f83bdffb640 1 -- 172.21.15.92:0/3224919117 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5249+0+0 (secure 0 0 0) 0x7f83b40bae40 con 0x7f83c00ceb00 2024-09-11T00:15:07.566 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:07.562+0000 7f83c537e640 1 --2- 172.21.15.92:0/3224919117 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f83ac077f70 0x7f83ac07a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:07.566 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:07.562+0000 7f83c537e640 1 --2- 172.21.15.92:0/3224919117 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f83ac077f70 0x7f83ac07a430 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f83c01e8350 tx=0x7f83b0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:15:07.568 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:07.566+0000 7f83bdffb640 1 -- 172.21.15.92:0/3224919117 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f83c0140980 con 0x7f83c00ceb00 2024-09-11T00:15:07.808 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:07.807+0000 7f83c75e2640 1 -- 172.21.15.92:0/3224919117 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) -- 0x7f83c00b4d40 con 0x7f83c00ceb00 2024-09-11T00:15:07.810 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:07.809+0000 7f83bdffb640 1 -- 172.21.15.92:0/3224919117 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v8) ==== 90+0+0 (secure 0 0 0) 0x7f83b40834c0 con 0x7f83c00ceb00 2024-09-11T00:15:07.813 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:07.811+0000 7f83c75e2640 1 -- 172.21.15.92:0/3224919117 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f83ac077f70 msgr2=0x7f83ac07a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:07.813 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:07.811+0000 7f83c75e2640 1 --2- 172.21.15.92:0/3224919117 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f83ac077f70 0x7f83ac07a430 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f83c01e8350 tx=0x7f83b0009040 comp rx=0 tx=0).stop 2024-09-11T00:15:07.813 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:07.811+0000 7f83c75e2640 1 -- 172.21.15.92:0/3224919117 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f83c00ceb00 msgr2=0x7f83c01f67e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:07.813 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:07.811+0000 7f83c75e2640 1 --2- 172.21.15.92:0/3224919117 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f83c00ceb00 0x7f83c01f67e0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f83b4000c00 tx=0x7f83b40038a0 comp rx=0 tx=0).stop 2024-09-11T00:15:07.813 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:07.811+0000 7f83c75e2640 1 -- 172.21.15.92:0/3224919117 shutdown_connections 2024-09-11T00:15:07.813 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:07.811+0000 7f83c75e2640 1 --2- 172.21.15.92:0/3224919117 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f83ac077f70 0x7f83ac07a430 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:07.813 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:07.811+0000 7f83c75e2640 1 --2- 172.21.15.92:0/3224919117 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f83c0144780 0x7f83c006f330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:07.813 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:07.811+0000 7f83c75e2640 1 --2- 172.21.15.92:0/3224919117 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f83c00ceb00 0x7f83c01f67e0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:07.813 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:07.811+0000 7f83c75e2640 1 --2- 172.21.15.92:0/3224919117 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f83c0072680 0x7f83c00af000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:07.813 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:07.811+0000 7f83c75e2640 1 -- 172.21.15.92:0/3224919117 >> 172.21.15.92:0/3224919117 conn(0x7f83c00b1760 msgr2=0x7f83c00cff30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:15:07.813 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:07.811+0000 7f83c75e2640 1 -- 172.21.15.92:0/3224919117 shutdown_connections 2024-09-11T00:15:07.814 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:07.811+0000 7f83c75e2640 1 -- 172.21.15.92:0/3224919117 wait complete. 2024-09-11T00:15:07.823 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2024-09-11T00:15:07.925 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:07.924+0000 7f5afad4b640 1 -- 172.21.15.92:0/4035561691 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5af40cf210 msgr2=0x7f5af415c550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:07.926 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:07.924+0000 7f5afad4b640 1 --2- 172.21.15.92:0/4035561691 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5af40cf210 0x7f5af415c550 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f5af406de10 tx=0x7f5aec02a820 comp rx=0 tx=0).stop 2024-09-11T00:15:07.926 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:07.924+0000 7f5afad4b640 1 -- 172.21.15.92:0/4035561691 shutdown_connections 2024-09-11T00:15:07.926 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:07.924+0000 7f5afad4b640 1 --2- 172.21.15.92:0/4035561691 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5af40cf210 0x7f5af415c550 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:07.926 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:07.924+0000 7f5afad4b640 1 --2- 172.21.15.92:0/4035561691 >> v2:172.21.15.145:3300/0 conn(0x7f5af4144780 0x7f5af40b3da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:07.926 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:07.924+0000 7f5afad4b640 1 -- 172.21.15.92:0/4035561691 >> 172.21.15.92:0/4035561691 conn(0x7f5af40b1760 msgr2=0x7f5af40b1b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:15:07.926 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:07.924+0000 7f5afad4b640 1 -- 172.21.15.92:0/4035561691 shutdown_connections 2024-09-11T00:15:07.926 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:07.924+0000 7f5afad4b640 1 -- 172.21.15.92:0/4035561691 wait complete. 2024-09-11T00:15:07.927 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:07.925+0000 7f5afad4b640 1 Processor -- start 2024-09-11T00:15:07.927 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:07.925+0000 7f5afad4b640 1 -- start start 2024-09-11T00:15:07.929 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:07.926+0000 7f5afad4b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5af4072680 0x7f5af4131020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:07.929 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:07.926+0000 7f5afad4b640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5af40cf210 0x7f5af40cdc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:07.929 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:07.926+0000 7f5afad4b640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f5af4144780 0x7f5af41f2a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:07.929 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:07.926+0000 7f5afad4b640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f5af415ca90 con 0x7f5af4072680 2024-09-11T00:15:07.929 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:07.926+0000 7f5afad4b640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f5af4072df0 con 0x7f5af40cf210 2024-09-11T00:15:07.929 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:07.926+0000 7f5afad4b640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f5af415cc10 con 0x7f5af4144780 2024-09-11T00:15:07.929 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:07.926+0000 7f5af8ae7640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5af4072680 0x7f5af4131020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:07.929 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:07.926+0000 7f5af8ae7640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5af4072680 0x7f5af4131020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:45776/0 (socket says 172.21.15.92:45776) 2024-09-11T00:15:07.929 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:07.926+0000 7f5af8ae7640 1 -- 172.21.15.92:0/2598315427 learned_addr learned my addr 172.21.15.92:0/2598315427 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-11T00:15:07.929 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:07.926+0000 7f5af92e8640 1 --2- 172.21.15.92:0/2598315427 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f5af4144780 0x7f5af41f2a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:07.930 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:07.926+0000 7f5af3fff640 1 --2- 172.21.15.92:0/2598315427 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5af40cf210 0x7f5af40cdc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:07.930 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:07.926+0000 7f5af8ae7640 1 -- 172.21.15.92:0/2598315427 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f5af4144780 msgr2=0x7f5af41f2a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:07.930 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:07.926+0000 7f5af8ae7640 1 --2- 172.21.15.92:0/2598315427 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f5af4144780 0x7f5af41f2a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:07.930 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:07.926+0000 7f5af8ae7640 1 -- 172.21.15.92:0/2598315427 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5af40cf210 msgr2=0x7f5af40cdc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:07.930 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:07.926+0000 7f5af8ae7640 1 --2- 172.21.15.92:0/2598315427 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5af40cf210 0x7f5af40cdc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:07.930 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:07.926+0000 7f5af8ae7640 1 -- 172.21.15.92:0/2598315427 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5af41f3500 con 0x7f5af4072680 2024-09-11T00:15:07.930 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:07.927+0000 7f5af8ae7640 1 --2- 172.21.15.92:0/2598315427 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5af4072680 0x7f5af4131020 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f5ae400d740 tx=0x7f5ae400dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:15:07.930 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:07.927+0000 7f5af17fa640 1 -- 172.21.15.92:0/2598315427 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ae4017070 con 0x7f5af4072680 2024-09-11T00:15:07.930 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:07.927+0000 7f5af17fa640 1 -- 172.21.15.92:0/2598315427 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5ae4009d20 con 0x7f5af4072680 2024-09-11T00:15:07.930 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:07.927+0000 7f5afad4b640 1 -- 172.21.15.92:0/2598315427 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5af41f37e0 con 0x7f5af4072680 2024-09-11T00:15:07.930 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:07.927+0000 7f5af17fa640 1 -- 172.21.15.92:0/2598315427 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ae40106c0 con 0x7f5af4072680 2024-09-11T00:15:07.930 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:07.927+0000 7f5afad4b640 1 -- 172.21.15.92:0/2598315427 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5af40abab0 con 0x7f5af4072680 2024-09-11T00:15:07.931 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:07.928+0000 7f5afad4b640 1 -- 172.21.15.92:0/2598315427 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5af415c550 con 0x7f5af4072680 2024-09-11T00:15:07.931 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:07.928+0000 7f5af17fa640 1 -- 172.21.15.92:0/2598315427 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f5ae4010860 con 0x7f5af4072680 2024-09-11T00:15:07.931 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:07.929+0000 7f5af17fa640 1 --2- 172.21.15.92:0/2598315427 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f5ae0077f70 0x7f5ae007a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:07.932 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:07.929+0000 7f5af17fa640 1 -- 172.21.15.92:0/2598315427 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5249+0+0 (secure 0 0 0) 0x7f5ae4099f40 con 0x7f5af4072680 2024-09-11T00:15:07.932 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:07.929+0000 7f5af3fff640 1 --2- 172.21.15.92:0/2598315427 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f5ae0077f70 0x7f5ae007a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:07.932 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:07.929+0000 7f5af3fff640 1 --2- 172.21.15.92:0/2598315427 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f5ae0077f70 0x7f5ae007a430 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f5af40cf170 tx=0x7f5ae8007e90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:15:07.934 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:07.933+0000 7f5af17fa640 1 -- 172.21.15.92:0/2598315427 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f5ae40625b0 con 0x7f5af4072680 2024-09-11T00:15:08.177 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:08.175+0000 7f5afad4b640 1 -- 172.21.15.92:0/2598315427 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) -- 0x7f5af40b4d40 con 0x7f5af4072680 2024-09-11T00:15:08.180 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:08.179+0000 7f5af17fa640 1 -- 172.21.15.92:0/2598315427 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v9) ==== 97+0+0 (secure 0 0 0) 0x7f5ae4066fe0 con 0x7f5af4072680 2024-09-11T00:15:08.183 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:08.181+0000 7f5afad4b640 1 -- 172.21.15.92:0/2598315427 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f5ae0077f70 msgr2=0x7f5ae007a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:08.183 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:08.181+0000 7f5afad4b640 1 --2- 172.21.15.92:0/2598315427 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f5ae0077f70 0x7f5ae007a430 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f5af40cf170 tx=0x7f5ae8007e90 comp rx=0 tx=0).stop 2024-09-11T00:15:08.183 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:08.181+0000 7f5afad4b640 1 -- 172.21.15.92:0/2598315427 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5af4072680 msgr2=0x7f5af4131020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:08.183 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:08.181+0000 7f5afad4b640 1 --2- 172.21.15.92:0/2598315427 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5af4072680 0x7f5af4131020 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f5ae400d740 tx=0x7f5ae400dc00 comp rx=0 tx=0).stop 2024-09-11T00:15:08.183 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:08.181+0000 7f5afad4b640 1 -- 172.21.15.92:0/2598315427 shutdown_connections 2024-09-11T00:15:08.183 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:08.181+0000 7f5afad4b640 1 --2- 172.21.15.92:0/2598315427 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f5ae0077f70 0x7f5ae007a430 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:08.183 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:08.181+0000 7f5afad4b640 1 --2- 172.21.15.92:0/2598315427 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f5af4144780 0x7f5af41f2a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:08.184 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:08.181+0000 7f5afad4b640 1 --2- 172.21.15.92:0/2598315427 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5af40cf210 0x7f5af40cdc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:08.184 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:08.181+0000 7f5afad4b640 1 --2- 172.21.15.92:0/2598315427 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5af4072680 0x7f5af4131020 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:08.184 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:08.181+0000 7f5afad4b640 1 -- 172.21.15.92:0/2598315427 >> 172.21.15.92:0/2598315427 conn(0x7f5af40b1760 msgr2=0x7f5af40702f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:15:08.184 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:08.181+0000 7f5afad4b640 1 -- 172.21.15.92:0/2598315427 shutdown_connections 2024-09-11T00:15:08.184 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:08.181+0000 7f5afad4b640 1 -- 172.21.15.92:0/2598315427 wait complete. 2024-09-11T00:15:08.194 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2024-09-11T00:15:08.295 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:08.293+0000 7f54bf803640 1 -- 172.21.15.92:0/438345092 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f54b815b1e0 msgr2=0x7f54b806fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:08.295 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:08.293+0000 7f54bf803640 1 --2- 172.21.15.92:0/438345092 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f54b815b1e0 0x7f54b806fc90 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f54b806c960 tx=0x7f54a802a8b0 comp rx=0 tx=0).stop 2024-09-11T00:15:08.296 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:08.293+0000 7f54bf803640 1 -- 172.21.15.92:0/438345092 shutdown_connections 2024-09-11T00:15:08.296 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:08.293+0000 7f54bf803640 1 --2- 172.21.15.92:0/438345092 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f54b815da30 0x7f54b815de90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:08.296 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:08.293+0000 7f54bf803640 1 --2- 172.21.15.92:0/438345092 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f54b815b1e0 0x7f54b806fc90 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:08.296 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:08.293+0000 7f54bf803640 1 --2- 172.21.15.92:0/438345092 >> v2:172.21.15.145:3300/0 conn(0x7f54b813cf80 0x7f54b806f750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:08.296 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:08.293+0000 7f54bf803640 1 -- 172.21.15.92:0/438345092 >> 172.21.15.92:0/438345092 conn(0x7f54b80b1760 msgr2=0x7f54b80b1b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:15:08.296 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:08.294+0000 7f54bf803640 1 -- 172.21.15.92:0/438345092 shutdown_connections 2024-09-11T00:15:08.296 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:08.294+0000 7f54bf803640 1 -- 172.21.15.92:0/438345092 wait complete. 2024-09-11T00:15:08.298 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:08.295+0000 7f54bf803640 1 Processor -- start 2024-09-11T00:15:08.298 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:08.295+0000 7f54bf803640 1 -- start start 2024-09-11T00:15:08.298 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:08.295+0000 7f54bf803640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f54b813cf80 0x7f54b81f2960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:08.298 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:08.295+0000 7f54bf803640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f54b815b1e0 0x7f54b8073cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:08.299 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:08.295+0000 7f54bf803640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f54b815da30 0x7f54b8074210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:08.299 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:08.295+0000 7f54bf803640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f54b806e460 con 0x7f54b813cf80 2024-09-11T00:15:08.299 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:08.295+0000 7f54bf803640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f54b806e2e0 con 0x7f54b815da30 2024-09-11T00:15:08.299 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:08.295+0000 7f54bf803640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f54b806e5e0 con 0x7f54b815b1e0 2024-09-11T00:15:08.299 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:08.295+0000 7f54bd59f640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f54b813cf80 0x7f54b81f2960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:08.299 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:08.296+0000 7f54bd59f640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f54b813cf80 0x7f54b81f2960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:45786/0 (socket says 172.21.15.92:45786) 2024-09-11T00:15:08.299 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:08.296+0000 7f54bd59f640 1 -- 172.21.15.92:0/2066009922 learned_addr learned my addr 172.21.15.92:0/2066009922 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-11T00:15:08.299 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:08.296+0000 7f54bcd9e640 1 --2- 172.21.15.92:0/2066009922 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f54b815b1e0 0x7f54b8073cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:08.299 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:08.296+0000 7f54bdda0640 1 --2- 172.21.15.92:0/2066009922 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f54b815da30 0x7f54b8074210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:08.299 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:08.296+0000 7f54bd59f640 1 -- 172.21.15.92:0/2066009922 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f54b815b1e0 msgr2=0x7f54b8073cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:08.299 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:08.296+0000 7f54bd59f640 1 --2- 172.21.15.92:0/2066009922 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f54b815b1e0 0x7f54b8073cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:08.299 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:08.296+0000 7f54bd59f640 1 -- 172.21.15.92:0/2066009922 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f54b815da30 msgr2=0x7f54b8074210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:08.299 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:08.296+0000 7f54bd59f640 1 --2- 172.21.15.92:0/2066009922 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f54b815da30 0x7f54b8074210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:08.299 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:08.296+0000 7f54bd59f640 1 -- 172.21.15.92:0/2066009922 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54b813b720 con 0x7f54b813cf80 2024-09-11T00:15:08.300 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:08.296+0000 7f54bd59f640 1 --2- 172.21.15.92:0/2066009922 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f54b813cf80 0x7f54b81f2960 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f54b400b4a0 tx=0x7f54b400b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:15:08.300 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:08.296+0000 7f54adffb640 1 -- 172.21.15.92:0/2066009922 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54b4014070 con 0x7f54b813cf80 2024-09-11T00:15:08.300 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:08.296+0000 7f54adffb640 1 -- 172.21.15.92:0/2066009922 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f54b4010700 con 0x7f54b813cf80 2024-09-11T00:15:08.300 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:08.296+0000 7f54bf803640 1 -- 172.21.15.92:0/2066009922 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f54b813ba00 con 0x7f54b813cf80 2024-09-11T00:15:08.300 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:08.296+0000 7f54adffb640 1 -- 172.21.15.92:0/2066009922 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54b4010b50 con 0x7f54b813cf80 2024-09-11T00:15:08.300 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:08.296+0000 7f54bf803640 1 -- 172.21.15.92:0/2066009922 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54b813bfc0 con 0x7f54b813cf80 2024-09-11T00:15:08.301 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:08.297+0000 7f54bf803640 1 -- 172.21.15.92:0/2066009922 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f54b815de90 con 0x7f54b813cf80 2024-09-11T00:15:08.301 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:08.298+0000 7f54adffb640 1 -- 172.21.15.92:0/2066009922 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f54b4017360 con 0x7f54b813cf80 2024-09-11T00:15:08.301 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:08.298+0000 7f54adffb640 1 --2- 172.21.15.92:0/2066009922 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f549c077fa0 0x7f549c07a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:08.301 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:08.299+0000 7f54adffb640 1 -- 172.21.15.92:0/2066009922 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5249+0+0 (secure 0 0 0) 0x7f54b4099770 con 0x7f54b813cf80 2024-09-11T00:15:08.301 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:08.299+0000 7f54bcd9e640 1 --2- 172.21.15.92:0/2066009922 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f549c077fa0 0x7f549c07a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:08.301 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:08.299+0000 7f54bcd9e640 1 --2- 172.21.15.92:0/2066009922 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f549c077fa0 0x7f549c07a460 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f54a8033000 tx=0x7f54a8004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:15:08.304 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:08.302+0000 7f54adffb640 1 -- 172.21.15.92:0/2066009922 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f54b4061e70 con 0x7f54b813cf80 2024-09-11T00:15:08.546 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:08.544+0000 7f54bf803640 1 -- 172.21.15.92:0/2066009922 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) -- 0x7f54b80cd660 con 0x7f54b813cf80 2024-09-11T00:15:08.548 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:08.546+0000 7f54adffb640 1 -- 172.21.15.92:0/2066009922 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v10) ==== 90+0+0 (secure 0 0 0) 0x7f54b40668a0 con 0x7f54b813cf80 2024-09-11T00:15:08.551 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:08.549+0000 7f54bf803640 1 -- 172.21.15.92:0/2066009922 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f549c077fa0 msgr2=0x7f549c07a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:08.551 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:08.549+0000 7f54bf803640 1 --2- 172.21.15.92:0/2066009922 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f549c077fa0 0x7f549c07a460 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f54a8033000 tx=0x7f54a8004730 comp rx=0 tx=0).stop 2024-09-11T00:15:08.551 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:08.549+0000 7f54bf803640 1 -- 172.21.15.92:0/2066009922 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f54b813cf80 msgr2=0x7f54b81f2960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:08.551 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:08.549+0000 7f54bf803640 1 --2- 172.21.15.92:0/2066009922 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f54b813cf80 0x7f54b81f2960 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f54b400b4a0 tx=0x7f54b400b960 comp rx=0 tx=0).stop 2024-09-11T00:15:08.552 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:08.550+0000 7f54bf803640 1 -- 172.21.15.92:0/2066009922 shutdown_connections 2024-09-11T00:15:08.552 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:08.550+0000 7f54bf803640 1 --2- 172.21.15.92:0/2066009922 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f549c077fa0 0x7f549c07a460 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:08.552 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:08.550+0000 7f54bf803640 1 --2- 172.21.15.92:0/2066009922 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f54b815da30 0x7f54b8074210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:08.552 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:08.550+0000 7f54bf803640 1 --2- 172.21.15.92:0/2066009922 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f54b815b1e0 0x7f54b8073cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:08.552 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:08.550+0000 7f54bf803640 1 --2- 172.21.15.92:0/2066009922 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f54b813cf80 0x7f54b81f2960 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:08.552 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:08.550+0000 7f54bf803640 1 -- 172.21.15.92:0/2066009922 >> 172.21.15.92:0/2066009922 conn(0x7f54b80b1760 msgr2=0x7f54b8158640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:15:08.552 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:08.550+0000 7f54bf803640 1 -- 172.21.15.92:0/2066009922 shutdown_connections 2024-09-11T00:15:08.552 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:08.550+0000 7f54bf803640 1 -- 172.21.15.92:0/2066009922 wait complete. 2024-09-11T00:15:08.562 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-11T00:15:08.663 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:08.661+0000 7f52d2ba1640 1 -- 172.21.15.92:0/1138021558 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f52cc0d2520 msgr2=0x7f52cc0cf5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:08.663 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:08.661+0000 7f52d2ba1640 1 --2- 172.21.15.92:0/1138021558 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f52cc0d2520 0x7f52cc0cf5d0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f52c0009830 tx=0x7f52c002a480 comp rx=0 tx=0).stop 2024-09-11T00:15:08.663 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:08.661+0000 7f52d2ba1640 1 -- 172.21.15.92:0/1138021558 shutdown_connections 2024-09-11T00:15:08.663 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:08.661+0000 7f52d2ba1640 1 --2- 172.21.15.92:0/1138021558 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f52cc0cfb10 0x7f52cc15bf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:08.663 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:08.661+0000 7f52d2ba1640 1 --2- 172.21.15.92:0/1138021558 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f52cc0d2520 0x7f52cc0cf5d0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:08.663 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:08.661+0000 7f52d2ba1640 1 -- 172.21.15.92:0/1138021558 >> 172.21.15.92:0/1138021558 conn(0x7f52cc0d1a00 msgr2=0x7f52cc0d1e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:15:08.663 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:08.661+0000 7f52d2ba1640 1 -- 172.21.15.92:0/1138021558 shutdown_connections 2024-09-11T00:15:08.664 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:08.661+0000 7f52d2ba1640 1 -- 172.21.15.92:0/1138021558 wait complete. 2024-09-11T00:15:08.666 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:08.662+0000 7f52d2ba1640 1 Processor -- start 2024-09-11T00:15:08.666 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:08.662+0000 7f52d2ba1640 1 -- start start 2024-09-11T00:15:08.666 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:08.663+0000 7f52d2ba1640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f52cc0cfb10 0x7f52cc1f1dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:08.666 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:08.663+0000 7f52d2ba1640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f52cc0d2520 0x7f52cc0c7b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:08.667 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:08.663+0000 7f52d2ba1640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f52cc15bb60 0x7f52cc14ab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:08.667 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:08.663+0000 7f52d2ba1640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f52cc15c600 con 0x7f52cc15bb60 2024-09-11T00:15:08.667 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:08.663+0000 7f52d2ba1640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f52cc15c480 con 0x7f52cc0cfb10 2024-09-11T00:15:08.667 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:08.663+0000 7f52d2ba1640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f52cc15c780 con 0x7f52cc0d2520 2024-09-11T00:15:08.667 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:08.663+0000 7f52d23a0640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f52cc15bb60 0x7f52cc14ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:08.667 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:08.663+0000 7f52d23a0640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f52cc15bb60 0x7f52cc14ab20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:45812/0 (socket says 172.21.15.92:45812) 2024-09-11T00:15:08.667 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:08.663+0000 7f52d23a0640 1 -- 172.21.15.92:0/2670353682 learned_addr learned my addr 172.21.15.92:0/2670353682 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-11T00:15:08.667 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:08.663+0000 7f52d139e640 1 --2- 172.21.15.92:0/2670353682 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f52cc0d2520 0x7f52cc0c7b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:08.667 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:08.663+0000 7f52d1b9f640 1 --2- 172.21.15.92:0/2670353682 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f52cc0cfb10 0x7f52cc1f1dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:08.667 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:08.663+0000 7f52d23a0640 1 -- 172.21.15.92:0/2670353682 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f52cc0d2520 msgr2=0x7f52cc0c7b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:08.667 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:08.663+0000 7f52d23a0640 1 --2- 172.21.15.92:0/2670353682 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f52cc0d2520 0x7f52cc0c7b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:08.667 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:08.663+0000 7f52d23a0640 1 -- 172.21.15.92:0/2670353682 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f52cc0cfb10 msgr2=0x7f52cc1f1dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:08.667 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:08.663+0000 7f52d23a0640 1 --2- 172.21.15.92:0/2670353682 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f52cc0cfb10 0x7f52cc1f1dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:08.668 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:08.663+0000 7f52d23a0640 1 -- 172.21.15.92:0/2670353682 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52cc0c7390 con 0x7f52cc15bb60 2024-09-11T00:15:08.668 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:08.663+0000 7f52d1b9f640 1 --2- 172.21.15.92:0/2670353682 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f52cc0cfb10 0x7f52cc1f1dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:15:08.668 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:08.664+0000 7f52d23a0640 1 --2- 172.21.15.92:0/2670353682 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f52cc15bb60 0x7f52cc14ab20 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f52c400d750 tx=0x7f52c400dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:15:08.668 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:08.664+0000 7f52ca7fc640 1 -- 172.21.15.92:0/2670353682 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52c4017070 con 0x7f52cc15bb60 2024-09-11T00:15:08.668 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:08.664+0000 7f52ca7fc640 1 -- 172.21.15.92:0/2670353682 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f52c4009ac0 con 0x7f52cc15bb60 2024-09-11T00:15:08.668 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:08.664+0000 7f52ca7fc640 1 -- 172.21.15.92:0/2670353682 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52c4005020 con 0x7f52cc15bb60 2024-09-11T00:15:08.668 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:08.664+0000 7f52d2ba1640 1 -- 172.21.15.92:0/2670353682 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52cc0b3de0 con 0x7f52cc15bb60 2024-09-11T00:15:08.668 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:08.664+0000 7f52d2ba1640 1 -- 172.21.15.92:0/2670353682 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52cc0b43a0 con 0x7f52cc15bb60 2024-09-11T00:15:08.669 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:08.665+0000 7f52d2ba1640 1 -- 172.21.15.92:0/2670353682 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f52cc15cd40 con 0x7f52cc15bb60 2024-09-11T00:15:08.669 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:08.665+0000 7f52ca7fc640 1 -- 172.21.15.92:0/2670353682 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f52c40051c0 con 0x7f52cc15bb60 2024-09-11T00:15:08.669 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:08.666+0000 7f52ca7fc640 1 --2- 172.21.15.92:0/2670353682 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f52b8077fa0 0x7f52b807a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:08.669 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:08.666+0000 7f52ca7fc640 1 -- 172.21.15.92:0/2670353682 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5249+0+0 (secure 0 0 0) 0x7f52c4099c90 con 0x7f52cc15bb60 2024-09-11T00:15:08.669 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:08.666+0000 7f52d1b9f640 1 --2- 172.21.15.92:0/2670353682 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f52b8077fa0 0x7f52b807a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:08.669 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:08.667+0000 7f52d1b9f640 1 --2- 172.21.15.92:0/2670353682 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f52b8077fa0 0x7f52b807a460 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f52bc004a30 tx=0x7f52bc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:15:08.672 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:08.670+0000 7f52ca7fc640 1 -- 172.21.15.92:0/2670353682 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f52c4062950 con 0x7f52cc15bb60 2024-09-11T00:15:08.846 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:08.845+0000 7f52d2ba1640 1 -- 172.21.15.92:0/2670353682 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f52cc0750a0 con 0x7f52cc15bb60 2024-09-11T00:15:08.847 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:08.845+0000 7f52ca7fc640 1 -- 172.21.15.92:0/2670353682 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v35) ==== 84+0+65 (secure 0 0 0) 0x7f52c406b070 con 0x7f52cc15bb60 2024-09-11T00:15:08.847 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:15:08.847 INFO:teuthology.orchestra.run.smithi092.stdout:[ 2024-09-11T00:15:08.847 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-11T00:15:08.847 INFO:teuthology.orchestra.run.smithi092.stdout: "poolnum": 1, 2024-09-11T00:15:08.847 INFO:teuthology.orchestra.run.smithi092.stdout: "poolname": ".mgr" 2024-09-11T00:15:08.847 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-11T00:15:08.847 INFO:teuthology.orchestra.run.smithi092.stdout:] 2024-09-11T00:15:08.853 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:08.848+0000 7f52d2ba1640 1 -- 172.21.15.92:0/2670353682 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f52b8077fa0 msgr2=0x7f52b807a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:08.853 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:08.848+0000 7f52d2ba1640 1 --2- 172.21.15.92:0/2670353682 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f52b8077fa0 0x7f52b807a460 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f52bc004a30 tx=0x7f52bc009040 comp rx=0 tx=0).stop 2024-09-11T00:15:08.854 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:08.848+0000 7f52d2ba1640 1 -- 172.21.15.92:0/2670353682 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f52cc15bb60 msgr2=0x7f52cc14ab20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:08.854 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:08.848+0000 7f52d2ba1640 1 --2- 172.21.15.92:0/2670353682 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f52cc15bb60 0x7f52cc14ab20 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f52c400d750 tx=0x7f52c400dc10 comp rx=0 tx=0).stop 2024-09-11T00:15:08.854 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:08.848+0000 7f52d2ba1640 1 -- 172.21.15.92:0/2670353682 shutdown_connections 2024-09-11T00:15:08.854 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:08.848+0000 7f52d2ba1640 1 --2- 172.21.15.92:0/2670353682 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f52b8077fa0 0x7f52b807a460 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:08.854 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:08.848+0000 7f52d2ba1640 1 --2- 172.21.15.92:0/2670353682 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f52cc15bb60 0x7f52cc14ab20 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:08.854 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:08.848+0000 7f52d2ba1640 1 --2- 172.21.15.92:0/2670353682 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f52cc0d2520 0x7f52cc0c7b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:08.854 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:08.848+0000 7f52d2ba1640 1 --2- 172.21.15.92:0/2670353682 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f52cc0cfb10 0x7f52cc1f1dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:08.854 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:08.848+0000 7f52d2ba1640 1 -- 172.21.15.92:0/2670353682 >> 172.21.15.92:0/2670353682 conn(0x7f52cc0d1a00 msgr2=0x7f52cc15f240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:15:08.855 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:08.848+0000 7f52d2ba1640 1 -- 172.21.15.92:0/2670353682 shutdown_connections 2024-09-11T00:15:08.855 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:08.848+0000 7f52d2ba1640 1 -- 172.21.15.92:0/2670353682 wait complete. 2024-09-11T00:15:08.861 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-11T00:15:08.861 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-11T00:15:08.968 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:08.966+0000 7f45d2132640 1 -- 172.21.15.92:0/3141756268 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f45cc0b7300 msgr2=0x7f45cc0d24e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:08.968 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:08.966+0000 7f45d2132640 1 --2- 172.21.15.92:0/3141756268 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f45cc0b7300 0x7f45cc0d24e0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f45cc06d2a0 tx=0x7f45b402a560 comp rx=0 tx=0).stop 2024-09-11T00:15:08.968 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:08.966+0000 7f45d2132640 1 -- 172.21.15.92:0/3141756268 shutdown_connections 2024-09-11T00:15:08.969 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:08.966+0000 7f45d2132640 1 --2- 172.21.15.92:0/3141756268 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f45cc0b7300 0x7f45cc0d24e0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:08.969 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:08.966+0000 7f45d2132640 1 --2- 172.21.15.92:0/3141756268 >> v2:172.21.15.145:3300/0 conn(0x7f45cc15e060 0x7f45cc0b6dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:08.969 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:08.966+0000 7f45d2132640 1 -- 172.21.15.92:0/3141756268 >> 172.21.15.92:0/3141756268 conn(0x7f45cc0d3f70 msgr2=0x7f45cc0d4350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:15:08.969 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:08.966+0000 7f45d2132640 1 -- 172.21.15.92:0/3141756268 shutdown_connections 2024-09-11T00:15:08.969 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:08.966+0000 7f45d2132640 1 -- 172.21.15.92:0/3141756268 wait complete. 2024-09-11T00:15:08.969 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:08.967+0000 7f45d2132640 1 Processor -- start 2024-09-11T00:15:08.969 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:08.968+0000 7f45d2132640 1 -- start start 2024-09-11T00:15:08.971 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:08.968+0000 7f45d2132640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f45cc0d4af0 0x7f45cc1f5320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:08.971 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:08.968+0000 7f45d2132640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f45cc15e060 0x7f45cc0cb0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:08.971 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:08.968+0000 7f45d2132640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f45cc0ce090 0x7f45cc0cb630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:08.971 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:08.968+0000 7f45d2132640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f45cc0d2db0 con 0x7f45cc0d4af0 2024-09-11T00:15:08.971 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:08.968+0000 7f45d2132640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f45cc0d2c30 con 0x7f45cc15e060 2024-09-11T00:15:08.971 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:08.968+0000 7f45d2132640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f45cc0d2f30 con 0x7f45cc0ce090 2024-09-11T00:15:08.971 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:08.969+0000 7f45cb7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f45cc0d4af0 0x7f45cc1f5320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:08.972 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:08.969+0000 7f45cb7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f45cc0d4af0 0x7f45cc1f5320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:45826/0 (socket says 172.21.15.92:45826) 2024-09-11T00:15:08.972 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:08.969+0000 7f45cb7fe640 1 -- 172.21.15.92:0/4023502161 learned_addr learned my addr 172.21.15.92:0/4023502161 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-11T00:15:08.972 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:08.969+0000 7f45caffd640 1 --2- 172.21.15.92:0/4023502161 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f45cc15e060 0x7f45cc0cb0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:08.972 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:08.969+0000 7f45cbfff640 1 --2- 172.21.15.92:0/4023502161 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f45cc0ce090 0x7f45cc0cb630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:08.972 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:08.969+0000 7f45cb7fe640 1 -- 172.21.15.92:0/4023502161 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f45cc0ce090 msgr2=0x7f45cc0cb630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:08.972 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:08.969+0000 7f45cb7fe640 1 --2- 172.21.15.92:0/4023502161 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f45cc0ce090 0x7f45cc0cb630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:08.972 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:08.969+0000 7f45cb7fe640 1 -- 172.21.15.92:0/4023502161 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f45cc15e060 msgr2=0x7f45cc0cb0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:08.972 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:08.969+0000 7f45cb7fe640 1 --2- 172.21.15.92:0/4023502161 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f45cc15e060 0x7f45cc0cb0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:08.972 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:08.969+0000 7f45cb7fe640 1 -- 172.21.15.92:0/4023502161 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45cc1f5860 con 0x7f45cc0d4af0 2024-09-11T00:15:08.972 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:08.969+0000 7f45cbfff640 1 --2- 172.21.15.92:0/4023502161 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f45cc0ce090 0x7f45cc0cb630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:15:08.972 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:08.969+0000 7f45cb7fe640 1 --2- 172.21.15.92:0/4023502161 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f45cc0d4af0 0x7f45cc1f5320 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f45bc00d740 tx=0x7f45bc00dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:15:08.972 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:08.969+0000 7f45c3fff640 1 -- 172.21.15.92:0/4023502161 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45bc017070 con 0x7f45cc0d4af0 2024-09-11T00:15:08.972 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:08.969+0000 7f45c3fff640 1 -- 172.21.15.92:0/4023502161 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f45bc009d20 con 0x7f45cc0d4af0 2024-09-11T00:15:08.973 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:08.969+0000 7f45d2132640 1 -- 172.21.15.92:0/4023502161 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45cc146df0 con 0x7f45cc0d4af0 2024-09-11T00:15:08.973 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:08.969+0000 7f45c3fff640 1 -- 172.21.15.92:0/4023502161 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45bc0106c0 con 0x7f45cc0d4af0 2024-09-11T00:15:08.973 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:08.969+0000 7f45d2132640 1 -- 172.21.15.92:0/4023502161 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45cc0cd5b0 con 0x7f45cc0d4af0 2024-09-11T00:15:08.974 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:08.970+0000 7f45d2132640 1 -- 172.21.15.92:0/4023502161 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f45cc0d24e0 con 0x7f45cc0d4af0 2024-09-11T00:15:08.974 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:08.971+0000 7f45c3fff640 1 -- 172.21.15.92:0/4023502161 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f45bc010860 con 0x7f45cc0d4af0 2024-09-11T00:15:08.974 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:08.971+0000 7f45c3fff640 1 --2- 172.21.15.92:0/4023502161 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f45ac077f70 0x7f45ac07a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:08.974 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:08.971+0000 7f45c3fff640 1 -- 172.21.15.92:0/4023502161 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5249+0+0 (secure 0 0 0) 0x7f45bc099f20 con 0x7f45cc0d4af0 2024-09-11T00:15:08.974 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:08.972+0000 7f45caffd640 1 --2- 172.21.15.92:0/4023502161 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f45ac077f70 0x7f45ac07a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:08.974 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:08.972+0000 7f45caffd640 1 --2- 172.21.15.92:0/4023502161 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f45ac077f70 0x7f45ac07a430 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f45b4033000 tx=0x7f45b4004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:15:08.977 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:08.975+0000 7f45c3fff640 1 -- 172.21.15.92:0/4023502161 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f45bc062590 con 0x7f45cc0d4af0 2024-09-11T00:15:09.151 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:09.150+0000 7f45d2132640 1 -- 172.21.15.92:0/4023502161 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f45cc08dfa0 con 0x7f45cc0d4af0 2024-09-11T00:15:09.962 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:09.960+0000 7f45c3fff640 1 -- 172.21.15.92:0/4023502161 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v36) ==== 138+0+0 (secure 0 0 0) 0x7f45bc066fc0 con 0x7f45cc0d4af0 2024-09-11T00:15:09.962 INFO:teuthology.orchestra.run.smithi092.stderr:pool 'cephfs_metadata' created 2024-09-11T00:15:09.967 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:09.965+0000 7f45d2132640 1 -- 172.21.15.92:0/4023502161 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f45ac077f70 msgr2=0x7f45ac07a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:09.967 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:09.965+0000 7f45d2132640 1 --2- 172.21.15.92:0/4023502161 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f45ac077f70 0x7f45ac07a430 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f45b4033000 tx=0x7f45b4004730 comp rx=0 tx=0).stop 2024-09-11T00:15:09.967 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:09.965+0000 7f45d2132640 1 -- 172.21.15.92:0/4023502161 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f45cc0d4af0 msgr2=0x7f45cc1f5320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:09.967 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:09.965+0000 7f45d2132640 1 --2- 172.21.15.92:0/4023502161 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f45cc0d4af0 0x7f45cc1f5320 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f45bc00d740 tx=0x7f45bc00dc00 comp rx=0 tx=0).stop 2024-09-11T00:15:09.967 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:09.965+0000 7f45d2132640 1 -- 172.21.15.92:0/4023502161 shutdown_connections 2024-09-11T00:15:09.968 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:09.965+0000 7f45d2132640 1 --2- 172.21.15.92:0/4023502161 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f45ac077f70 0x7f45ac07a430 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:09.968 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:09.965+0000 7f45d2132640 1 --2- 172.21.15.92:0/4023502161 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f45cc0ce090 0x7f45cc0cb630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:09.968 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:09.965+0000 7f45d2132640 1 --2- 172.21.15.92:0/4023502161 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f45cc15e060 0x7f45cc0cb0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:09.968 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:09.965+0000 7f45d2132640 1 --2- 172.21.15.92:0/4023502161 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f45cc0d4af0 0x7f45cc1f5320 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:09.968 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:09.965+0000 7f45d2132640 1 -- 172.21.15.92:0/4023502161 >> 172.21.15.92:0/4023502161 conn(0x7f45cc0d3f70 msgr2=0x7f45cc0cfb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:15:09.969 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:09.967+0000 7f45d2132640 1 -- 172.21.15.92:0/4023502161 shutdown_connections 2024-09-11T00:15:09.969 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:09.967+0000 7f45d2132640 1 -- 172.21.15.92:0/4023502161 wait complete. 2024-09-11T00:15:09.986 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-11T00:15:10.101 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:10.099+0000 7f683ebc2640 1 -- 172.21.15.92:0/1758076554 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6824004800 msgr2=0x7f6824004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:10.101 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:10.099+0000 7f683ebc2640 1 --2- 172.21.15.92:0/1758076554 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6824004800 0x7f6824004c80 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f6820001690 tx=0x7f6824005830 comp rx=0 tx=0).stop 2024-09-11T00:15:10.101 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:10.099+0000 7f683ebc2640 1 -- 172.21.15.92:0/1758076554 shutdown_connections 2024-09-11T00:15:10.101 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:10.099+0000 7f683ebc2640 1 --2- 172.21.15.92:0/1758076554 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6824004800 0x7f6824004c80 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:10.101 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:10.099+0000 7f683ebc2640 1 -- 172.21.15.92:0/1758076554 >> 172.21.15.92:0/1758076554 conn(0x7f68380d3f70 msgr2=0x7f68380d4350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:15:10.101 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:10.099+0000 7f683ebc2640 1 -- 172.21.15.92:0/1758076554 shutdown_connections 2024-09-11T00:15:10.101 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:10.099+0000 7f683ebc2640 1 -- 172.21.15.92:0/1758076554 wait complete. 2024-09-11T00:15:10.104 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:10.100+0000 7f683ebc2640 1 Processor -- start 2024-09-11T00:15:10.104 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:10.100+0000 7f683ebc2640 1 -- start start 2024-09-11T00:15:10.104 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:10.101+0000 7f683ebc2640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6824004800 0x7f683815e440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:10.104 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:10.101+0000 7f683ebc2640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f683815e980 0x7f68381f3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:10.104 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:10.101+0000 7f683ebc2640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f68381f3ed0 0x7f6838146120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:10.104 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:10.101+0000 7f683ebc2640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f68380d24e0 con 0x7f68381f3ed0 2024-09-11T00:15:10.105 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:10.101+0000 7f683ebc2640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f68380b70b0 con 0x7f683815e980 2024-09-11T00:15:10.105 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:10.101+0000 7f683ebc2640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f68380d2660 con 0x7f6824004800 2024-09-11T00:15:10.105 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:10.101+0000 7f683d15f640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f68381f3ed0 0x7f6838146120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:10.105 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:10.101+0000 7f683d15f640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f68381f3ed0 0x7f6838146120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:45850/0 (socket says 172.21.15.92:45850) 2024-09-11T00:15:10.105 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:10.101+0000 7f683d15f640 1 -- 172.21.15.92:0/1539842816 learned_addr learned my addr 172.21.15.92:0/1539842816 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-11T00:15:10.105 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:10.101+0000 7f6837fff640 1 --2- 172.21.15.92:0/1539842816 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f683815e980 0x7f68381f3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:10.105 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:10.101+0000 7f683d15f640 1 -- 172.21.15.92:0/1539842816 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6824004800 msgr2=0x7f683815e440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:10.105 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:10.101+0000 7f683d15f640 1 --2- 172.21.15.92:0/1539842816 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6824004800 0x7f683815e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:10.105 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:10.101+0000 7f683d15f640 1 -- 172.21.15.92:0/1539842816 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f683815e980 msgr2=0x7f68381f3990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:10.106 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:10.101+0000 7f683d15f640 1 --2- 172.21.15.92:0/1539842816 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f683815e980 0x7f68381f3990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:10.106 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:10.101+0000 7f683d15f640 1 -- 172.21.15.92:0/1539842816 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6838160aa0 con 0x7f68381f3ed0 2024-09-11T00:15:10.106 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:10.101+0000 7f683d15f640 1 --2- 172.21.15.92:0/1539842816 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f68381f3ed0 0x7f6838146120 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f6830001eb0 tx=0x7f683000e7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:15:10.106 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:10.101+0000 7f68357fa640 1 -- 172.21.15.92:0/1539842816 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6830011930 con 0x7f68381f3ed0 2024-09-11T00:15:10.106 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:10.101+0000 7f68357fa640 1 -- 172.21.15.92:0/1539842816 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6830016070 con 0x7f68381f3ed0 2024-09-11T00:15:10.106 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:10.101+0000 7f683ebc2640 1 -- 172.21.15.92:0/1539842816 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6838160d80 con 0x7f68381f3ed0 2024-09-11T00:15:10.106 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:10.101+0000 7f68357fa640 1 -- 172.21.15.92:0/1539842816 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6830011e60 con 0x7f68381f3ed0 2024-09-11T00:15:10.106 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:10.102+0000 7f683ebc2640 1 -- 172.21.15.92:0/1539842816 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6838161340 con 0x7f68381f3ed0 2024-09-11T00:15:10.106 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:10.102+0000 7f683ebc2640 1 -- 172.21.15.92:0/1539842816 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f68380d2b50 con 0x7f68381f3ed0 2024-09-11T00:15:10.107 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:10.103+0000 7f68357fa640 1 -- 172.21.15.92:0/1539842816 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f683001b460 con 0x7f68381f3ed0 2024-09-11T00:15:10.107 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:10.104+0000 7f68357fa640 1 --2- 172.21.15.92:0/1539842816 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f6818077fa0 0x7f681807a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:10.107 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:10.104+0000 7f68357fa640 1 -- 172.21.15.92:0/1539842816 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 5619+0+0 (secure 0 0 0) 0x7f683009ab50 con 0x7f68381f3ed0 2024-09-11T00:15:10.107 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:10.104+0000 7f683c95e640 1 --2- 172.21.15.92:0/1539842816 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f6818077fa0 0x7f681807a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:10.107 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:10.105+0000 7f683c95e640 1 --2- 172.21.15.92:0/1539842816 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f6818077fa0 0x7f681807a460 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f6838052150 tx=0x7f6828003970 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:15:10.109 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:10.107+0000 7f68357fa640 1 -- 172.21.15.92:0/1539842816 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f6830063780 con 0x7f68381f3ed0 2024-09-11T00:15:10.285 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:10.283+0000 7f683ebc2640 1 -- 172.21.15.92:0/1539842816 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f683815ed60 con 0x7f68381f3ed0 2024-09-11T00:15:10.968 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:10.966+0000 7f68357fa640 1 -- 172.21.15.92:0/1539842816 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v37) ==== 170+0+0 (secure 0 0 0) 0x7f6830063080 con 0x7f68381f3ed0 2024-09-11T00:15:10.968 INFO:teuthology.orchestra.run.smithi092.stderr:pool 'cephfs_data' created 2024-09-11T00:15:10.971 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:10.970+0000 7f683ebc2640 1 -- 172.21.15.92:0/1539842816 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f6818077fa0 msgr2=0x7f681807a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:10.971 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:10.970+0000 7f683ebc2640 1 --2- 172.21.15.92:0/1539842816 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f6818077fa0 0x7f681807a460 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f6838052150 tx=0x7f6828003970 comp rx=0 tx=0).stop 2024-09-11T00:15:10.971 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:10.970+0000 7f683ebc2640 1 -- 172.21.15.92:0/1539842816 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f68381f3ed0 msgr2=0x7f6838146120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:10.971 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:10.970+0000 7f683ebc2640 1 --2- 172.21.15.92:0/1539842816 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f68381f3ed0 0x7f6838146120 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f6830001eb0 tx=0x7f683000e7f0 comp rx=0 tx=0).stop 2024-09-11T00:15:10.973 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:10.971+0000 7f683ebc2640 1 -- 172.21.15.92:0/1539842816 shutdown_connections 2024-09-11T00:15:10.973 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:10.971+0000 7f683ebc2640 1 --2- 172.21.15.92:0/1539842816 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f6818077fa0 0x7f681807a460 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:10.973 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:10.971+0000 7f683ebc2640 1 --2- 172.21.15.92:0/1539842816 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f68381f3ed0 0x7f6838146120 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:10.973 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:10.971+0000 7f683ebc2640 1 --2- 172.21.15.92:0/1539842816 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f683815e980 0x7f68381f3990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:10.973 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:10.971+0000 7f683ebc2640 1 --2- 172.21.15.92:0/1539842816 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6824004800 0x7f683815e440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:10.973 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:10.971+0000 7f683ebc2640 1 -- 172.21.15.92:0/1539842816 >> 172.21.15.92:0/1539842816 conn(0x7f68380d3f70 msgr2=0x7f68380b76f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:15:10.974 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:10.972+0000 7f683ebc2640 1 -- 172.21.15.92:0/1539842816 shutdown_connections 2024-09-11T00:15:10.975 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:10.973+0000 7f683ebc2640 1 -- 172.21.15.92:0/1539842816 wait complete. 2024-09-11T00:15:10.999 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-11T00:15:11.107 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:11.105+0000 7f923b42a640 1 -- 172.21.15.92:0/2966682563 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9220003a50 msgr2=0x7f9220003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:11.107 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:11.105+0000 7f923b42a640 1 --2- 172.21.15.92:0/2966682563 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9220003a50 0x7f9220003e70 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f92300016c0 tx=0x7f9220005830 comp rx=0 tx=0).stop 2024-09-11T00:15:11.108 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:11.105+0000 7f923b42a640 1 -- 172.21.15.92:0/2966682563 shutdown_connections 2024-09-11T00:15:11.108 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:11.105+0000 7f923b42a640 1 --2- 172.21.15.92:0/2966682563 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9220003a50 0x7f9220003e70 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:11.108 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:11.105+0000 7f923b42a640 1 -- 172.21.15.92:0/2966682563 >> 172.21.15.92:0/2966682563 conn(0x7f92340d0c00 msgr2=0x7f92340d0fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:15:11.108 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:11.105+0000 7f923b42a640 1 -- 172.21.15.92:0/2966682563 shutdown_connections 2024-09-11T00:15:11.108 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:11.105+0000 7f923b42a640 1 -- 172.21.15.92:0/2966682563 wait complete. 2024-09-11T00:15:11.112 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:11.106+0000 7f923b42a640 1 Processor -- start 2024-09-11T00:15:11.113 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:11.106+0000 7f923b42a640 1 -- start start 2024-09-11T00:15:11.113 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:11.107+0000 7f923b42a640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9220003a50 0x7f9234141500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:11.113 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:11.107+0000 7f923b42a640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9234147470 0x7f9234159bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:11.113 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:11.107+0000 7f923b42a640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9234071960 0x7f923415a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:11.113 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:11.107+0000 7f923b42a640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f923415ec30 con 0x7f9234071960 2024-09-11T00:15:11.113 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:11.107+0000 7f923b42a640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f923415eab0 con 0x7f9220003a50 2024-09-11T00:15:11.113 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:11.107+0000 7f923b42a640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f923415edb0 con 0x7f9234147470 2024-09-11T00:15:11.113 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:11.107+0000 7f92399c7640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9234071960 0x7f923415a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:11.114 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:11.107+0000 7f92399c7640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9234071960 0x7f923415a0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:45866/0 (socket says 172.21.15.92:45866) 2024-09-11T00:15:11.114 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:11.107+0000 7f92399c7640 1 -- 172.21.15.92:0/1190443428 learned_addr learned my addr 172.21.15.92:0/1190443428 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-11T00:15:11.114 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:11.107+0000 7f92391c6640 1 --2- 172.21.15.92:0/1190443428 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9220003a50 0x7f9234141500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:11.114 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:11.107+0000 7f92389c5640 1 --2- 172.21.15.92:0/1190443428 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9234147470 0x7f9234159bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:11.114 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:11.108+0000 7f92399c7640 1 -- 172.21.15.92:0/1190443428 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9234147470 msgr2=0x7f9234159bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:11.114 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:11.108+0000 7f92399c7640 1 --2- 172.21.15.92:0/1190443428 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9234147470 0x7f9234159bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:11.114 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:11.108+0000 7f92399c7640 1 -- 172.21.15.92:0/1190443428 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9220003a50 msgr2=0x7f9234141500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:11.114 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:11.108+0000 7f92399c7640 1 --2- 172.21.15.92:0/1190443428 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9220003a50 0x7f9234141500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:11.114 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:11.108+0000 7f92399c7640 1 -- 172.21.15.92:0/1190443428 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9234141a40 con 0x7f9234071960 2024-09-11T00:15:11.115 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:11.108+0000 7f92389c5640 1 --2- 172.21.15.92:0/1190443428 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9234147470 0x7f9234159bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:15:11.115 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:11.108+0000 7f92399c7640 1 --2- 172.21.15.92:0/1190443428 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9234071960 0x7f923415a0f0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f922c005fd0 tx=0x7f922c00f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:15:11.115 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:11.108+0000 7f9229ffb640 1 -- 172.21.15.92:0/1190443428 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f922c003d80 con 0x7f9234071960 2024-09-11T00:15:11.115 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:11.108+0000 7f9229ffb640 1 -- 172.21.15.92:0/1190443428 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f922c004b20 con 0x7f9234071960 2024-09-11T00:15:11.115 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:11.108+0000 7f923b42a640 1 -- 172.21.15.92:0/1190443428 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92341f8420 con 0x7f9234071960 2024-09-11T00:15:11.115 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:11.108+0000 7f9229ffb640 1 -- 172.21.15.92:0/1190443428 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f922c004050 con 0x7f9234071960 2024-09-11T00:15:11.115 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:11.108+0000 7f923b42a640 1 -- 172.21.15.92:0/1190443428 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92341f89e0 con 0x7f9234071960 2024-09-11T00:15:11.115 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:11.109+0000 7f923b42a640 1 -- 172.21.15.92:0/1190443428 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f923415b250 con 0x7f9234071960 2024-09-11T00:15:11.116 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:11.109+0000 7f9229ffb640 1 -- 172.21.15.92:0/1190443428 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f922c022070 con 0x7f9234071960 2024-09-11T00:15:11.116 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:11.110+0000 7f9229ffb640 1 --2- 172.21.15.92:0/1190443428 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f9218077f70 0x7f921807a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:11.116 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:11.110+0000 7f9229ffb640 1 -- 172.21.15.92:0/1190443428 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6001+0+0 (secure 0 0 0) 0x7f922c09aeb0 con 0x7f9234071960 2024-09-11T00:15:11.116 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:11.110+0000 7f92391c6640 1 --2- 172.21.15.92:0/1190443428 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f9218077f70 0x7f921807a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:11.116 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:11.111+0000 7f92391c6640 1 --2- 172.21.15.92:0/1190443428 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f9218077f70 0x7f921807a430 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f9230032000 tx=0x7f923002c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:15:11.117 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:11.114+0000 7f9229ffb640 1 -- 172.21.15.92:0/1190443428 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f922c01f060 con 0x7f9234071960 2024-09-11T00:15:11.325 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:11.324+0000 7f923b42a640 1 -- 172.21.15.92:0/1190443428 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f92340d1b10 con 0x7f9234071960 2024-09-11T00:15:11.970 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:11.968+0000 7f9229ffb640 1 -- 172.21.15.92:0/1190443428 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 5 and data pool 6 v13) ==== 172+0+0 (secure 0 0 0) 0x7f922c063880 con 0x7f9234071960 2024-09-11T00:15:11.970 INFO:teuthology.orchestra.run.smithi092.stderr:new fs with metadata pool 5 and data pool 6 2024-09-11T00:15:11.974 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:11.972+0000 7f923b42a640 1 -- 172.21.15.92:0/1190443428 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f9218077f70 msgr2=0x7f921807a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:11.974 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:11.972+0000 7f923b42a640 1 --2- 172.21.15.92:0/1190443428 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f9218077f70 0x7f921807a430 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f9230032000 tx=0x7f923002c040 comp rx=0 tx=0).stop 2024-09-11T00:15:11.974 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:11.972+0000 7f923b42a640 1 -- 172.21.15.92:0/1190443428 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9234071960 msgr2=0x7f923415a0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:11.975 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:11.972+0000 7f923b42a640 1 --2- 172.21.15.92:0/1190443428 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9234071960 0x7f923415a0f0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f922c005fd0 tx=0x7f922c00f790 comp rx=0 tx=0).stop 2024-09-11T00:15:11.975 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:11.972+0000 7f923b42a640 1 -- 172.21.15.92:0/1190443428 shutdown_connections 2024-09-11T00:15:11.975 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:11.972+0000 7f923b42a640 1 --2- 172.21.15.92:0/1190443428 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f9218077f70 0x7f921807a430 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:11.975 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:11.972+0000 7f923b42a640 1 --2- 172.21.15.92:0/1190443428 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9234071960 0x7f923415a0f0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:11.975 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:11.972+0000 7f923b42a640 1 --2- 172.21.15.92:0/1190443428 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9234147470 0x7f9234159bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:11.975 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:11.972+0000 7f923b42a640 1 --2- 172.21.15.92:0/1190443428 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9220003a50 0x7f9234141500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:11.975 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:11.972+0000 7f923b42a640 1 -- 172.21.15.92:0/1190443428 >> 172.21.15.92:0/1190443428 conn(0x7f92340d0c00 msgr2=0x7f9234070000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:15:11.975 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:11.973+0000 7f923b42a640 1 -- 172.21.15.92:0/1190443428 shutdown_connections 2024-09-11T00:15:11.975 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:11.973+0000 7f923b42a640 1 -- 172.21.15.92:0/1190443428 wait complete. 2024-09-11T00:15:12.001 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T00:15:12.104 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:12.103+0000 7f7881b53640 1 -- 172.21.15.92:0/1551928857 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f787c06e2e0 msgr2=0x7f787c15e530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:12.105 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:12.103+0000 7f7881b53640 1 --2- 172.21.15.92:0/1551928857 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f787c06e2e0 0x7f787c15e530 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f7870009830 tx=0x7f787002a510 comp rx=0 tx=0).stop 2024-09-11T00:15:12.105 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:12.103+0000 7f7881b53640 1 -- 172.21.15.92:0/1551928857 shutdown_connections 2024-09-11T00:15:12.105 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:12.103+0000 7f7881b53640 1 --2- 172.21.15.92:0/1551928857 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f787c0cf110 0x7f787c0b47b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:12.105 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:12.103+0000 7f7881b53640 1 --2- 172.21.15.92:0/1551928857 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f787c06e2e0 0x7f787c15e530 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:12.105 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:12.103+0000 7f7881b53640 1 -- 172.21.15.92:0/1551928857 >> 172.21.15.92:0/1551928857 conn(0x7f787c0b1760 msgr2=0x7f787c0b1b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:15:12.105 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:12.103+0000 7f7881b53640 1 -- 172.21.15.92:0/1551928857 shutdown_connections 2024-09-11T00:15:12.105 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:12.103+0000 7f7881b53640 1 -- 172.21.15.92:0/1551928857 wait complete. 2024-09-11T00:15:12.108 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:12.104+0000 7f7881b53640 1 Processor -- start 2024-09-11T00:15:12.109 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:12.104+0000 7f7881b53640 1 -- start start 2024-09-11T00:15:12.109 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:12.105+0000 7f7881b53640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f787c06e2e0 0x7f787c1f6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:12.109 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:12.105+0000 7f7881b53640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f787c0cf110 0x7f787c15bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:12.109 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:12.105+0000 7f7881b53640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f787c15e150 0x7f787c15c110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:12.109 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:12.105+0000 7f7881b53640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f787c0b3470 con 0x7f787c06e2e0 2024-09-11T00:15:12.109 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:12.105+0000 7f7881b53640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f787c0729d0 con 0x7f787c0cf110 2024-09-11T00:15:12.110 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:12.105+0000 7f7881b53640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f787c0b35f0 con 0x7f787c15e150 2024-09-11T00:15:12.110 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:12.105+0000 7f787b7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f787c06e2e0 0x7f787c1f6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:12.110 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:12.105+0000 7f787b7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f787c06e2e0 0x7f787c1f6100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:45880/0 (socket says 172.21.15.92:45880) 2024-09-11T00:15:12.110 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:12.105+0000 7f787b7fe640 1 -- 172.21.15.92:0/806727775 learned_addr learned my addr 172.21.15.92:0/806727775 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-11T00:15:12.110 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:12.105+0000 7f787affd640 1 --2- 172.21.15.92:0/806727775 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f787c0cf110 0x7f787c15bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:12.110 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:12.105+0000 7f787b7fe640 1 -- 172.21.15.92:0/806727775 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f787c15e150 msgr2=0x7f787c15c110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:12.110 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:12.105+0000 7f787b7fe640 1 --2- 172.21.15.92:0/806727775 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f787c15e150 0x7f787c15c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:12.110 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:12.105+0000 7f787b7fe640 1 -- 172.21.15.92:0/806727775 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f787c0cf110 msgr2=0x7f787c15bbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:12.110 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:12.105+0000 7f787b7fe640 1 --2- 172.21.15.92:0/806727775 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f787c0cf110 0x7f787c15bbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:12.110 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:12.105+0000 7f787b7fe640 1 -- 172.21.15.92:0/806727775 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f787c1e4a10 con 0x7f787c06e2e0 2024-09-11T00:15:12.110 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:12.105+0000 7f787affd640 1 --2- 172.21.15.92:0/806727775 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f787c0cf110 0x7f787c15bbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:15:12.110 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:12.105+0000 7f787b7fe640 1 --2- 172.21.15.92:0/806727775 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f787c06e2e0 0x7f787c1f6100 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f786c00c3c0 tx=0x7f786c00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:15:12.111 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:12.105+0000 7f7863fff640 1 -- 172.21.15.92:0/806727775 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f786c017070 con 0x7f787c06e2e0 2024-09-11T00:15:12.111 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:12.105+0000 7f7863fff640 1 -- 172.21.15.92:0/806727775 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f786c0035f0 con 0x7f787c06e2e0 2024-09-11T00:15:12.111 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:12.105+0000 7f7881b53640 1 -- 172.21.15.92:0/806727775 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f787c1e4cf0 con 0x7f787c06e2e0 2024-09-11T00:15:12.111 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:12.105+0000 7f7863fff640 1 -- 172.21.15.92:0/806727775 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f786c003a80 con 0x7f787c06e2e0 2024-09-11T00:15:12.111 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:12.105+0000 7f7881b53640 1 -- 172.21.15.92:0/806727775 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f787c1e5590 con 0x7f787c06e2e0 2024-09-11T00:15:12.111 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:12.106+0000 7f7881b53640 1 -- 172.21.15.92:0/806727775 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f787c15e530 con 0x7f787c06e2e0 2024-09-11T00:15:12.112 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:12.107+0000 7f7863fff640 1 -- 172.21.15.92:0/806727775 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f786c003c20 con 0x7f787c06e2e0 2024-09-11T00:15:12.112 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:12.107+0000 7f7863fff640 1 --2- 172.21.15.92:0/806727775 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f7868077f70 0x7f786807a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:12.112 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:12.107+0000 7f7863fff640 1 -- 172.21.15.92:0/806727775 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 6101+0+0 (secure 0 0 0) 0x7f786c099410 con 0x7f787c06e2e0 2024-09-11T00:15:12.112 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:12.108+0000 7f787affd640 1 --2- 172.21.15.92:0/806727775 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f7868077f70 0x7f786807a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:12.112 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:12.108+0000 7f787affd640 1 --2- 172.21.15.92:0/806727775 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f7868077f70 0x7f786807a430 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f7870034000 tx=0x7f7870004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:15:12.113 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:12.112+0000 7f7863fff640 1 -- 172.21.15.92:0/806727775 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f787c073ef0 con 0x7f787c06e2e0 2024-09-11T00:15:12.288 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:12.287+0000 7f7881b53640 1 -- 172.21.15.92:0/806727775 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f787c1e4ec0 con 0x7f787c06e2e0 2024-09-11T00:15:12.289 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:12.288+0000 7f7863fff640 1 -- 172.21.15.92:0/806727775 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) ==== 74+0+17039 (secure 0 0 0) 0x7f786c061e10 con 0x7f787c06e2e0 2024-09-11T00:15:12.289 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:15:12.290 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":38,"fsid":"47039cb3-5d2a-46bf-9066-8055b5dfc583","created":"2024-09-11T00:13:53.889939+0000","modified":"2024-09-11T00:15:11.325355+0000","last_up_change":"2024-09-11T00:14:06.563107+0000","last_in_change":"2024-09-11T00:13:56.982537+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T00:14:06.287223+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-09-11T00:15:09.154216+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-09-11T00:15:10.288017+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"538af0ea-96c9-4999-9ccc-bee55f80ff76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":2860560077},{"type":"v1","addr":"172.21.15.92:6801","nonce":2860560077}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":2860560077},{"type":"v1","addr":"172.21.15.92:6803","nonce":2860560077}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":2860560077},{"type":"v1","addr":"172.21.15.92:6807","nonce":2860560077}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":2860560077},{"type":"v1","addr":"172.21.15.92:6805","nonce":2860560077}]},"public_addr":"172.21.15.92:6801/2860560077","cluster_addr":"172.21.15.92:6803/2860560077","heartbeat_back_addr":"172.21.15.92:6807/2860560077","heartbeat_front_addr":"172.21.15.92:6805/2860560077","state":["exists","up"]},{"osd":1,"uuid":"f9214f2c-ffe6-4447-9a13-9549a36e0537","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":2600417443},{"type":"v1","addr":"172.21.15.92:6817","nonce":2600417443}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6818","nonce":2600417443},{"type":"v1","addr":"172.21.15.92:6819","nonce":2600417443}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6822","nonce":2600417443},{"type":"v1","addr":"172.21.15.92:6823","nonce":2600417443}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":2600417443},{"type":"v1","addr":"172.21.15.92:6821","nonce":2600417443}]},"public_addr":"172.21.15.92:6817/2600417443","cluster_addr":"172.21.15.92:6819/2600417443","heartbeat_back_addr":"172.21.15.92:6823/2600417443","heartbeat_front_addr":"172.21.15.92:6821/2600417443","state":["exists","up"]},{"osd":2,"uuid":"b44dd849-fb85-42b1-8a1a-b6681bb1f467","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":3143892898},{"type":"v1","addr":"172.21.15.92:6809","nonce":3143892898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":3143892898},{"type":"v1","addr":"172.21.15.92:6811","nonce":3143892898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":3143892898},{"type":"v1","addr":"172.21.15.92:6815","nonce":3143892898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":3143892898},{"type":"v1","addr":"172.21.15.92:6813","nonce":3143892898}]},"public_addr":"172.21.15.92:6809/3143892898","cluster_addr":"172.21.15.92:6811/3143892898","heartbeat_back_addr":"172.21.15.92:6815/3143892898","heartbeat_front_addr":"172.21.15.92:6813/3143892898","state":["exists","up"]},{"osd":3,"uuid":"05a49d87-23b9-48dd-962c-d5c2686e7a32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":3913961488},{"type":"v1","addr":"172.21.15.92:6825","nonce":3913961488}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6826","nonce":3913961488},{"type":"v1","addr":"172.21.15.92:6827","nonce":3913961488}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":3913961488},{"type":"v1","addr":"172.21.15.92:6831","nonce":3913961488}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":3913961488},{"type":"v1","addr":"172.21.15.92:6829","nonce":3913961488}]},"public_addr":"172.21.15.92:6825/3913961488","cluster_addr":"172.21.15.92:6827/3913961488","heartbeat_back_addr":"172.21.15.92:6831/3913961488","heartbeat_front_addr":"172.21.15.92:6829/3913961488","state":["exists","up"]},{"osd":4,"uuid":"cf52b087-afe0-4f43-a4e7-db2ebc158815","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6826","nonce":2206798907},{"type":"v1","addr":"172.21.15.145:6827","nonce":2206798907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6828","nonce":2206798907},{"type":"v1","addr":"172.21.15.145:6829","nonce":2206798907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6832","nonce":2206798907},{"type":"v1","addr":"172.21.15.145:6833","nonce":2206798907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6830","nonce":2206798907},{"type":"v1","addr":"172.21.15.145:6831","nonce":2206798907}]},"public_addr":"172.21.15.145:6827/2206798907","cluster_addr":"172.21.15.145:6829/2206798907","heartbeat_back_addr":"172.21.15.145:6833/2206798907","heartbeat_front_addr":"172.21.15.145:6831/2206798907","state":["exists","up"]},{"osd":5,"uuid":"0e54adcd-2d1d-49fb-bf97-3dd7e9addd30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6810","nonce":2599548493},{"type":"v1","addr":"172.21.15.145:6811","nonce":2599548493}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6812","nonce":2599548493},{"type":"v1","addr":"172.21.15.145:6813","nonce":2599548493}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6816","nonce":2599548493},{"type":"v1","addr":"172.21.15.145:6817","nonce":2599548493}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6814","nonce":2599548493},{"type":"v1","addr":"172.21.15.145:6815","nonce":2599548493}]},"public_addr":"172.21.15.145:6811/2599548493","cluster_addr":"172.21.15.145:6813/2599548493","heartbeat_back_addr":"172.21.15.145:6817/2599548493","heartbeat_front_addr":"172.21.15.145:6815/2599548493","state":["exists","up"]},{"osd":6,"uuid":"4d5ae7a8-b3df-4c7a-9124-290f239f5b57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6802","nonce":4192380792},{"type":"v1","addr":"172.21.15.145:6803","nonce":4192380792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6804","nonce":4192380792},{"type":"v1","addr":"172.21.15.145:6805","nonce":4192380792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6808","nonce":4192380792},{"type":"v1","addr":"172.21.15.145:6809","nonce":4192380792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6806","nonce":4192380792},{"type":"v1","addr":"172.21.15.145:6807","nonce":4192380792}]},"public_addr":"172.21.15.145:6803/4192380792","cluster_addr":"172.21.15.145:6805/4192380792","heartbeat_back_addr":"172.21.15.145:6809/4192380792","heartbeat_front_addr":"172.21.15.145:6807/4192380792","state":["exists","up"]},{"osd":7,"uuid":"d7e36444-6e3f-4372-81d3-88e7b4e993f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6818","nonce":3010598400},{"type":"v1","addr":"172.21.15.145:6819","nonce":3010598400}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6820","nonce":3010598400},{"type":"v1","addr":"172.21.15.145:6821","nonce":3010598400}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6824","nonce":3010598400},{"type":"v1","addr":"172.21.15.145:6825","nonce":3010598400}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6822","nonce":3010598400},{"type":"v1","addr":"172.21.15.145:6823","nonce":3010598400}]},"public_addr":"172.21.15.145:6819/3010598400","cluster_addr":"172.21.15.145:6821/3010598400","heartbeat_back_addr":"172.21.15.145:6825/3010598400","heartbeat_front_addr":"172.21.15.145:6823/3010598400","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:14:03.281892+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:14:04.039021+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:14:03.045775+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:14:03.708856+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:14:04.425520+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:14:03.839369+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:14:03.029834+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:14:03.707529+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T00:15:12.291 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:12.290+0000 7f7881b53640 1 -- 172.21.15.92:0/806727775 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f7868077f70 msgr2=0x7f786807a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:12.292 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:12.290+0000 7f7881b53640 1 --2- 172.21.15.92:0/806727775 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f7868077f70 0x7f786807a430 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f7870034000 tx=0x7f7870004730 comp rx=0 tx=0).stop 2024-09-11T00:15:12.292 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:12.290+0000 7f7881b53640 1 -- 172.21.15.92:0/806727775 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f787c06e2e0 msgr2=0x7f787c1f6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:12.292 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:12.290+0000 7f7881b53640 1 --2- 172.21.15.92:0/806727775 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f787c06e2e0 0x7f787c1f6100 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f786c00c3c0 tx=0x7f786c00c880 comp rx=0 tx=0).stop 2024-09-11T00:15:12.292 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:12.290+0000 7f7881b53640 1 -- 172.21.15.92:0/806727775 shutdown_connections 2024-09-11T00:15:12.292 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:12.290+0000 7f7881b53640 1 --2- 172.21.15.92:0/806727775 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f7868077f70 0x7f786807a430 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:12.292 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:12.290+0000 7f7881b53640 1 --2- 172.21.15.92:0/806727775 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f787c15e150 0x7f787c15c110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:12.292 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:12.290+0000 7f7881b53640 1 --2- 172.21.15.92:0/806727775 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f787c0cf110 0x7f787c15bbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:12.293 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:12.290+0000 7f7881b53640 1 --2- 172.21.15.92:0/806727775 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f787c06e2e0 0x7f787c1f6100 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:12.293 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:12.290+0000 7f7881b53640 1 -- 172.21.15.92:0/806727775 >> 172.21.15.92:0/806727775 conn(0x7f787c0b1760 msgr2=0x7f787c0b3a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:15:12.293 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:12.290+0000 7f7881b53640 1 -- 172.21.15.92:0/806727775 shutdown_connections 2024-09-11T00:15:12.293 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:12.290+0000 7f7881b53640 1 -- 172.21.15.92:0/806727775 wait complete. 2024-09-11T00:15:12.303 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T00:15:12.404 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:12.402+0000 7fe831dd3640 1 -- 172.21.15.92:0/316829936 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe82c06f140 msgr2=0x7fe82c06f5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:12.404 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:12.402+0000 7fe831dd3640 1 --2- 172.21.15.92:0/316829936 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe82c06f140 0x7fe82c06f5f0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fe824005fd0 tx=0x7fe82402a8a0 comp rx=0 tx=0).stop 2024-09-11T00:15:12.404 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:12.402+0000 7fe831dd3640 1 -- 172.21.15.92:0/316829936 shutdown_connections 2024-09-11T00:15:12.404 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:12.402+0000 7fe831dd3640 1 --2- 172.21.15.92:0/316829936 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe82c06f140 0x7fe82c06f5f0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:12.404 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:12.402+0000 7fe831dd3640 1 --2- 172.21.15.92:0/316829936 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe82c073780 0x7fe82c073b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:12.404 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:12.402+0000 7fe831dd3640 1 -- 172.21.15.92:0/316829936 >> 172.21.15.92:0/316829936 conn(0x7fe82c0b1760 msgr2=0x7fe82c0b1b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:15:12.404 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:12.402+0000 7fe831dd3640 1 -- 172.21.15.92:0/316829936 shutdown_connections 2024-09-11T00:15:12.404 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:12.402+0000 7fe831dd3640 1 -- 172.21.15.92:0/316829936 wait complete. 2024-09-11T00:15:12.408 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:12.403+0000 7fe831dd3640 1 Processor -- start 2024-09-11T00:15:12.409 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:12.403+0000 7fe831dd3640 1 -- start start 2024-09-11T00:15:12.409 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:12.404+0000 7fe831dd3640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe82c06f140 0x7fe82c15b660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:12.409 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:12.404+0000 7fe831dd3640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe82c073780 0x7fe82c1f5cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:12.409 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:12.404+0000 7fe831dd3640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe82c15c470 0x7fe82c1f6210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:12.409 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:12.404+0000 7fe831dd3640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fe82c06fcb0 con 0x7fe82c06f140 2024-09-11T00:15:12.410 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:12.404+0000 7fe831dd3640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fe82c06fb30 con 0x7fe82c073780 2024-09-11T00:15:12.410 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:12.404+0000 7fe831dd3640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7fe82c06fe30 con 0x7fe82c15c470 2024-09-11T00:15:12.410 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:12.404+0000 7fe82b7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe82c06f140 0x7fe82c15b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:12.410 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:12.404+0000 7fe82b7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe82c06f140 0x7fe82c15b660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:45908/0 (socket says 172.21.15.92:45908) 2024-09-11T00:15:12.410 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:12.404+0000 7fe82b7fe640 1 -- 172.21.15.92:0/1431641245 learned_addr learned my addr 172.21.15.92:0/1431641245 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-11T00:15:12.410 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:12.404+0000 7fe82bfff640 1 --2- 172.21.15.92:0/1431641245 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe82c15c470 0x7fe82c1f6210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:12.410 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:12.404+0000 7fe822ffd640 1 --2- 172.21.15.92:0/1431641245 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe82c073780 0x7fe82c1f5cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:12.410 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:12.404+0000 7fe82b7fe640 1 -- 172.21.15.92:0/1431641245 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe82c15c470 msgr2=0x7fe82c1f6210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:12.410 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:12.404+0000 7fe82b7fe640 1 --2- 172.21.15.92:0/1431641245 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe82c15c470 0x7fe82c1f6210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:12.411 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:12.404+0000 7fe82b7fe640 1 -- 172.21.15.92:0/1431641245 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe82c073780 msgr2=0x7fe82c1f5cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:12.411 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:12.404+0000 7fe82b7fe640 1 --2- 172.21.15.92:0/1431641245 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe82c073780 0x7fe82c1f5cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:12.411 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:12.404+0000 7fe82b7fe640 1 -- 172.21.15.92:0/1431641245 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe82c144fb0 con 0x7fe82c06f140 2024-09-11T00:15:12.411 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:12.404+0000 7fe82bfff640 1 --2- 172.21.15.92:0/1431641245 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe82c15c470 0x7fe82c1f6210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:15:12.411 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:12.404+0000 7fe822ffd640 1 --2- 172.21.15.92:0/1431641245 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe82c073780 0x7fe82c1f5cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:15:12.411 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:12.404+0000 7fe82b7fe640 1 --2- 172.21.15.92:0/1431641245 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe82c06f140 0x7fe82c15b660 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fe81c00c890 tx=0x7fe81c00cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:15:12.411 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:12.404+0000 7fe828ff9640 1 -- 172.21.15.92:0/1431641245 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe81c004220 con 0x7fe82c06f140 2024-09-11T00:15:12.412 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:12.404+0000 7fe828ff9640 1 -- 172.21.15.92:0/1431641245 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe81c0079b0 con 0x7fe82c06f140 2024-09-11T00:15:12.412 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:12.404+0000 7fe831dd3640 1 -- 172.21.15.92:0/1431641245 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe82c1f3a40 con 0x7fe82c06f140 2024-09-11T00:15:12.412 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:12.404+0000 7fe828ff9640 1 -- 172.21.15.92:0/1431641245 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe81c007dc0 con 0x7fe82c06f140 2024-09-11T00:15:12.412 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:12.405+0000 7fe831dd3640 1 -- 172.21.15.92:0/1431641245 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe82c1f4000 con 0x7fe82c06f140 2024-09-11T00:15:12.412 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:12.406+0000 7fe831dd3640 1 -- 172.21.15.92:0/1431641245 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe82c06f5f0 con 0x7fe82c06f140 2024-09-11T00:15:12.412 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:12.406+0000 7fe828ff9640 1 -- 172.21.15.92:0/1431641245 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fe81c020060 con 0x7fe82c06f140 2024-09-11T00:15:12.412 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:12.407+0000 7fe828ff9640 1 --2- 172.21.15.92:0/1431641245 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7fe80c077f70 0x7fe80c07a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:12.412 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:12.407+0000 7fe828ff9640 1 -- 172.21.15.92:0/1431641245 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 6101+0+0 (secure 0 0 0) 0x7fe81c099d70 con 0x7fe82c06f140 2024-09-11T00:15:12.412 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:12.407+0000 7fe822ffd640 1 --2- 172.21.15.92:0/1431641245 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7fe80c077f70 0x7fe80c07a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:12.413 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:12.407+0000 7fe822ffd640 1 --2- 172.21.15.92:0/1431641245 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7fe80c077f70 0x7fe80c07a430 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fe82c15c110 tx=0x7fe814009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:15:12.413 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:12.411+0000 7fe828ff9640 1 -- 172.21.15.92:0/1431641245 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fe81c014030 con 0x7fe82c06f140 2024-09-11T00:15:12.588 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:12.586+0000 7fe831dd3640 1 -- 172.21.15.92:0/1431641245 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe82c0cd6d0 con 0x7fe82c06f140 2024-09-11T00:15:12.589 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:12.587+0000 7fe828ff9640 1 -- 172.21.15.92:0/1431641245 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) ==== 74+0+17039 (secure 0 0 0) 0x7fe81c0626e0 con 0x7fe82c06f140 2024-09-11T00:15:12.589 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:15:12.589 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":38,"fsid":"47039cb3-5d2a-46bf-9066-8055b5dfc583","created":"2024-09-11T00:13:53.889939+0000","modified":"2024-09-11T00:15:11.325355+0000","last_up_change":"2024-09-11T00:14:06.563107+0000","last_in_change":"2024-09-11T00:13:56.982537+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T00:14:06.287223+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-09-11T00:15:09.154216+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-09-11T00:15:10.288017+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"538af0ea-96c9-4999-9ccc-bee55f80ff76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":2860560077},{"type":"v1","addr":"172.21.15.92:6801","nonce":2860560077}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":2860560077},{"type":"v1","addr":"172.21.15.92:6803","nonce":2860560077}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":2860560077},{"type":"v1","addr":"172.21.15.92:6807","nonce":2860560077}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":2860560077},{"type":"v1","addr":"172.21.15.92:6805","nonce":2860560077}]},"public_addr":"172.21.15.92:6801/2860560077","cluster_addr":"172.21.15.92:6803/2860560077","heartbeat_back_addr":"172.21.15.92:6807/2860560077","heartbeat_front_addr":"172.21.15.92:6805/2860560077","state":["exists","up"]},{"osd":1,"uuid":"f9214f2c-ffe6-4447-9a13-9549a36e0537","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":2600417443},{"type":"v1","addr":"172.21.15.92:6817","nonce":2600417443}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6818","nonce":2600417443},{"type":"v1","addr":"172.21.15.92:6819","nonce":2600417443}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6822","nonce":2600417443},{"type":"v1","addr":"172.21.15.92:6823","nonce":2600417443}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":2600417443},{"type":"v1","addr":"172.21.15.92:6821","nonce":2600417443}]},"public_addr":"172.21.15.92:6817/2600417443","cluster_addr":"172.21.15.92:6819/2600417443","heartbeat_back_addr":"172.21.15.92:6823/2600417443","heartbeat_front_addr":"172.21.15.92:6821/2600417443","state":["exists","up"]},{"osd":2,"uuid":"b44dd849-fb85-42b1-8a1a-b6681bb1f467","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":3143892898},{"type":"v1","addr":"172.21.15.92:6809","nonce":3143892898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":3143892898},{"type":"v1","addr":"172.21.15.92:6811","nonce":3143892898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":3143892898},{"type":"v1","addr":"172.21.15.92:6815","nonce":3143892898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":3143892898},{"type":"v1","addr":"172.21.15.92:6813","nonce":3143892898}]},"public_addr":"172.21.15.92:6809/3143892898","cluster_addr":"172.21.15.92:6811/3143892898","heartbeat_back_addr":"172.21.15.92:6815/3143892898","heartbeat_front_addr":"172.21.15.92:6813/3143892898","state":["exists","up"]},{"osd":3,"uuid":"05a49d87-23b9-48dd-962c-d5c2686e7a32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":3913961488},{"type":"v1","addr":"172.21.15.92:6825","nonce":3913961488}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6826","nonce":3913961488},{"type":"v1","addr":"172.21.15.92:6827","nonce":3913961488}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":3913961488},{"type":"v1","addr":"172.21.15.92:6831","nonce":3913961488}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":3913961488},{"type":"v1","addr":"172.21.15.92:6829","nonce":3913961488}]},"public_addr":"172.21.15.92:6825/3913961488","cluster_addr":"172.21.15.92:6827/3913961488","heartbeat_back_addr":"172.21.15.92:6831/3913961488","heartbeat_front_addr":"172.21.15.92:6829/3913961488","state":["exists","up"]},{"osd":4,"uuid":"cf52b087-afe0-4f43-a4e7-db2ebc158815","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6826","nonce":2206798907},{"type":"v1","addr":"172.21.15.145:6827","nonce":2206798907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6828","nonce":2206798907},{"type":"v1","addr":"172.21.15.145:6829","nonce":2206798907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6832","nonce":2206798907},{"type":"v1","addr":"172.21.15.145:6833","nonce":2206798907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6830","nonce":2206798907},{"type":"v1","addr":"172.21.15.145:6831","nonce":2206798907}]},"public_addr":"172.21.15.145:6827/2206798907","cluster_addr":"172.21.15.145:6829/2206798907","heartbeat_back_addr":"172.21.15.145:6833/2206798907","heartbeat_front_addr":"172.21.15.145:6831/2206798907","state":["exists","up"]},{"osd":5,"uuid":"0e54adcd-2d1d-49fb-bf97-3dd7e9addd30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6810","nonce":2599548493},{"type":"v1","addr":"172.21.15.145:6811","nonce":2599548493}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6812","nonce":2599548493},{"type":"v1","addr":"172.21.15.145:6813","nonce":2599548493}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6816","nonce":2599548493},{"type":"v1","addr":"172.21.15.145:6817","nonce":2599548493}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6814","nonce":2599548493},{"type":"v1","addr":"172.21.15.145:6815","nonce":2599548493}]},"public_addr":"172.21.15.145:6811/2599548493","cluster_addr":"172.21.15.145:6813/2599548493","heartbeat_back_addr":"172.21.15.145:6817/2599548493","heartbeat_front_addr":"172.21.15.145:6815/2599548493","state":["exists","up"]},{"osd":6,"uuid":"4d5ae7a8-b3df-4c7a-9124-290f239f5b57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6802","nonce":4192380792},{"type":"v1","addr":"172.21.15.145:6803","nonce":4192380792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6804","nonce":4192380792},{"type":"v1","addr":"172.21.15.145:6805","nonce":4192380792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6808","nonce":4192380792},{"type":"v1","addr":"172.21.15.145:6809","nonce":4192380792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6806","nonce":4192380792},{"type":"v1","addr":"172.21.15.145:6807","nonce":4192380792}]},"public_addr":"172.21.15.145:6803/4192380792","cluster_addr":"172.21.15.145:6805/4192380792","heartbeat_back_addr":"172.21.15.145:6809/4192380792","heartbeat_front_addr":"172.21.15.145:6807/4192380792","state":["exists","up"]},{"osd":7,"uuid":"d7e36444-6e3f-4372-81d3-88e7b4e993f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6818","nonce":3010598400},{"type":"v1","addr":"172.21.15.145:6819","nonce":3010598400}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6820","nonce":3010598400},{"type":"v1","addr":"172.21.15.145:6821","nonce":3010598400}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6824","nonce":3010598400},{"type":"v1","addr":"172.21.15.145:6825","nonce":3010598400}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6822","nonce":3010598400},{"type":"v1","addr":"172.21.15.145:6823","nonce":3010598400}]},"public_addr":"172.21.15.145:6819/3010598400","cluster_addr":"172.21.15.145:6821/3010598400","heartbeat_back_addr":"172.21.15.145:6825/3010598400","heartbeat_front_addr":"172.21.15.145:6823/3010598400","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:14:03.281892+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:14:04.039021+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:14:03.045775+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:14:03.708856+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:14:04.425520+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:14:03.839369+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:14:03.029834+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:14:03.707529+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T00:15:12.592 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:12.590+0000 7fe831dd3640 1 -- 172.21.15.92:0/1431641245 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7fe80c077f70 msgr2=0x7fe80c07a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:12.592 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:12.590+0000 7fe831dd3640 1 --2- 172.21.15.92:0/1431641245 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7fe80c077f70 0x7fe80c07a430 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fe82c15c110 tx=0x7fe814009040 comp rx=0 tx=0).stop 2024-09-11T00:15:12.592 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:12.590+0000 7fe831dd3640 1 -- 172.21.15.92:0/1431641245 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe82c06f140 msgr2=0x7fe82c15b660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:12.592 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:12.590+0000 7fe831dd3640 1 --2- 172.21.15.92:0/1431641245 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe82c06f140 0x7fe82c15b660 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fe81c00c890 tx=0x7fe81c00cd50 comp rx=0 tx=0).stop 2024-09-11T00:15:12.592 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:12.590+0000 7fe831dd3640 1 -- 172.21.15.92:0/1431641245 shutdown_connections 2024-09-11T00:15:12.592 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:12.590+0000 7fe831dd3640 1 --2- 172.21.15.92:0/1431641245 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7fe80c077f70 0x7fe80c07a430 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:12.592 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:12.590+0000 7fe831dd3640 1 --2- 172.21.15.92:0/1431641245 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe82c15c470 0x7fe82c1f6210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:12.592 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:12.590+0000 7fe831dd3640 1 --2- 172.21.15.92:0/1431641245 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe82c073780 0x7fe82c1f5cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:12.592 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:12.590+0000 7fe831dd3640 1 --2- 172.21.15.92:0/1431641245 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe82c06f140 0x7fe82c15b660 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:12.593 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:12.590+0000 7fe831dd3640 1 -- 172.21.15.92:0/1431641245 >> 172.21.15.92:0/1431641245 conn(0x7fe82c0b1760 msgr2=0x7fe82c0cde70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:15:12.593 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:12.590+0000 7fe831dd3640 1 -- 172.21.15.92:0/1431641245 shutdown_connections 2024-09-11T00:15:12.593 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:12.590+0000 7fe831dd3640 1 -- 172.21.15.92:0/1431641245 wait complete. 2024-09-11T00:15:12.603 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-11T00:15:12.708 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:12.706+0000 7fd2748e2640 1 -- 172.21.15.92:0/3936214777 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd270156330 msgr2=0x7fd270074330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:12.709 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:12.706+0000 7fd2748e2640 1 --2- 172.21.15.92:0/3936214777 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd270156330 0x7fd270074330 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fd258005fd0 tx=0x7fd25802a540 comp rx=0 tx=0).stop 2024-09-11T00:15:12.709 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:12.706+0000 7fd2748e2640 1 -- 172.21.15.92:0/3936214777 shutdown_connections 2024-09-11T00:15:12.709 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:12.706+0000 7fd2748e2640 1 --2- 172.21.15.92:0/3936214777 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd270156330 0x7fd270074330 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:12.709 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:12.706+0000 7fd2748e2640 1 --2- 172.21.15.92:0/3936214777 >> v2:172.21.15.145:3300/0 conn(0x7fd270155f50 0x7fd270160070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:12.709 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:12.706+0000 7fd2748e2640 1 -- 172.21.15.92:0/3936214777 >> 172.21.15.92:0/3936214777 conn(0x7fd2700b1c80 msgr2=0x7fd2700b2060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:15:12.709 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:12.706+0000 7fd2748e2640 1 -- 172.21.15.92:0/3936214777 shutdown_connections 2024-09-11T00:15:12.709 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:12.707+0000 7fd2748e2640 1 -- 172.21.15.92:0/3936214777 wait complete. 2024-09-11T00:15:12.712 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:12.708+0000 7fd2748e2640 1 Processor -- start 2024-09-11T00:15:12.712 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:12.708+0000 7fd2748e2640 1 -- start start 2024-09-11T00:15:12.712 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:12.709+0000 7fd2748e2640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd270155f50 0x7fd2701409d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:12.712 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:12.709+0000 7fd2748e2640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd270156330 0x7fd27015b7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:12.712 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:12.709+0000 7fd2748e2640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd27015c070 0x7fd2701400f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:12.712 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:12.709+0000 7fd2748e2640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fd2700749f0 con 0x7fd270156330 2024-09-11T00:15:12.712 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:12.709+0000 7fd2748e2640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fd270074870 con 0x7fd270155f50 2024-09-11T00:15:12.713 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:12.709+0000 7fd2748e2640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7fd270074b70 con 0x7fd27015c070 2024-09-11T00:15:12.713 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:12.709+0000 7fd26dd9b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd270156330 0x7fd27015b7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:12.713 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:12.709+0000 7fd26dd9b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd270156330 0x7fd27015b7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:45918/0 (socket says 172.21.15.92:45918) 2024-09-11T00:15:12.713 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:12.709+0000 7fd26dd9b640 1 -- 172.21.15.92:0/2598542998 learned_addr learned my addr 172.21.15.92:0/2598542998 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-11T00:15:12.713 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:12.709+0000 7fd26e59c640 1 --2- 172.21.15.92:0/2598542998 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd270155f50 0x7fd2701409d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:12.713 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:12.709+0000 7fd26ed9d640 1 --2- 172.21.15.92:0/2598542998 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd27015c070 0x7fd2701400f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:12.713 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:12.709+0000 7fd26dd9b640 1 -- 172.21.15.92:0/2598542998 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd27015c070 msgr2=0x7fd2701400f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:12.713 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:12.709+0000 7fd26dd9b640 1 --2- 172.21.15.92:0/2598542998 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd27015c070 0x7fd2701400f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:12.713 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:12.709+0000 7fd26dd9b640 1 -- 172.21.15.92:0/2598542998 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd270155f50 msgr2=0x7fd2701409d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:12.713 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:12.709+0000 7fd26dd9b640 1 --2- 172.21.15.92:0/2598542998 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd270155f50 0x7fd2701409d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:12.713 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:12.709+0000 7fd26dd9b640 1 -- 172.21.15.92:0/2598542998 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2700ce5f0 con 0x7fd270156330 2024-09-11T00:15:12.714 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:12.709+0000 7fd26dd9b640 1 --2- 172.21.15.92:0/2598542998 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd270156330 0x7fd27015b7d0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fd258000c00 tx=0x7fd2580038a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:15:12.714 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:12.709+0000 7fd266ffd640 1 -- 172.21.15.92:0/2598542998 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd25803f070 con 0x7fd270156330 2024-09-11T00:15:12.714 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:12.709+0000 7fd266ffd640 1 -- 172.21.15.92:0/2598542998 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd2580047a0 con 0x7fd270156330 2024-09-11T00:15:12.714 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:12.709+0000 7fd266ffd640 1 -- 172.21.15.92:0/2598542998 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd258035030 con 0x7fd270156330 2024-09-11T00:15:12.714 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:12.709+0000 7fd2748e2640 1 -- 172.21.15.92:0/2598542998 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2700ce890 con 0x7fd270156330 2024-09-11T00:15:12.714 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:12.709+0000 7fd2748e2640 1 -- 172.21.15.92:0/2598542998 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2700cee50 con 0x7fd270156330 2024-09-11T00:15:12.714 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:12.710+0000 7fd2748e2640 1 -- 172.21.15.92:0/2598542998 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd270160070 con 0x7fd270156330 2024-09-11T00:15:12.715 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:12.711+0000 7fd266ffd640 1 -- 172.21.15.92:0/2598542998 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fd258004bf0 con 0x7fd270156330 2024-09-11T00:15:12.715 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:12.712+0000 7fd266ffd640 1 --2- 172.21.15.92:0/2598542998 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7fd250077f70 0x7fd25007a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:12.715 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:12.712+0000 7fd266ffd640 1 -- 172.21.15.92:0/2598542998 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 6101+0+0 (secure 0 0 0) 0x7fd2580bb390 con 0x7fd270156330 2024-09-11T00:15:12.716 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:12.712+0000 7fd26e59c640 1 --2- 172.21.15.92:0/2598542998 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7fd250077f70 0x7fd25007a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:12.716 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:12.713+0000 7fd26e59c640 1 --2- 172.21.15.92:0/2598542998 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7fd250077f70 0x7fd25007a430 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fd260005fd0 tx=0x7fd260009500 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:15:12.717 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:12.716+0000 7fd266ffd640 1 -- 172.21.15.92:0/2598542998 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fd258083610 con 0x7fd270156330 2024-09-11T00:15:12.930 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:12.929+0000 7fd2748e2640 1 -- 172.21.15.92:0/2598542998 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fd2700694d0 con 0x7fd270156330 2024-09-11T00:15:12.983 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:12.982+0000 7fd266ffd640 1 -- 172.21.15.92:0/2598542998 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v14) ==== 118+0+0 (secure 0 0 0) 0x7fd25808c380 con 0x7fd270156330 2024-09-11T00:15:12.986 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:12.984+0000 7fd2748e2640 1 -- 172.21.15.92:0/2598542998 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7fd250077f70 msgr2=0x7fd25007a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:12.986 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:12.984+0000 7fd2748e2640 1 --2- 172.21.15.92:0/2598542998 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7fd250077f70 0x7fd25007a430 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fd260005fd0 tx=0x7fd260009500 comp rx=0 tx=0).stop 2024-09-11T00:15:12.986 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:12.984+0000 7fd2748e2640 1 -- 172.21.15.92:0/2598542998 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd270156330 msgr2=0x7fd27015b7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:12.986 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:12.984+0000 7fd2748e2640 1 --2- 172.21.15.92:0/2598542998 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd270156330 0x7fd27015b7d0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fd258000c00 tx=0x7fd2580038a0 comp rx=0 tx=0).stop 2024-09-11T00:15:12.986 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:12.984+0000 7fd2748e2640 1 -- 172.21.15.92:0/2598542998 shutdown_connections 2024-09-11T00:15:12.986 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:12.984+0000 7fd2748e2640 1 --2- 172.21.15.92:0/2598542998 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7fd250077f70 0x7fd25007a430 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:12.986 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:12.984+0000 7fd2748e2640 1 --2- 172.21.15.92:0/2598542998 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd27015c070 0x7fd2701400f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:12.986 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:12.984+0000 7fd2748e2640 1 --2- 172.21.15.92:0/2598542998 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd270156330 0x7fd27015b7d0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:12.987 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:12.984+0000 7fd2748e2640 1 --2- 172.21.15.92:0/2598542998 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd270155f50 0x7fd2701409d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:12.987 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:12.984+0000 7fd2748e2640 1 -- 172.21.15.92:0/2598542998 >> 172.21.15.92:0/2598542998 conn(0x7fd2700b1c80 msgr2=0x7fd27006ea30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:15:12.987 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:12.984+0000 7fd2748e2640 1 -- 172.21.15.92:0/2598542998 shutdown_connections 2024-09-11T00:15:12.987 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:12.984+0000 7fd2748e2640 1 -- 172.21.15.92:0/2598542998 wait complete. 2024-09-11T00:15:12.998 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-11T00:15:12.998 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-11T00:15:13.103 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:13.101+0000 7f19ac76c640 1 -- 172.21.15.92:0/650702607 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f19a415e530 msgr2=0x7f19a40cf110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:13.103 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:13.101+0000 7f19ac76c640 1 --2- 172.21.15.92:0/650702607 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f19a415e530 0x7f19a40cf110 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f199c005fd0 tx=0x7f199c02aa90 comp rx=0 tx=0).stop 2024-09-11T00:15:13.103 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:13.101+0000 7f19ac76c640 1 -- 172.21.15.92:0/650702607 shutdown_connections 2024-09-11T00:15:13.103 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:13.101+0000 7f19ac76c640 1 --2- 172.21.15.92:0/650702607 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f19a415e530 0x7f19a40cf110 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:13.103 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:13.101+0000 7f19ac76c640 1 -- 172.21.15.92:0/650702607 >> 172.21.15.92:0/650702607 conn(0x7f19a40b1760 msgr2=0x7f19a40b1b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:15:13.103 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:13.101+0000 7f19ac76c640 1 -- 172.21.15.92:0/650702607 shutdown_connections 2024-09-11T00:15:13.103 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:13.101+0000 7f19ac76c640 1 -- 172.21.15.92:0/650702607 wait complete. 2024-09-11T00:15:13.106 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:13.102+0000 7f19ac76c640 1 Processor -- start 2024-09-11T00:15:13.106 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:13.102+0000 7f19ac76c640 1 -- start start 2024-09-11T00:15:13.107 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:13.103+0000 7f19ac76c640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f19a406e2e0 0x7f19a414ec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:13.107 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:13.103+0000 7f19ac76c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f19a415e150 0x7f19a413c090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:13.107 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:13.103+0000 7f19ac76c640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f19a415e530 0x7f19a4151e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:13.107 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:13.103+0000 7f19ac76c640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f19a40b4930 con 0x7f19a415e150 2024-09-11T00:15:13.107 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:13.103+0000 7f19ac76c640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f19a40b47b0 con 0x7f19a415e530 2024-09-11T00:15:13.107 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:13.103+0000 7f19ac76c640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f19a40b4ab0 con 0x7f19a406e2e0 2024-09-11T00:15:13.107 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:13.103+0000 7f19a9d07640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f19a415e150 0x7f19a413c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:13.107 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:13.103+0000 7f19a9d07640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f19a415e150 0x7f19a413c090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:45938/0 (socket says 172.21.15.92:45938) 2024-09-11T00:15:13.107 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:13.103+0000 7f19a9d07640 1 -- 172.21.15.92:0/2968493200 learned_addr learned my addr 172.21.15.92:0/2968493200 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-11T00:15:13.107 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:13.103+0000 7f19aad09640 1 --2- 172.21.15.92:0/2968493200 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f19a415e530 0x7f19a4151e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:13.107 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:13.103+0000 7f19aa508640 1 --2- 172.21.15.92:0/2968493200 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f19a406e2e0 0x7f19a414ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:13.107 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:13.103+0000 7f19a9d07640 1 -- 172.21.15.92:0/2968493200 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f19a406e2e0 msgr2=0x7f19a414ec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:13.107 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:13.103+0000 7f19a9d07640 1 --2- 172.21.15.92:0/2968493200 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f19a406e2e0 0x7f19a414ec00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:13.108 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:13.103+0000 7f19a9d07640 1 -- 172.21.15.92:0/2968493200 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f19a415e530 msgr2=0x7f19a4151e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:13.108 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:13.103+0000 7f19a9d07640 1 --2- 172.21.15.92:0/2968493200 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f19a415e530 0x7f19a4151e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:13.108 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:13.103+0000 7f19a9d07640 1 -- 172.21.15.92:0/2968493200 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19a4151670 con 0x7f19a415e150 2024-09-11T00:15:13.108 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:13.103+0000 7f19aad09640 1 --2- 172.21.15.92:0/2968493200 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f19a415e530 0x7f19a4151e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:15:13.108 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:13.103+0000 7f19aa508640 1 --2- 172.21.15.92:0/2968493200 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f19a406e2e0 0x7f19a414ec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:15:13.108 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:13.103+0000 7f19a9d07640 1 --2- 172.21.15.92:0/2968493200 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f19a415e150 0x7f19a413c090 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f199400c450 tx=0x7f199400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:15:13.108 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:13.103+0000 7f199affd640 1 -- 172.21.15.92:0/2968493200 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19940052d0 con 0x7f19a415e150 2024-09-11T00:15:13.108 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:13.103+0000 7f199affd640 1 -- 172.21.15.92:0/2968493200 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1994005470 con 0x7f19a415e150 2024-09-11T00:15:13.108 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:13.103+0000 7f19ac76c640 1 -- 172.21.15.92:0/2968493200 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19a414d0a0 con 0x7f19a415e150 2024-09-11T00:15:13.108 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:13.104+0000 7f199affd640 1 -- 172.21.15.92:0/2968493200 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1994012870 con 0x7f19a415e150 2024-09-11T00:15:13.108 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:13.104+0000 7f19ac76c640 1 -- 172.21.15.92:0/2968493200 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19a4151910 con 0x7f19a415e150 2024-09-11T00:15:13.108 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:13.104+0000 7f19ac76c640 1 -- 172.21.15.92:0/2968493200 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f19a4072720 con 0x7f19a415e150 2024-09-11T00:15:13.108 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:13.105+0000 7f199affd640 1 -- 172.21.15.92:0/2968493200 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f19940035f0 con 0x7f19a415e150 2024-09-11T00:15:13.109 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:13.106+0000 7f199affd640 1 --2- 172.21.15.92:0/2968493200 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f1988077f70 0x7f198807a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:13.109 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:13.106+0000 7f199affd640 1 -- 172.21.15.92:0/2968493200 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7f1994099a40 con 0x7f19a415e150 2024-09-11T00:15:13.109 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:13.106+0000 7f19aa508640 1 --2- 172.21.15.92:0/2968493200 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f1988077f70 0x7f198807a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:13.109 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:13.107+0000 7f19aa508640 1 --2- 172.21.15.92:0/2968493200 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f1988077f70 0x7f198807a430 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f19a4152600 tx=0x7f19a0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:15:13.111 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:13.110+0000 7f199affd640 1 -- 172.21.15.92:0/2968493200 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f19a4073ef0 con 0x7f19a415e150 2024-09-11T00:15:13.321 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:13.319+0000 7f19ac76c640 1 -- 172.21.15.92:0/2968493200 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f19a4151ae0 con 0x7f19a415e150 2024-09-11T00:15:13.999 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:13.998+0000 7f199affd640 1 -- 172.21.15.92:0/2968493200 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v15) ==== 122+0+0 (secure 0 0 0) 0x7f19940623b0 con 0x7f19a415e150 2024-09-11T00:15:14.002 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:14.000+0000 7f19ac76c640 1 -- 172.21.15.92:0/2968493200 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f1988077f70 msgr2=0x7f198807a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:14.002 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:14.000+0000 7f19ac76c640 1 --2- 172.21.15.92:0/2968493200 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f1988077f70 0x7f198807a430 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f19a4152600 tx=0x7f19a0009040 comp rx=0 tx=0).stop 2024-09-11T00:15:14.002 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:14.000+0000 7f19ac76c640 1 -- 172.21.15.92:0/2968493200 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f19a415e150 msgr2=0x7f19a413c090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:14.002 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:14.000+0000 7f19ac76c640 1 --2- 172.21.15.92:0/2968493200 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f19a415e150 0x7f19a413c090 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f199400c450 tx=0x7f199400c910 comp rx=0 tx=0).stop 2024-09-11T00:15:14.002 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:14.000+0000 7f19ac76c640 1 -- 172.21.15.92:0/2968493200 shutdown_connections 2024-09-11T00:15:14.002 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:14.000+0000 7f19ac76c640 1 --2- 172.21.15.92:0/2968493200 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f1988077f70 0x7f198807a430 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:14.002 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:14.000+0000 7f19ac76c640 1 --2- 172.21.15.92:0/2968493200 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f19a415e530 0x7f19a4151e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:14.002 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:14.000+0000 7f19ac76c640 1 --2- 172.21.15.92:0/2968493200 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f19a415e150 0x7f19a413c090 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:14.003 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:14.000+0000 7f19ac76c640 1 --2- 172.21.15.92:0/2968493200 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f19a406e2e0 0x7f19a414ec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:14.003 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:14.000+0000 7f19ac76c640 1 -- 172.21.15.92:0/2968493200 >> 172.21.15.92:0/2968493200 conn(0x7f19a40b1760 msgr2=0x7f19a414f450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:15:14.003 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:14.000+0000 7f19ac76c640 1 -- 172.21.15.92:0/2968493200 shutdown_connections 2024-09-11T00:15:14.003 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:14.000+0000 7f19ac76c640 1 -- 172.21.15.92:0/2968493200 wait complete. 2024-09-11T00:15:14.014 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-11T00:15:14.014 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T00:15:14.120 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:14.118+0000 7f6cd4a79640 1 -- 172.21.15.92:0/1939199553 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6cd0144780 msgr2=0x7f6cd00b3da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:14.120 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:14.118+0000 7f6cd4a79640 1 --2- 172.21.15.92:0/1939199553 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6cd0144780 0x7f6cd00b3da0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f6cc0005fd0 tx=0x7f6cc002aa10 comp rx=0 tx=0).stop 2024-09-11T00:15:14.120 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:14.118+0000 7f6cd4a79640 1 -- 172.21.15.92:0/1939199553 shutdown_connections 2024-09-11T00:15:14.120 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:14.118+0000 7f6cd4a79640 1 --2- 172.21.15.92:0/1939199553 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6cd00cf210 0x7f6cd015c550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:14.120 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:14.118+0000 7f6cd4a79640 1 --2- 172.21.15.92:0/1939199553 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6cd0144780 0x7f6cd00b3da0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:14.121 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:14.118+0000 7f6cd4a79640 1 -- 172.21.15.92:0/1939199553 >> 172.21.15.92:0/1939199553 conn(0x7f6cd00b1760 msgr2=0x7f6cd00b1b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:15:14.121 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:14.118+0000 7f6cd4a79640 1 -- 172.21.15.92:0/1939199553 shutdown_connections 2024-09-11T00:15:14.121 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:14.118+0000 7f6cd4a79640 1 -- 172.21.15.92:0/1939199553 wait complete. 2024-09-11T00:15:14.123 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:14.119+0000 7f6cd4a79640 1 Processor -- start 2024-09-11T00:15:14.123 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:14.119+0000 7f6cd4a79640 1 -- start start 2024-09-11T00:15:14.123 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:14.120+0000 7f6cd4a79640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6cd0072680 0x7f6cd01f3980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:14.123 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:14.120+0000 7f6cd4a79640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6cd00cf210 0x7f6cd00aee50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:14.123 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:14.120+0000 7f6cd4a79640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6cd0144780 0x7f6cd00b07b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:14.124 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:14.120+0000 7f6cd4a79640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f6cd015ca90 con 0x7f6cd00cf210 2024-09-11T00:15:14.124 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:14.120+0000 7f6cd4a79640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f6cd0072d60 con 0x7f6cd0144780 2024-09-11T00:15:14.124 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:14.120+0000 7f6cd4a79640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f6cd015cc10 con 0x7f6cd0072680 2024-09-11T00:15:14.124 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:14.120+0000 7f6ccdd9b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6cd00cf210 0x7f6cd00aee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:14.124 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:14.120+0000 7f6ccdd9b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6cd00cf210 0x7f6cd00aee50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:45956/0 (socket says 172.21.15.92:45956) 2024-09-11T00:15:14.124 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:14.120+0000 7f6ccdd9b640 1 -- 172.21.15.92:0/3827425368 learned_addr learned my addr 172.21.15.92:0/3827425368 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-11T00:15:14.124 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:14.120+0000 7f6cce59c640 1 --2- 172.21.15.92:0/3827425368 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6cd0072680 0x7f6cd01f3980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:14.124 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:14.120+0000 7f6cced9d640 1 --2- 172.21.15.92:0/3827425368 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6cd0144780 0x7f6cd00b07b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:14.124 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:14.121+0000 7f6ccdd9b640 1 -- 172.21.15.92:0/3827425368 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6cd0072680 msgr2=0x7f6cd01f3980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:14.124 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:14.121+0000 7f6ccdd9b640 1 --2- 172.21.15.92:0/3827425368 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6cd0072680 0x7f6cd01f3980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:14.124 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:14.121+0000 7f6ccdd9b640 1 -- 172.21.15.92:0/3827425368 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6cd0144780 msgr2=0x7f6cd00b07b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:14.124 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:14.121+0000 7f6ccdd9b640 1 --2- 172.21.15.92:0/3827425368 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6cd0144780 0x7f6cd00b07b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:14.124 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:14.121+0000 7f6ccdd9b640 1 -- 172.21.15.92:0/3827425368 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6cd01e4da0 con 0x7f6cd00cf210 2024-09-11T00:15:14.125 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:14.121+0000 7f6ccdd9b640 1 --2- 172.21.15.92:0/3827425368 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6cd00cf210 0x7f6cd00aee50 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f6cb800c500 tx=0x7f6cb800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:15:14.125 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:14.121+0000 7f6cc6ffd640 1 -- 172.21.15.92:0/3827425368 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cb80052d0 con 0x7f6cd00cf210 2024-09-11T00:15:14.125 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:14.121+0000 7f6cc6ffd640 1 -- 172.21.15.92:0/3827425368 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6cb8005470 con 0x7f6cd00cf210 2024-09-11T00:15:14.125 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:14.121+0000 7f6cd4a79640 1 -- 172.21.15.92:0/3827425368 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6cd01e5080 con 0x7f6cd00cf210 2024-09-11T00:15:14.125 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:14.121+0000 7f6cc6ffd640 1 -- 172.21.15.92:0/3827425368 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cb8012870 con 0x7f6cd00cf210 2024-09-11T00:15:14.125 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:14.121+0000 7f6cd4a79640 1 -- 172.21.15.92:0/3827425368 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6cd01e5640 con 0x7f6cd00cf210 2024-09-11T00:15:14.126 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:14.122+0000 7f6cd4a79640 1 -- 172.21.15.92:0/3827425368 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6cd015bd40 con 0x7f6cd00cf210 2024-09-11T00:15:14.126 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:14.122+0000 7f6cc6ffd640 1 -- 172.21.15.92:0/3827425368 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f6cb8012a10 con 0x7f6cd00cf210 2024-09-11T00:15:14.126 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:14.123+0000 7f6cc6ffd640 1 --2- 172.21.15.92:0/3827425368 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f6cb0077f70 0x7f6cb007a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:14.126 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:14.123+0000 7f6cc6ffd640 1 -- 172.21.15.92:0/3827425368 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7f6cb8099a80 con 0x7f6cd00cf210 2024-09-11T00:15:14.126 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:14.123+0000 7f6cce59c640 1 --2- 172.21.15.92:0/3827425368 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f6cb0077f70 0x7f6cb007a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:14.126 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:14.124+0000 7f6cce59c640 1 --2- 172.21.15.92:0/3827425368 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f6cb0077f70 0x7f6cb007a430 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f6cc0035000 tx=0x7f6cc0004ab0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:15:14.129 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:14.127+0000 7f6cc6ffd640 1 -- 172.21.15.92:0/3827425368 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f6cd015bd40 con 0x7f6cd00cf210 2024-09-11T00:15:14.337 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:14.336+0000 7f6cd4a79640 1 -- 172.21.15.92:0/3827425368 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6cd015c550 con 0x7f6cd00cf210 2024-09-11T00:15:14.338 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:14.336+0000 7f6cc6ffd640 1 -- 172.21.15.92:0/3827425368 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) ==== 94+0+5223 (secure 0 0 0) 0x7f6cb8062400 con 0x7f6cd00cf210 2024-09-11T00:15:14.338 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:15:14.338 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":15,"btime":"2024-09-11T00:15:13:987293+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4628,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6836/315952476","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6834","nonce":315952476},{"type":"v1","addr":"172.21.15.145:6836","nonce":315952476}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4631,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6837/549929116","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6835","nonce":549929116},{"type":"v1","addr":"172.21.15.145:6837","nonce":549929116}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4998,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6834/2553881541","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":2553881541},{"type":"v1","addr":"172.21.15.92:6834","nonce":2553881541}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T00:15:11.325320+0000","modified":"2024-09-11T00:15:13.320995+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5001},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5001":{"gid":5001,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.92:6835/2081230425","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6833","nonce":2081230425},{"type":"v1","addr":"172.21.15.92:6835","nonce":2081230425}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5001,"qdb_cluster":[5001]},"id":2}]} 2024-09-11T00:15:14.339 INFO:teuthology.orchestra.run.smithi092.stderr:dumped fsmap epoch 15 2024-09-11T00:15:14.341 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:14.339+0000 7f6cd4a79640 1 -- 172.21.15.92:0/3827425368 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f6cb0077f70 msgr2=0x7f6cb007a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:14.341 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:14.339+0000 7f6cd4a79640 1 --2- 172.21.15.92:0/3827425368 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f6cb0077f70 0x7f6cb007a430 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f6cc0035000 tx=0x7f6cc0004ab0 comp rx=0 tx=0).stop 2024-09-11T00:15:14.341 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:14.339+0000 7f6cd4a79640 1 -- 172.21.15.92:0/3827425368 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6cd00cf210 msgr2=0x7f6cd00aee50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:14.341 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:14.339+0000 7f6cd4a79640 1 --2- 172.21.15.92:0/3827425368 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6cd00cf210 0x7f6cd00aee50 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f6cb800c500 tx=0x7f6cb800c9c0 comp rx=0 tx=0).stop 2024-09-11T00:15:14.341 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:14.339+0000 7f6cd4a79640 1 -- 172.21.15.92:0/3827425368 shutdown_connections 2024-09-11T00:15:14.341 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:14.339+0000 7f6cd4a79640 1 --2- 172.21.15.92:0/3827425368 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f6cb0077f70 0x7f6cb007a430 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:14.341 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:14.339+0000 7f6cd4a79640 1 --2- 172.21.15.92:0/3827425368 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6cd0144780 0x7f6cd00b07b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:14.341 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:14.339+0000 7f6cd4a79640 1 --2- 172.21.15.92:0/3827425368 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6cd00cf210 0x7f6cd00aee50 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:14.341 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:14.339+0000 7f6cd4a79640 1 --2- 172.21.15.92:0/3827425368 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6cd0072680 0x7f6cd01f3980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:14.341 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:14.339+0000 7f6cd4a79640 1 -- 172.21.15.92:0/3827425368 >> 172.21.15.92:0/3827425368 conn(0x7f6cd00b1760 msgr2=0x7f6cd00cd9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:15:14.341 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:14.339+0000 7f6cd4a79640 1 -- 172.21.15.92:0/3827425368 shutdown_connections 2024-09-11T00:15:14.342 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:14.339+0000 7f6cd4a79640 1 -- 172.21.15.92:0/3827425368 wait complete. 2024-09-11T00:15:14.357 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T00:15:14.458 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:14.456+0000 7f60697ec640 1 -- 172.21.15.92:0/849546644 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6064160530 msgr2=0x7f60640cf860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:14.458 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:14.456+0000 7f60697ec640 1 --2- 172.21.15.92:0/849546644 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6064160530 0x7f60640cf860 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f6054009830 tx=0x7f605402a470 comp rx=0 tx=0).stop 2024-09-11T00:15:14.458 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:14.456+0000 7f60697ec640 1 -- 172.21.15.92:0/849546644 shutdown_connections 2024-09-11T00:15:14.459 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:14.456+0000 7f60697ec640 1 --2- 172.21.15.92:0/849546644 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f60640b05c0 0x7f60640cfda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:14.459 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:14.456+0000 7f60697ec640 1 --2- 172.21.15.92:0/849546644 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6064160530 0x7f60640cf860 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:14.459 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:14.456+0000 7f60697ec640 1 -- 172.21.15.92:0/849546644 >> 172.21.15.92:0/849546644 conn(0x7f60640b37c0 msgr2=0x7f60640b3bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:15:14.459 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:14.456+0000 7f60697ec640 1 -- 172.21.15.92:0/849546644 shutdown_connections 2024-09-11T00:15:14.459 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:14.456+0000 7f60697ec640 1 -- 172.21.15.92:0/849546644 wait complete. 2024-09-11T00:15:14.461 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:14.457+0000 7f60697ec640 1 Processor -- start 2024-09-11T00:15:14.461 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:14.458+0000 7f60697ec640 1 -- start start 2024-09-11T00:15:14.461 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:14.458+0000 7f60697ec640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f60640b05c0 0x7f60640c7e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:14.461 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:14.458+0000 7f60697ec640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6064160530 0x7f606415a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:14.462 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:14.458+0000 7f60697ec640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f606415a9a0 0x7f606415c530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:14.462 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:14.458+0000 7f60697ec640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f60640b1990 con 0x7f606415a9a0 2024-09-11T00:15:14.462 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:14.458+0000 7f60697ec640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f60640b34f0 con 0x7f6064160530 2024-09-11T00:15:14.462 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:14.458+0000 7f60697ec640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f60640b1b10 con 0x7f60640b05c0 2024-09-11T00:15:14.462 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:14.458+0000 7f60637fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f606415a9a0 0x7f606415c530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:14.462 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:14.458+0000 7f60637fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f606415a9a0 0x7f606415c530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:54644/0 (socket says 172.21.15.92:54644) 2024-09-11T00:15:14.462 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:14.458+0000 7f60637fe640 1 -- 172.21.15.92:0/454632313 learned_addr learned my addr 172.21.15.92:0/454632313 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-11T00:15:14.462 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:14.458+0000 7f605bfff640 1 --2- 172.21.15.92:0/454632313 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6064160530 0x7f606415a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:14.462 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:14.458+0000 7f6062ffd640 1 --2- 172.21.15.92:0/454632313 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f60640b05c0 0x7f60640c7e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:14.462 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:14.459+0000 7f60637fe640 1 -- 172.21.15.92:0/454632313 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f60640b05c0 msgr2=0x7f60640c7e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:14.462 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:14.459+0000 7f60637fe640 1 --2- 172.21.15.92:0/454632313 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f60640b05c0 0x7f60640c7e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:14.462 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:14.459+0000 7f60637fe640 1 -- 172.21.15.92:0/454632313 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6064160530 msgr2=0x7f606415a460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:14.462 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:14.459+0000 7f60637fe640 1 --2- 172.21.15.92:0/454632313 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6064160530 0x7f606415a460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:14.463 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:14.459+0000 7f60637fe640 1 -- 172.21.15.92:0/454632313 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f606415af20 con 0x7f606415a9a0 2024-09-11T00:15:14.463 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:14.459+0000 7f60637fe640 1 --2- 172.21.15.92:0/454632313 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f606415a9a0 0x7f606415c530 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f605c009cc0 tx=0x7f605c00c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:15:14.463 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:14.459+0000 7f605b7fe640 1 -- 172.21.15.92:0/454632313 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f605c003b70 con 0x7f606415a9a0 2024-09-11T00:15:14.463 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:14.459+0000 7f605b7fe640 1 -- 172.21.15.92:0/454632313 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f605c003d10 con 0x7f606415a9a0 2024-09-11T00:15:14.463 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:14.459+0000 7f60697ec640 1 -- 172.21.15.92:0/454632313 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f60641f2b90 con 0x7f606415a9a0 2024-09-11T00:15:14.463 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:14.459+0000 7f605b7fe640 1 -- 172.21.15.92:0/454632313 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f605c004280 con 0x7f606415a9a0 2024-09-11T00:15:14.463 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:14.459+0000 7f60697ec640 1 -- 172.21.15.92:0/454632313 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60641f3150 con 0x7f606415a9a0 2024-09-11T00:15:14.463 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:14.460+0000 7f60697ec640 1 -- 172.21.15.92:0/454632313 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f60640b1f90 con 0x7f606415a9a0 2024-09-11T00:15:14.464 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:14.461+0000 7f605b7fe640 1 -- 172.21.15.92:0/454632313 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f605c004420 con 0x7f606415a9a0 2024-09-11T00:15:14.464 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:14.461+0000 7f605b7fe640 1 --2- 172.21.15.92:0/454632313 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f6044077f70 0x7f604407a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:14.464 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:14.461+0000 7f605b7fe640 1 -- 172.21.15.92:0/454632313 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7f605c09ab30 con 0x7f606415a9a0 2024-09-11T00:15:14.464 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:14.461+0000 7f6062ffd640 1 --2- 172.21.15.92:0/454632313 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f6044077f70 0x7f604407a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:14.464 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:14.462+0000 7f6062ffd640 1 --2- 172.21.15.92:0/454632313 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f6044077f70 0x7f604407a430 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f6054034000 tx=0x7f6054004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:15:14.467 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:14.465+0000 7f605b7fe640 1 -- 172.21.15.92:0/454632313 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f605c062e50 con 0x7f606415a9a0 2024-09-11T00:15:14.641 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:14.639+0000 7f60697ec640 1 -- 172.21.15.92:0/454632313 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f60641f3320 con 0x7f606415a9a0 2024-09-11T00:15:14.642 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:14.640+0000 7f605b7fe640 1 -- 172.21.15.92:0/454632313 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) ==== 74+0+17026 (secure 0 0 0) 0x7f605c067880 con 0x7f606415a9a0 2024-09-11T00:15:14.642 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:15:14.642 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":39,"fsid":"47039cb3-5d2a-46bf-9066-8055b5dfc583","created":"2024-09-11T00:13:53.889939+0000","modified":"2024-09-11T00:15:12.982445+0000","last_up_change":"2024-09-11T00:14:06.563107+0000","last_in_change":"2024-09-11T00:13:56.982537+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T00:14:06.287223+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-09-11T00:15:09.154216+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-09-11T00:15:10.288017+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"538af0ea-96c9-4999-9ccc-bee55f80ff76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":2860560077},{"type":"v1","addr":"172.21.15.92:6801","nonce":2860560077}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":2860560077},{"type":"v1","addr":"172.21.15.92:6803","nonce":2860560077}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":2860560077},{"type":"v1","addr":"172.21.15.92:6807","nonce":2860560077}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":2860560077},{"type":"v1","addr":"172.21.15.92:6805","nonce":2860560077}]},"public_addr":"172.21.15.92:6801/2860560077","cluster_addr":"172.21.15.92:6803/2860560077","heartbeat_back_addr":"172.21.15.92:6807/2860560077","heartbeat_front_addr":"172.21.15.92:6805/2860560077","state":["exists","up"]},{"osd":1,"uuid":"f9214f2c-ffe6-4447-9a13-9549a36e0537","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":2600417443},{"type":"v1","addr":"172.21.15.92:6817","nonce":2600417443}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6818","nonce":2600417443},{"type":"v1","addr":"172.21.15.92:6819","nonce":2600417443}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6822","nonce":2600417443},{"type":"v1","addr":"172.21.15.92:6823","nonce":2600417443}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":2600417443},{"type":"v1","addr":"172.21.15.92:6821","nonce":2600417443}]},"public_addr":"172.21.15.92:6817/2600417443","cluster_addr":"172.21.15.92:6819/2600417443","heartbeat_back_addr":"172.21.15.92:6823/2600417443","heartbeat_front_addr":"172.21.15.92:6821/2600417443","state":["exists","up"]},{"osd":2,"uuid":"b44dd849-fb85-42b1-8a1a-b6681bb1f467","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":3143892898},{"type":"v1","addr":"172.21.15.92:6809","nonce":3143892898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":3143892898},{"type":"v1","addr":"172.21.15.92:6811","nonce":3143892898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":3143892898},{"type":"v1","addr":"172.21.15.92:6815","nonce":3143892898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":3143892898},{"type":"v1","addr":"172.21.15.92:6813","nonce":3143892898}]},"public_addr":"172.21.15.92:6809/3143892898","cluster_addr":"172.21.15.92:6811/3143892898","heartbeat_back_addr":"172.21.15.92:6815/3143892898","heartbeat_front_addr":"172.21.15.92:6813/3143892898","state":["exists","up"]},{"osd":3,"uuid":"05a49d87-23b9-48dd-962c-d5c2686e7a32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":3913961488},{"type":"v1","addr":"172.21.15.92:6825","nonce":3913961488}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6826","nonce":3913961488},{"type":"v1","addr":"172.21.15.92:6827","nonce":3913961488}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":3913961488},{"type":"v1","addr":"172.21.15.92:6831","nonce":3913961488}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":3913961488},{"type":"v1","addr":"172.21.15.92:6829","nonce":3913961488}]},"public_addr":"172.21.15.92:6825/3913961488","cluster_addr":"172.21.15.92:6827/3913961488","heartbeat_back_addr":"172.21.15.92:6831/3913961488","heartbeat_front_addr":"172.21.15.92:6829/3913961488","state":["exists","up"]},{"osd":4,"uuid":"cf52b087-afe0-4f43-a4e7-db2ebc158815","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6826","nonce":2206798907},{"type":"v1","addr":"172.21.15.145:6827","nonce":2206798907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6828","nonce":2206798907},{"type":"v1","addr":"172.21.15.145:6829","nonce":2206798907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6832","nonce":2206798907},{"type":"v1","addr":"172.21.15.145:6833","nonce":2206798907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6830","nonce":2206798907},{"type":"v1","addr":"172.21.15.145:6831","nonce":2206798907}]},"public_addr":"172.21.15.145:6827/2206798907","cluster_addr":"172.21.15.145:6829/2206798907","heartbeat_back_addr":"172.21.15.145:6833/2206798907","heartbeat_front_addr":"172.21.15.145:6831/2206798907","state":["exists","up"]},{"osd":5,"uuid":"0e54adcd-2d1d-49fb-bf97-3dd7e9addd30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6810","nonce":2599548493},{"type":"v1","addr":"172.21.15.145:6811","nonce":2599548493}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6812","nonce":2599548493},{"type":"v1","addr":"172.21.15.145:6813","nonce":2599548493}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6816","nonce":2599548493},{"type":"v1","addr":"172.21.15.145:6817","nonce":2599548493}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6814","nonce":2599548493},{"type":"v1","addr":"172.21.15.145:6815","nonce":2599548493}]},"public_addr":"172.21.15.145:6811/2599548493","cluster_addr":"172.21.15.145:6813/2599548493","heartbeat_back_addr":"172.21.15.145:6817/2599548493","heartbeat_front_addr":"172.21.15.145:6815/2599548493","state":["exists","up"]},{"osd":6,"uuid":"4d5ae7a8-b3df-4c7a-9124-290f239f5b57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6802","nonce":4192380792},{"type":"v1","addr":"172.21.15.145:6803","nonce":4192380792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6804","nonce":4192380792},{"type":"v1","addr":"172.21.15.145:6805","nonce":4192380792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6808","nonce":4192380792},{"type":"v1","addr":"172.21.15.145:6809","nonce":4192380792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6806","nonce":4192380792},{"type":"v1","addr":"172.21.15.145:6807","nonce":4192380792}]},"public_addr":"172.21.15.145:6803/4192380792","cluster_addr":"172.21.15.145:6805/4192380792","heartbeat_back_addr":"172.21.15.145:6809/4192380792","heartbeat_front_addr":"172.21.15.145:6807/4192380792","state":["exists","up"]},{"osd":7,"uuid":"d7e36444-6e3f-4372-81d3-88e7b4e993f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6818","nonce":3010598400},{"type":"v1","addr":"172.21.15.145:6819","nonce":3010598400}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6820","nonce":3010598400},{"type":"v1","addr":"172.21.15.145:6821","nonce":3010598400}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6824","nonce":3010598400},{"type":"v1","addr":"172.21.15.145:6825","nonce":3010598400}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6822","nonce":3010598400},{"type":"v1","addr":"172.21.15.145:6823","nonce":3010598400}]},"public_addr":"172.21.15.145:6819/3010598400","cluster_addr":"172.21.15.145:6821/3010598400","heartbeat_back_addr":"172.21.15.145:6825/3010598400","heartbeat_front_addr":"172.21.15.145:6823/3010598400","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:14:03.281892+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:14:04.039021+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:14:03.045775+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:14:03.708856+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:14:04.425520+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:14:03.839369+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:14:03.029834+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:14:03.707529+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T00:15:14.644 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:14.643+0000 7f60697ec640 1 -- 172.21.15.92:0/454632313 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f6044077f70 msgr2=0x7f604407a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:14.644 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:14.643+0000 7f60697ec640 1 --2- 172.21.15.92:0/454632313 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f6044077f70 0x7f604407a430 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f6054034000 tx=0x7f6054004730 comp rx=0 tx=0).stop 2024-09-11T00:15:14.645 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:14.643+0000 7f60697ec640 1 -- 172.21.15.92:0/454632313 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f606415a9a0 msgr2=0x7f606415c530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:14.645 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:14.643+0000 7f60697ec640 1 --2- 172.21.15.92:0/454632313 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f606415a9a0 0x7f606415c530 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f605c009cc0 tx=0x7f605c00c6a0 comp rx=0 tx=0).stop 2024-09-11T00:15:14.645 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:14.643+0000 7f60697ec640 1 -- 172.21.15.92:0/454632313 shutdown_connections 2024-09-11T00:15:14.645 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:14.643+0000 7f60697ec640 1 --2- 172.21.15.92:0/454632313 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f6044077f70 0x7f604407a430 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:14.645 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:14.643+0000 7f60697ec640 1 --2- 172.21.15.92:0/454632313 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f606415a9a0 0x7f606415c530 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:14.645 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:14.643+0000 7f60697ec640 1 --2- 172.21.15.92:0/454632313 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6064160530 0x7f606415a460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:14.645 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:14.643+0000 7f60697ec640 1 --2- 172.21.15.92:0/454632313 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f60640b05c0 0x7f60640c7e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:14.645 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:14.643+0000 7f60697ec640 1 -- 172.21.15.92:0/454632313 >> 172.21.15.92:0/454632313 conn(0x7f60640b37c0 msgr2=0x7f6064071c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:15:14.645 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:14.643+0000 7f60697ec640 1 -- 172.21.15.92:0/454632313 shutdown_connections 2024-09-11T00:15:14.645 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:14.643+0000 7f60697ec640 1 -- 172.21.15.92:0/454632313 wait complete. 2024-09-11T00:15:14.655 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-11T00:15:14.655 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T00:15:14.756 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:14.754+0000 7f06ddfa2640 1 -- 172.21.15.92:0/1419613322 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f06c4004800 msgr2=0x7f06c4004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:14.756 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:14.754+0000 7f06ddfa2640 1 --2- 172.21.15.92:0/1419613322 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f06c4004800 0x7f06c4004c80 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f06c0009b20 tx=0x7f06c4005830 comp rx=0 tx=0).stop 2024-09-11T00:15:14.756 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:14.754+0000 7f06d7fff640 1 -- 172.21.15.92:0/1419613322 reap_dead start 2024-09-11T00:15:14.756 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:14.754+0000 7f06ddfa2640 1 -- 172.21.15.92:0/1419613322 shutdown_connections 2024-09-11T00:15:14.756 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:14.754+0000 7f06ddfa2640 1 -- 172.21.15.92:0/1419613322 >> 172.21.15.92:0/1419613322 conn(0x7f06d80d3f70 msgr2=0x7f06d80d4350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:15:14.756 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:14.754+0000 7f06ddfa2640 1 -- 172.21.15.92:0/1419613322 shutdown_connections 2024-09-11T00:15:14.756 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:14.754+0000 7f06ddfa2640 1 -- 172.21.15.92:0/1419613322 wait complete. 2024-09-11T00:15:14.759 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:14.755+0000 7f06ddfa2640 1 Processor -- start 2024-09-11T00:15:14.759 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:14.755+0000 7f06ddfa2640 1 -- start start 2024-09-11T00:15:14.759 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:14.756+0000 7f06ddfa2640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f06c4004800 0x7f06d8149940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:14.759 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:14.756+0000 7f06ddfa2640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f06d80c7620 0x7f06d814c160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:14.759 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:14.756+0000 7f06ddfa2640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f06d814c6a0 0x7f06d814cb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:14.759 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:14.756+0000 7f06ddfa2640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f06d80b7150 con 0x7f06c4004800 2024-09-11T00:15:14.759 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:14.756+0000 7f06ddfa2640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f06d80b6fd0 con 0x7f06d814c6a0 2024-09-11T00:15:14.759 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:14.756+0000 7f06ddfa2640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f06d80d2a20 con 0x7f06d80c7620 2024-09-11T00:15:14.759 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:14.756+0000 7f06d77fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f06c4004800 0x7f06d8149940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:14.759 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:14.756+0000 7f06d77fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f06c4004800 0x7f06d8149940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:54664/0 (socket says 172.21.15.92:54664) 2024-09-11T00:15:14.759 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:14.756+0000 7f06d77fe640 1 -- 172.21.15.92:0/537972381 learned_addr learned my addr 172.21.15.92:0/537972381 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-11T00:15:14.759 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:14.756+0000 7f06d6ffd640 1 --2- 172.21.15.92:0/537972381 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f06d80c7620 0x7f06d814c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:14.759 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:14.756+0000 7f06d7fff640 1 --2- 172.21.15.92:0/537972381 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f06d814c6a0 0x7f06d814cb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:14.760 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:14.756+0000 7f06d77fe640 1 -- 172.21.15.92:0/537972381 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f06d80c7620 msgr2=0x7f06d814c160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:14.760 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:14.756+0000 7f06d77fe640 1 --2- 172.21.15.92:0/537972381 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f06d80c7620 0x7f06d814c160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:14.760 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:14.756+0000 7f06d77fe640 1 -- 172.21.15.92:0/537972381 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f06d814c6a0 msgr2=0x7f06d814cb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:14.760 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:14.756+0000 7f06d77fe640 1 --2- 172.21.15.92:0/537972381 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f06d814c6a0 0x7f06d814cb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:14.760 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:14.756+0000 7f06d77fe640 1 -- 172.21.15.92:0/537972381 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06d81600b0 con 0x7f06c4004800 2024-09-11T00:15:14.760 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:14.757+0000 7f06d77fe640 1 --2- 172.21.15.92:0/537972381 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f06c4004800 0x7f06d8149940 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f06c8011c40 tx=0x7f06c800f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:15:14.760 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:14.757+0000 7f06cffff640 1 -- 172.21.15.92:0/537972381 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06c8003d80 con 0x7f06c4004800 2024-09-11T00:15:14.760 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:14.757+0000 7f06cffff640 1 -- 172.21.15.92:0/537972381 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f06c8004b20 con 0x7f06c4004800 2024-09-11T00:15:14.760 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:14.757+0000 7f06ddfa2640 1 -- 172.21.15.92:0/537972381 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06d8160390 con 0x7f06c4004800 2024-09-11T00:15:14.760 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:14.757+0000 7f06cffff640 1 -- 172.21.15.92:0/537972381 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06c8004050 con 0x7f06c4004800 2024-09-11T00:15:14.760 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:14.757+0000 7f06ddfa2640 1 -- 172.21.15.92:0/537972381 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06d8160950 con 0x7f06c4004800 2024-09-11T00:15:14.761 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:14.758+0000 7f06ddfa2640 1 -- 172.21.15.92:0/537972381 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f06d80d24e0 con 0x7f06c4004800 2024-09-11T00:15:14.761 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:14.758+0000 7f06cffff640 1 -- 172.21.15.92:0/537972381 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f06c8018070 con 0x7f06c4004800 2024-09-11T00:15:14.762 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:14.759+0000 7f06cffff640 1 --2- 172.21.15.92:0/537972381 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f06b8077fa0 0x7f06b807a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:14.762 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:14.759+0000 7f06cffff640 1 -- 172.21.15.92:0/537972381 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7f06c809ac40 con 0x7f06c4004800 2024-09-11T00:15:14.762 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:14.759+0000 7f06d6ffd640 1 --2- 172.21.15.92:0/537972381 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f06b8077fa0 0x7f06b807a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:14.762 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:14.760+0000 7f06d6ffd640 1 --2- 172.21.15.92:0/537972381 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f06b8077fa0 0x7f06b807a460 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f06c0035000 tx=0x7f06c002d040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:15:14.765 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:14.763+0000 7f06cffff640 1 -- 172.21.15.92:0/537972381 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f06c8062f60 con 0x7f06c4004800 2024-09-11T00:15:14.935 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:14.934+0000 7f06ddfa2640 1 -- 172.21.15.92:0/537972381 --> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f06d808dfa0 con 0x7f06b8077fa0 2024-09-11T00:15:14.940 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:14.939+0000 7f06cffff640 1 -- 172.21.15.92:0/537972381 <== mgr.4100 v2:172.21.15.145:6800/325490785 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+250277 (secure 0 0 0) 0x7f06d808dfa0 con 0x7f06b8077fa0 2024-09-11T00:15:14.943 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:15:14.945 INFO:teuthology.orchestra.run.smithi092.stderr:dumped all 2024-09-11T00:15:14.946 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:14.942+0000 7f06ddfa2640 1 -- 172.21.15.92:0/537972381 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f06b8077fa0 msgr2=0x7f06b807a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:14.946 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:14.942+0000 7f06ddfa2640 1 --2- 172.21.15.92:0/537972381 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f06b8077fa0 0x7f06b807a460 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f06c0035000 tx=0x7f06c002d040 comp rx=0 tx=0).stop 2024-09-11T00:15:14.946 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:14.942+0000 7f06ddfa2640 1 -- 172.21.15.92:0/537972381 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f06c4004800 msgr2=0x7f06d8149940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:14.946 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:14.942+0000 7f06ddfa2640 1 --2- 172.21.15.92:0/537972381 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f06c4004800 0x7f06d8149940 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f06c8011c40 tx=0x7f06c800f790 comp rx=0 tx=0).stop 2024-09-11T00:15:14.947 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:14.942+0000 7f06ddfa2640 1 -- 172.21.15.92:0/537972381 shutdown_connections 2024-09-11T00:15:14.947 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:14.942+0000 7f06ddfa2640 1 --2- 172.21.15.92:0/537972381 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f06b8077fa0 0x7f06b807a460 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:14.947 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:14.942+0000 7f06ddfa2640 1 --2- 172.21.15.92:0/537972381 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f06d814c6a0 0x7f06d814cb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:14.947 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:14.942+0000 7f06ddfa2640 1 --2- 172.21.15.92:0/537972381 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f06d80c7620 0x7f06d814c160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:14.947 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:14.942+0000 7f06ddfa2640 1 --2- 172.21.15.92:0/537972381 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f06c4004800 0x7f06d8149940 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:14.947 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:14.942+0000 7f06ddfa2640 1 -- 172.21.15.92:0/537972381 >> 172.21.15.92:0/537972381 conn(0x7f06d80d3f70 msgr2=0x7f06d80d0520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:15:14.947 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:14.942+0000 7f06ddfa2640 1 -- 172.21.15.92:0/537972381 shutdown_connections 2024-09-11T00:15:14.947 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:14.942+0000 7f06ddfa2640 1 -- 172.21.15.92:0/537972381 wait complete. 2024-09-11T00:15:14.954 INFO:teuthology.orchestra.run.smithi092.stdout:{"pg_ready":true,"pg_map":{"version":67,"stamp":"2024-09-11T00:15:14.286766+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592126,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":139,"num_write_kb":1640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":103,"ondisk_log_size":103,"up":182,"acting":182,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":5,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220720,"kb_used_data":4472,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754000,"statfs":{"total":773094113280,"available":772868096000,"internally_reserved":0,"allocated":4579328,"data_stored":2625822,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":26,"apply_latency_ms":26,"commit_latency_ns":26000000,"apply_latency_ns":26000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1758,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.324271"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:11.996813+0000","last_change":"2024-09-11T00:15:11.990745+0000","last_active":"2024-09-11T00:15:11.996813+0000","last_peered":"2024-09-11T00:15:11.996813+0000","last_clean":"2024-09-11T00:15:11.996813+0000","last_became_active":"2024-09-11T00:15:11.990485+0000","last_became_peered":"2024-09-11T00:15:11.990485+0000","last_unstale":"2024-09-11T00:15:11.996813+0000","last_undegraded":"2024-09-11T00:15:11.996813+0000","last_fullsized":"2024-09-11T00:15:11.996813+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:14:44.693719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:11.996830+0000","last_change":"2024-09-11T00:15:11.989933+0000","last_active":"2024-09-11T00:15:11.996830+0000","last_peered":"2024-09-11T00:15:11.996830+0000","last_clean":"2024-09-11T00:15:11.996830+0000","last_became_active":"2024-09-11T00:15:11.989547+0000","last_became_peered":"2024-09-11T00:15:11.989547+0000","last_unstale":"2024-09-11T00:15:11.996830+0000","last_undegraded":"2024-09-11T00:15:11.996830+0000","last_fullsized":"2024-09-11T00:15:11.996830+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:38:48.432712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:11.999391+0000","last_change":"2024-09-11T00:15:11.996802+0000","last_active":"2024-09-11T00:15:11.999391+0000","last_peered":"2024-09-11T00:15:11.999391+0000","last_clean":"2024-09-11T00:15:11.999391+0000","last_became_active":"2024-09-11T00:15:11.996464+0000","last_became_peered":"2024-09-11T00:15:11.996464+0000","last_unstale":"2024-09-11T00:15:11.999391+0000","last_undegraded":"2024-09-11T00:15:11.999391+0000","last_fullsized":"2024-09-11T00:15:11.999391+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:48:53.696945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-11T00:15:10.973081+0000","last_change":"2024-09-11T00:15:10.973081+0000","last_active":"2024-09-11T00:15:10.961693+0000","last_peered":"2024-09-11T00:15:10.961693+0000","last_clean":"2024-09-11T00:15:10.961693+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:15:10.973081+0000","last_undegraded":"2024-09-11T00:15:10.973081+0000","last_fullsized":"2024-09-11T00:15:10.973081+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-11T00:15:10.972932+0000","last_change":"2024-09-11T00:15:10.972932+0000","last_active":"2024-09-11T00:15:10.961693+0000","last_peered":"2024-09-11T00:15:10.961693+0000","last_clean":"2024-09-11T00:15:10.961693+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:15:10.972932+0000","last_undegraded":"2024-09-11T00:15:10.972932+0000","last_fullsized":"2024-09-11T00:15:10.972932+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:11.987916+0000","last_change":"2024-09-11T00:15:11.981800+0000","last_active":"2024-09-11T00:15:11.987916+0000","last_peered":"2024-09-11T00:15:11.987916+0000","last_clean":"2024-09-11T00:15:11.987916+0000","last_became_active":"2024-09-11T00:15:11.981553+0000","last_became_peered":"2024-09-11T00:15:11.981553+0000","last_unstale":"2024-09-11T00:15:11.987916+0000","last_undegraded":"2024-09-11T00:15:11.987916+0000","last_fullsized":"2024-09-11T00:15:11.987916+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:28:04.414078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:11.995625+0000","last_change":"2024-09-11T00:15:11.985908+0000","last_active":"2024-09-11T00:15:11.995625+0000","last_peered":"2024-09-11T00:15:11.995625+0000","last_clean":"2024-09-11T00:15:11.995625+0000","last_became_active":"2024-09-11T00:15:11.983107+0000","last_became_peered":"2024-09-11T00:15:11.983107+0000","last_unstale":"2024-09-11T00:15:11.995625+0000","last_undegraded":"2024-09-11T00:15:11.995625+0000","last_fullsized":"2024-09-11T00:15:11.995625+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:41:28.124141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:11.996966+0000","last_change":"2024-09-11T00:15:11.991693+0000","last_active":"2024-09-11T00:15:11.996966+0000","last_peered":"2024-09-11T00:15:11.996966+0000","last_clean":"2024-09-11T00:15:11.996966+0000","last_became_active":"2024-09-11T00:15:11.991452+0000","last_became_peered":"2024-09-11T00:15:11.991452+0000","last_unstale":"2024-09-11T00:15:11.996966+0000","last_undegraded":"2024-09-11T00:15:11.996966+0000","last_fullsized":"2024-09-11T00:15:11.996966+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:19:07.626300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:11.999360+0000","last_change":"2024-09-11T00:15:11.996272+0000","last_active":"2024-09-11T00:15:11.999360+0000","last_peered":"2024-09-11T00:15:11.999360+0000","last_clean":"2024-09-11T00:15:11.999360+0000","last_became_active":"2024-09-11T00:15:11.996016+0000","last_became_peered":"2024-09-11T00:15:11.996016+0000","last_unstale":"2024-09-11T00:15:11.999360+0000","last_undegraded":"2024-09-11T00:15:11.999360+0000","last_fullsized":"2024-09-11T00:15:11.999360+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:16:47.443195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:12.004395+0000","last_change":"2024-09-11T00:15:12.000547+0000","last_active":"2024-09-11T00:15:12.004395+0000","last_peered":"2024-09-11T00:15:12.004395+0000","last_clean":"2024-09-11T00:15:12.004395+0000","last_became_active":"2024-09-11T00:15:12.000275+0000","last_became_peered":"2024-09-11T00:15:12.000275+0000","last_unstale":"2024-09-11T00:15:12.004395+0000","last_undegraded":"2024-09-11T00:15:12.004395+0000","last_fullsized":"2024-09-11T00:15:12.004395+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:49:11.620971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:11.998030+0000","last_change":"2024-09-11T00:15:11.991652+0000","last_active":"2024-09-11T00:15:11.998030+0000","last_peered":"2024-09-11T00:15:11.998030+0000","last_clean":"2024-09-11T00:15:11.998030+0000","last_became_active":"2024-09-11T00:15:11.990905+0000","last_became_peered":"2024-09-11T00:15:11.990905+0000","last_unstale":"2024-09-11T00:15:11.998030+0000","last_undegraded":"2024-09-11T00:15:11.998030+0000","last_fullsized":"2024-09-11T00:15:11.998030+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:14:44.693719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:11.988524+0000","last_change":"2024-09-11T00:15:11.984051+0000","last_active":"2024-09-11T00:15:11.988524+0000","last_peered":"2024-09-11T00:15:11.988524+0000","last_clean":"2024-09-11T00:15:11.988524+0000","last_became_active":"2024-09-11T00:15:11.983773+0000","last_became_peered":"2024-09-11T00:15:11.983773+0000","last_unstale":"2024-09-11T00:15:11.988524+0000","last_undegraded":"2024-09-11T00:15:11.988524+0000","last_fullsized":"2024-09-11T00:15:11.988524+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:34:51.768105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:12.003723+0000","last_change":"2024-09-11T00:15:12.000158+0000","last_active":"2024-09-11T00:15:12.003723+0000","last_peered":"2024-09-11T00:15:12.003723+0000","last_clean":"2024-09-11T00:15:12.003723+0000","last_became_active":"2024-09-11T00:15:11.999876+0000","last_became_peered":"2024-09-11T00:15:11.999876+0000","last_unstale":"2024-09-11T00:15:12.003723+0000","last_undegraded":"2024-09-11T00:15:12.003723+0000","last_fullsized":"2024-09-11T00:15:12.003723+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:51:23.369565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:11.999202+0000","last_change":"2024-09-11T00:15:11.990614+0000","last_active":"2024-09-11T00:15:11.999202+0000","last_peered":"2024-09-11T00:15:11.999202+0000","last_clean":"2024-09-11T00:15:11.999202+0000","last_became_active":"2024-09-11T00:15:11.990346+0000","last_became_peered":"2024-09-11T00:15:11.990346+0000","last_unstale":"2024-09-11T00:15:11.999202+0000","last_undegraded":"2024-09-11T00:15:11.999202+0000","last_fullsized":"2024-09-11T00:15:11.999202+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:29:18.376105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:11.995647+0000","last_change":"2024-09-11T00:15:11.986763+0000","last_active":"2024-09-11T00:15:11.995647+0000","last_peered":"2024-09-11T00:15:11.995647+0000","last_clean":"2024-09-11T00:15:11.995647+0000","last_became_active":"2024-09-11T00:15:11.986468+0000","last_became_peered":"2024-09-11T00:15:11.986468+0000","last_unstale":"2024-09-11T00:15:11.995647+0000","last_undegraded":"2024-09-11T00:15:11.995647+0000","last_fullsized":"2024-09-11T00:15:11.995647+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:59:36.084840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:12.009647+0000","last_change":"2024-09-11T00:15:12.005753+0000","last_active":"2024-09-11T00:15:12.009647+0000","last_peered":"2024-09-11T00:15:12.009647+0000","last_clean":"2024-09-11T00:15:12.009647+0000","last_became_active":"2024-09-11T00:15:12.005460+0000","last_became_peered":"2024-09-11T00:15:12.005460+0000","last_unstale":"2024-09-11T00:15:12.009647+0000","last_undegraded":"2024-09-11T00:15:12.009647+0000","last_fullsized":"2024-09-11T00:15:12.009647+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:56:07.914915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:12.009660+0000","last_change":"2024-09-11T00:15:12.005879+0000","last_active":"2024-09-11T00:15:12.009660+0000","last_peered":"2024-09-11T00:15:12.009660+0000","last_clean":"2024-09-11T00:15:12.009660+0000","last_became_active":"2024-09-11T00:15:12.005591+0000","last_became_peered":"2024-09-11T00:15:12.005591+0000","last_unstale":"2024-09-11T00:15:12.009660+0000","last_undegraded":"2024-09-11T00:15:12.009660+0000","last_fullsized":"2024-09-11T00:15:12.009660+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:58:17.603588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T00:15:10.961693+0000","last_change":"2024-09-11T00:15:10.961693+0000","last_active":"2024-09-11T00:15:10.961693+0000","last_peered":"2024-09-11T00:15:10.961693+0000","last_clean":"2024-09-11T00:15:10.961693+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:15:10.961693+0000","last_undegraded":"2024-09-11T00:15:10.961693+0000","last_fullsized":"2024-09-11T00:15:10.961693+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-11T00:15:10.972624+0000","last_change":"2024-09-11T00:15:10.972624+0000","last_active":"2024-09-11T00:15:10.961693+0000","last_peered":"2024-09-11T00:15:10.961693+0000","last_clean":"2024-09-11T00:15:10.961693+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:15:10.972624+0000","last_undegraded":"2024-09-11T00:15:10.972624+0000","last_fullsized":"2024-09-11T00:15:10.972624+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T00:15:10.961693+0000","last_change":"2024-09-11T00:15:10.961693+0000","last_active":"2024-09-11T00:15:10.961693+0000","last_peered":"2024-09-11T00:15:10.961693+0000","last_clean":"2024-09-11T00:15:10.961693+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:15:10.961693+0000","last_undegraded":"2024-09-11T00:15:10.961693+0000","last_fullsized":"2024-09-11T00:15:10.961693+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:11.995476+0000","last_change":"2024-09-11T00:15:11.982721+0000","last_active":"2024-09-11T00:15:11.995476+0000","last_peered":"2024-09-11T00:15:11.995476+0000","last_clean":"2024-09-11T00:15:11.995476+0000","last_became_active":"2024-09-11T00:15:11.981979+0000","last_became_peered":"2024-09-11T00:15:11.981979+0000","last_unstale":"2024-09-11T00:15:11.995476+0000","last_undegraded":"2024-09-11T00:15:11.995476+0000","last_fullsized":"2024-09-11T00:15:11.995476+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:29:04.812424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:12.001333+0000","last_change":"2024-09-11T00:15:11.996951+0000","last_active":"2024-09-11T00:15:12.001333+0000","last_peered":"2024-09-11T00:15:12.001333+0000","last_clean":"2024-09-11T00:15:12.001333+0000","last_became_active":"2024-09-11T00:15:11.996664+0000","last_became_peered":"2024-09-11T00:15:11.996664+0000","last_unstale":"2024-09-11T00:15:12.001333+0000","last_undegraded":"2024-09-11T00:15:12.001333+0000","last_fullsized":"2024-09-11T00:15:12.001333+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:30:48.631902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:12.009565+0000","last_change":"2024-09-11T00:15:12.004148+0000","last_active":"2024-09-11T00:15:12.009565+0000","last_peered":"2024-09-11T00:15:12.009565+0000","last_clean":"2024-09-11T00:15:12.009565+0000","last_became_active":"2024-09-11T00:15:12.003829+0000","last_became_peered":"2024-09-11T00:15:12.003829+0000","last_unstale":"2024-09-11T00:15:12.009565+0000","last_undegraded":"2024-09-11T00:15:12.009565+0000","last_fullsized":"2024-09-11T00:15:12.009565+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:43:33.394237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-11T00:15:10.972983+0000","last_change":"2024-09-11T00:15:10.972983+0000","last_active":"2024-09-11T00:15:10.961693+0000","last_peered":"2024-09-11T00:15:10.961693+0000","last_clean":"2024-09-11T00:15:10.961693+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:15:10.972983+0000","last_undegraded":"2024-09-11T00:15:10.972983+0000","last_fullsized":"2024-09-11T00:15:10.972983+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T00:15:10.961693+0000","last_change":"2024-09-11T00:15:10.961693+0000","last_active":"2024-09-11T00:15:10.961693+0000","last_peered":"2024-09-11T00:15:10.961693+0000","last_clean":"2024-09-11T00:15:10.961693+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:15:10.961693+0000","last_undegraded":"2024-09-11T00:15:10.961693+0000","last_fullsized":"2024-09-11T00:15:10.961693+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:11.997420+0000","last_change":"2024-09-11T00:15:11.990612+0000","last_active":"2024-09-11T00:15:11.997420+0000","last_peered":"2024-09-11T00:15:11.997420+0000","last_clean":"2024-09-11T00:15:11.997420+0000","last_became_active":"2024-09-11T00:15:11.989737+0000","last_became_peered":"2024-09-11T00:15:11.989737+0000","last_unstale":"2024-09-11T00:15:11.997420+0000","last_undegraded":"2024-09-11T00:15:11.997420+0000","last_fullsized":"2024-09-11T00:15:11.997420+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:16:47.443195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T00:15:10.961693+0000","last_change":"2024-09-11T00:15:10.961693+0000","last_active":"2024-09-11T00:15:10.961693+0000","last_peered":"2024-09-11T00:15:10.961693+0000","last_clean":"2024-09-11T00:15:10.961693+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:15:10.961693+0000","last_undegraded":"2024-09-11T00:15:10.961693+0000","last_fullsized":"2024-09-11T00:15:10.961693+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:11.995375+0000","last_change":"2024-09-11T00:15:11.984503+0000","last_active":"2024-09-11T00:15:11.995375+0000","last_peered":"2024-09-11T00:15:11.995375+0000","last_clean":"2024-09-11T00:15:11.995375+0000","last_became_active":"2024-09-11T00:15:11.984226+0000","last_became_peered":"2024-09-11T00:15:11.984226+0000","last_unstale":"2024-09-11T00:15:11.995375+0000","last_undegraded":"2024-09-11T00:15:11.995375+0000","last_fullsized":"2024-09-11T00:15:11.995375+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:58:17.603588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T00:15:10.961693+0000","last_change":"2024-09-11T00:15:10.961693+0000","last_active":"2024-09-11T00:15:10.961693+0000","last_peered":"2024-09-11T00:15:10.961693+0000","last_clean":"2024-09-11T00:15:10.961693+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:15:10.961693+0000","last_undegraded":"2024-09-11T00:15:10.961693+0000","last_fullsized":"2024-09-11T00:15:10.961693+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T00:15:10.961693+0000","last_change":"2024-09-11T00:15:10.961693+0000","last_active":"2024-09-11T00:15:10.961693+0000","last_peered":"2024-09-11T00:15:10.961693+0000","last_clean":"2024-09-11T00:15:10.961693+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:15:10.961693+0000","last_undegraded":"2024-09-11T00:15:10.961693+0000","last_fullsized":"2024-09-11T00:15:10.961693+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:12.009620+0000","last_change":"2024-09-11T00:15:12.005579+0000","last_active":"2024-09-11T00:15:12.009620+0000","last_peered":"2024-09-11T00:15:12.009620+0000","last_clean":"2024-09-11T00:15:12.009620+0000","last_became_active":"2024-09-11T00:15:12.004267+0000","last_became_peered":"2024-09-11T00:15:12.004267+0000","last_unstale":"2024-09-11T00:15:12.009620+0000","last_undegraded":"2024-09-11T00:15:12.009620+0000","last_fullsized":"2024-09-11T00:15:12.009620+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:21:58.807270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:11.990529+0000","last_change":"2024-09-11T00:15:11.984826+0000","last_active":"2024-09-11T00:15:11.990529+0000","last_peered":"2024-09-11T00:15:11.990529+0000","last_clean":"2024-09-11T00:15:11.990529+0000","last_became_active":"2024-09-11T00:15:11.984307+0000","last_became_peered":"2024-09-11T00:15:11.984307+0000","last_unstale":"2024-09-11T00:15:11.990529+0000","last_undegraded":"2024-09-11T00:15:11.990529+0000","last_fullsized":"2024-09-11T00:15:11.990529+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:27:00.007857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:12.009626+0000","last_change":"2024-09-11T00:15:12.005723+0000","last_active":"2024-09-11T00:15:12.009626+0000","last_peered":"2024-09-11T00:15:12.009626+0000","last_clean":"2024-09-11T00:15:12.009626+0000","last_became_active":"2024-09-11T00:15:12.005398+0000","last_became_peered":"2024-09-11T00:15:12.005398+0000","last_unstale":"2024-09-11T00:15:12.009626+0000","last_undegraded":"2024-09-11T00:15:12.009626+0000","last_fullsized":"2024-09-11T00:15:12.009626+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:29:04.812424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-09-11T00:15:09.965757+0000","last_change":"2024-09-11T00:15:09.965757+0000","last_active":"2024-09-11T00:15:09.955417+0000","last_peered":"2024-09-11T00:15:09.955417+0000","last_clean":"2024-09-11T00:15:09.955417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:15:09.965757+0000","last_undegraded":"2024-09-11T00:15:09.965757+0000","last_fullsized":"2024-09-11T00:15:09.965757+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_clean_scrub_stamp":"2024-09-11T00:15:09.955417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:11.998169+0000","last_change":"2024-09-11T00:15:11.994104+0000","last_active":"2024-09-11T00:15:11.998169+0000","last_peered":"2024-09-11T00:15:11.998169+0000","last_clean":"2024-09-11T00:15:11.998169+0000","last_became_active":"2024-09-11T00:15:11.993787+0000","last_became_peered":"2024-09-11T00:15:11.993787+0000","last_unstale":"2024-09-11T00:15:11.998169+0000","last_undegraded":"2024-09-11T00:15:11.998169+0000","last_fullsized":"2024-09-11T00:15:11.998169+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:36:09.339619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"38'1","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:12.003434+0000","last_change":"2024-09-11T00:15:10.987651+0000","last_active":"2024-09-11T00:15:12.003434+0000","last_peered":"2024-09-11T00:15:12.003434+0000","last_clean":"2024-09-11T00:15:12.003434+0000","last_became_active":"2024-09-11T00:15:10.987365+0000","last_became_peered":"2024-09-11T00:15:10.987365+0000","last_unstale":"2024-09-11T00:15:12.003434+0000","last_undegraded":"2024-09-11T00:15:12.003434+0000","last_fullsized":"2024-09-11T00:15:12.003434+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_clean_scrub_stamp":"2024-09-11T00:15:09.955417+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:53:21.168815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:11.997253+0000","last_change":"2024-09-11T00:15:11.989911+0000","last_active":"2024-09-11T00:15:11.997253+0000","last_peered":"2024-09-11T00:15:11.997253+0000","last_clean":"2024-09-11T00:15:11.997253+0000","last_became_active":"2024-09-11T00:15:11.989434+0000","last_became_peered":"2024-09-11T00:15:11.989434+0000","last_unstale":"2024-09-11T00:15:11.997253+0000","last_undegraded":"2024-09-11T00:15:11.997253+0000","last_fullsized":"2024-09-11T00:15:11.997253+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:09:53.019331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"38'2","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:11.997740+0000","last_change":"2024-09-11T00:15:10.988735+0000","last_active":"2024-09-11T00:15:11.997740+0000","last_peered":"2024-09-11T00:15:11.997740+0000","last_clean":"2024-09-11T00:15:11.997740+0000","last_became_active":"2024-09-11T00:15:10.988449+0000","last_became_peered":"2024-09-11T00:15:10.988449+0000","last_unstale":"2024-09-11T00:15:11.997740+0000","last_undegraded":"2024-09-11T00:15:11.997740+0000","last_fullsized":"2024-09-11T00:15:11.997740+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_clean_scrub_stamp":"2024-09-11T00:15:09.955417+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:34:50.761829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:11.995258+0000","last_change":"2024-09-11T00:15:11.988181+0000","last_active":"2024-09-11T00:15:11.995258+0000","last_peered":"2024-09-11T00:15:11.995258+0000","last_clean":"2024-09-11T00:15:11.995258+0000","last_became_active":"2024-09-11T00:15:11.987724+0000","last_became_peered":"2024-09-11T00:15:11.987724+0000","last_unstale":"2024-09-11T00:15:11.995258+0000","last_undegraded":"2024-09-11T00:15:11.995258+0000","last_fullsized":"2024-09-11T00:15:11.995258+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:59:36.084840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"38'2","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:11.998938+0000","last_change":"2024-09-11T00:15:10.983607+0000","last_active":"2024-09-11T00:15:11.998938+0000","last_peered":"2024-09-11T00:15:11.998938+0000","last_clean":"2024-09-11T00:15:11.998938+0000","last_became_active":"2024-09-11T00:15:10.983327+0000","last_became_peered":"2024-09-11T00:15:10.983327+0000","last_unstale":"2024-09-11T00:15:11.998938+0000","last_undegraded":"2024-09-11T00:15:11.998938+0000","last_fullsized":"2024-09-11T00:15:11.998938+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_clean_scrub_stamp":"2024-09-11T00:15:09.955417+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:25:22.909623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:11.993330+0000","last_change":"2024-09-11T00:15:11.990149+0000","last_active":"2024-09-11T00:15:11.993330+0000","last_peered":"2024-09-11T00:15:11.993330+0000","last_clean":"2024-09-11T00:15:11.993330+0000","last_became_active":"2024-09-11T00:15:11.989909+0000","last_became_peered":"2024-09-11T00:15:11.989909+0000","last_unstale":"2024-09-11T00:15:11.993330+0000","last_undegraded":"2024-09-11T00:15:11.993330+0000","last_fullsized":"2024-09-11T00:15:11.993330+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:28:04.414078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"38'1","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:11.995511+0000","last_change":"2024-09-11T00:15:10.984669+0000","last_active":"2024-09-11T00:15:11.995511+0000","last_peered":"2024-09-11T00:15:11.995511+0000","last_clean":"2024-09-11T00:15:11.995511+0000","last_became_active":"2024-09-11T00:15:10.984215+0000","last_became_peered":"2024-09-11T00:15:10.984215+0000","last_unstale":"2024-09-11T00:15:11.995511+0000","last_undegraded":"2024-09-11T00:15:11.995511+0000","last_fullsized":"2024-09-11T00:15:11.995511+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_clean_scrub_stamp":"2024-09-11T00:15:09.955417+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:28:03.407802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:11.995599+0000","last_change":"2024-09-11T00:15:11.982642+0000","last_active":"2024-09-11T00:15:11.995599+0000","last_peered":"2024-09-11T00:15:11.995599+0000","last_clean":"2024-09-11T00:15:11.995599+0000","last_became_active":"2024-09-11T00:15:11.982021+0000","last_became_peered":"2024-09-11T00:15:11.982021+0000","last_unstale":"2024-09-11T00:15:11.995599+0000","last_undegraded":"2024-09-11T00:15:11.995599+0000","last_fullsized":"2024-09-11T00:15:11.995599+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:21:58.807270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"38'1","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:12.003994+0000","last_change":"2024-09-11T00:15:10.987655+0000","last_active":"2024-09-11T00:15:12.003994+0000","last_peered":"2024-09-11T00:15:12.003994+0000","last_clean":"2024-09-11T00:15:12.003994+0000","last_became_active":"2024-09-11T00:15:10.987373+0000","last_became_peered":"2024-09-11T00:15:10.987373+0000","last_unstale":"2024-09-11T00:15:12.003994+0000","last_undegraded":"2024-09-11T00:15:12.003994+0000","last_fullsized":"2024-09-11T00:15:12.003994+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_clean_scrub_stamp":"2024-09-11T00:15:09.955417+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:41:46.193502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:12.002915+0000","last_change":"2024-09-11T00:15:12.000133+0000","last_active":"2024-09-11T00:15:12.002915+0000","last_peered":"2024-09-11T00:15:12.002915+0000","last_clean":"2024-09-11T00:15:12.002915+0000","last_became_active":"2024-09-11T00:15:11.999840+0000","last_became_peered":"2024-09-11T00:15:11.999840+0000","last_unstale":"2024-09-11T00:15:12.002915+0000","last_undegraded":"2024-09-11T00:15:12.002915+0000","last_fullsized":"2024-09-11T00:15:12.002915+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:16:37.462915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:11.975235+0000","last_change":"2024-09-11T00:15:10.987183+0000","last_active":"2024-09-11T00:15:11.975235+0000","last_peered":"2024-09-11T00:15:11.975235+0000","last_clean":"2024-09-11T00:15:11.975235+0000","last_became_active":"2024-09-11T00:15:10.986886+0000","last_became_peered":"2024-09-11T00:15:10.986886+0000","last_unstale":"2024-09-11T00:15:11.975235+0000","last_undegraded":"2024-09-11T00:15:11.975235+0000","last_fullsized":"2024-09-11T00:15:11.975235+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_clean_scrub_stamp":"2024-09-11T00:15:09.955417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:57:48.764730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:12.008243+0000","last_change":"2024-09-11T00:15:12.002956+0000","last_active":"2024-09-11T00:15:12.008243+0000","last_peered":"2024-09-11T00:15:12.008243+0000","last_clean":"2024-09-11T00:15:12.008243+0000","last_became_active":"2024-09-11T00:15:12.002703+0000","last_became_peered":"2024-09-11T00:15:12.002703+0000","last_unstale":"2024-09-11T00:15:12.008243+0000","last_undegraded":"2024-09-11T00:15:12.008243+0000","last_fullsized":"2024-09-11T00:15:12.008243+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:10:10.614680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:11.982026+0000","last_change":"2024-09-11T00:15:10.977955+0000","last_active":"2024-09-11T00:15:11.982026+0000","last_peered":"2024-09-11T00:15:11.982026+0000","last_clean":"2024-09-11T00:15:11.982026+0000","last_became_active":"2024-09-11T00:15:10.977692+0000","last_became_peered":"2024-09-11T00:15:10.977692+0000","last_unstale":"2024-09-11T00:15:11.982026+0000","last_undegraded":"2024-09-11T00:15:11.982026+0000","last_fullsized":"2024-09-11T00:15:11.982026+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_clean_scrub_stamp":"2024-09-11T00:15:09.955417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:29:56.077160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-11T00:15:10.972569+0000","last_change":"2024-09-11T00:15:10.972569+0000","last_active":"2024-09-11T00:15:10.961693+0000","last_peered":"2024-09-11T00:15:10.961693+0000","last_clean":"2024-09-11T00:15:10.961693+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:15:10.972569+0000","last_undegraded":"2024-09-11T00:15:10.972569+0000","last_fullsized":"2024-09-11T00:15:10.972569+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:11.979505+0000","last_change":"2024-09-11T00:15:10.980706+0000","last_active":"2024-09-11T00:15:11.979505+0000","last_peered":"2024-09-11T00:15:11.979505+0000","last_clean":"2024-09-11T00:15:11.979505+0000","last_became_active":"2024-09-11T00:15:10.980429+0000","last_became_peered":"2024-09-11T00:15:10.980429+0000","last_unstale":"2024-09-11T00:15:11.979505+0000","last_undegraded":"2024-09-11T00:15:11.979505+0000","last_fullsized":"2024-09-11T00:15:11.979505+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_clean_scrub_stamp":"2024-09-11T00:15:09.955417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:21:57.800994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:12.003909+0000","last_change":"2024-09-11T00:15:12.001080+0000","last_active":"2024-09-11T00:15:12.003909+0000","last_peered":"2024-09-11T00:15:12.003909+0000","last_clean":"2024-09-11T00:15:12.003909+0000","last_became_active":"2024-09-11T00:15:11.998765+0000","last_became_peered":"2024-09-11T00:15:11.998765+0000","last_unstale":"2024-09-11T00:15:12.003909+0000","last_undegraded":"2024-09-11T00:15:12.003909+0000","last_fullsized":"2024-09-11T00:15:12.003909+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:27:00.007857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:11.975780+0000","last_change":"2024-09-11T00:15:10.987659+0000","last_active":"2024-09-11T00:15:11.975780+0000","last_peered":"2024-09-11T00:15:11.975780+0000","last_clean":"2024-09-11T00:15:11.975780+0000","last_became_active":"2024-09-11T00:15:10.987382+0000","last_became_peered":"2024-09-11T00:15:10.987382+0000","last_unstale":"2024-09-11T00:15:11.975780+0000","last_undegraded":"2024-09-11T00:15:11.975780+0000","last_fullsized":"2024-09-11T00:15:11.975780+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_clean_scrub_stamp":"2024-09-11T00:15:09.955417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:26:59.001581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:11.999601+0000","last_change":"2024-09-11T00:15:11.998770+0000","last_active":"2024-09-11T00:15:11.999601+0000","last_peered":"2024-09-11T00:15:11.999601+0000","last_clean":"2024-09-11T00:15:11.999601+0000","last_became_active":"2024-09-11T00:15:11.998477+0000","last_became_peered":"2024-09-11T00:15:11.998477+0000","last_unstale":"2024-09-11T00:15:11.999601+0000","last_undegraded":"2024-09-11T00:15:11.999601+0000","last_fullsized":"2024-09-11T00:15:11.999601+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:36:09.339619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"38'3","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:11.997971+0000","last_change":"2024-09-11T00:15:10.985997+0000","last_active":"2024-09-11T00:15:11.997971+0000","last_peered":"2024-09-11T00:15:11.997971+0000","last_clean":"2024-09-11T00:15:11.997971+0000","last_became_active":"2024-09-11T00:15:10.985724+0000","last_became_peered":"2024-09-11T00:15:10.985724+0000","last_unstale":"2024-09-11T00:15:11.997971+0000","last_undegraded":"2024-09-11T00:15:11.997971+0000","last_fullsized":"2024-09-11T00:15:11.997971+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_clean_scrub_stamp":"2024-09-11T00:15:09.955417+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:16:46.436919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:12.002091+0000","last_change":"2024-09-11T00:15:11.997734+0000","last_active":"2024-09-11T00:15:12.002091+0000","last_peered":"2024-09-11T00:15:12.002091+0000","last_clean":"2024-09-11T00:15:12.002091+0000","last_became_active":"2024-09-11T00:15:11.997379+0000","last_became_peered":"2024-09-11T00:15:11.997379+0000","last_unstale":"2024-09-11T00:15:12.002091+0000","last_undegraded":"2024-09-11T00:15:12.002091+0000","last_fullsized":"2024-09-11T00:15:12.002091+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:20:52.661018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"38'6","reported_seq":19,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:12.011940+0000","last_change":"2024-09-11T00:15:10.985361+0000","last_active":"2024-09-11T00:15:12.011940+0000","last_peered":"2024-09-11T00:15:12.011940+0000","last_clean":"2024-09-11T00:15:12.011940+0000","last_became_active":"2024-09-11T00:15:10.985070+0000","last_became_peered":"2024-09-11T00:15:10.985070+0000","last_unstale":"2024-09-11T00:15:12.011940+0000","last_undegraded":"2024-09-11T00:15:12.011940+0000","last_fullsized":"2024-09-11T00:15:12.011940+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_clean_scrub_stamp":"2024-09-11T00:15:09.955417+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:36:08.333344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:11.999375+0000","last_change":"2024-09-11T00:15:11.996031+0000","last_active":"2024-09-11T00:15:11.999375+0000","last_peered":"2024-09-11T00:15:11.999375+0000","last_clean":"2024-09-11T00:15:11.999375+0000","last_became_active":"2024-09-11T00:15:11.995734+0000","last_became_peered":"2024-09-11T00:15:11.995734+0000","last_unstale":"2024-09-11T00:15:11.999375+0000","last_undegraded":"2024-09-11T00:15:11.999375+0000","last_fullsized":"2024-09-11T00:15:11.999375+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:27:00.007857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"38'2","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:11.998091+0000","last_change":"2024-09-11T00:15:10.982086+0000","last_active":"2024-09-11T00:15:11.998091+0000","last_peered":"2024-09-11T00:15:11.998091+0000","last_clean":"2024-09-11T00:15:11.998091+0000","last_became_active":"2024-09-11T00:15:10.981821+0000","last_became_peered":"2024-09-11T00:15:10.981821+0000","last_unstale":"2024-09-11T00:15:11.998091+0000","last_undegraded":"2024-09-11T00:15:11.998091+0000","last_fullsized":"2024-09-11T00:15:11.998091+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_clean_scrub_stamp":"2024-09-11T00:15:09.955417+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:29:03.806148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:11.993534+0000","last_change":"2024-09-11T00:15:11.985531+0000","last_active":"2024-09-11T00:15:11.993534+0000","last_peered":"2024-09-11T00:15:11.993534+0000","last_clean":"2024-09-11T00:15:11.993534+0000","last_became_active":"2024-09-11T00:15:11.985177+0000","last_became_peered":"2024-09-11T00:15:11.985177+0000","last_unstale":"2024-09-11T00:15:11.993534+0000","last_undegraded":"2024-09-11T00:15:11.993534+0000","last_fullsized":"2024-09-11T00:15:11.993534+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:56:07.914915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:11.975224+0000","last_change":"2024-09-11T00:15:10.986902+0000","last_active":"2024-09-11T00:15:11.975224+0000","last_peered":"2024-09-11T00:15:11.975224+0000","last_clean":"2024-09-11T00:15:11.975224+0000","last_became_active":"2024-09-11T00:15:10.986618+0000","last_became_peered":"2024-09-11T00:15:10.986618+0000","last_unstale":"2024-09-11T00:15:11.975224+0000","last_undegraded":"2024-09-11T00:15:11.975224+0000","last_fullsized":"2024-09-11T00:15:11.975224+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_clean_scrub_stamp":"2024-09-11T00:15:09.955417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:05:08.232715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:12.004072+0000","last_change":"2024-09-11T00:15:12.001039+0000","last_active":"2024-09-11T00:15:12.004072+0000","last_peered":"2024-09-11T00:15:12.004072+0000","last_clean":"2024-09-11T00:15:12.004072+0000","last_became_active":"2024-09-11T00:15:11.998778+0000","last_became_peered":"2024-09-11T00:15:11.998778+0000","last_unstale":"2024-09-11T00:15:12.004072+0000","last_undegraded":"2024-09-11T00:15:12.004072+0000","last_fullsized":"2024-09-11T00:15:12.004072+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:36:09.339619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-09-11T00:15:09.965664+0000","last_change":"2024-09-11T00:15:09.965664+0000","last_active":"2024-09-11T00:15:09.955417+0000","last_peered":"2024-09-11T00:15:09.955417+0000","last_clean":"2024-09-11T00:15:09.955417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:15:09.965664+0000","last_undegraded":"2024-09-11T00:15:09.965664+0000","last_fullsized":"2024-09-11T00:15:09.965664+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_clean_scrub_stamp":"2024-09-11T00:15:09.955417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:11.995274+0000","last_change":"2024-09-11T00:15:11.987485+0000","last_active":"2024-09-11T00:15:11.995274+0000","last_peered":"2024-09-11T00:15:11.995274+0000","last_clean":"2024-09-11T00:15:11.995274+0000","last_became_active":"2024-09-11T00:15:11.987231+0000","last_became_peered":"2024-09-11T00:15:11.987231+0000","last_unstale":"2024-09-11T00:15:11.995274+0000","last_undegraded":"2024-09-11T00:15:11.995274+0000","last_fullsized":"2024-09-11T00:15:11.995274+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:41:28.124141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"38'8","reported_seq":21,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:12.005409+0000","last_change":"2024-09-11T00:15:10.988757+0000","last_active":"2024-09-11T00:15:12.005409+0000","last_peered":"2024-09-11T00:15:12.005409+0000","last_clean":"2024-09-11T00:15:12.005409+0000","last_became_active":"2024-09-11T00:15:10.988326+0000","last_became_peered":"2024-09-11T00:15:10.988326+0000","last_unstale":"2024-09-11T00:15:12.005409+0000","last_undegraded":"2024-09-11T00:15:12.005409+0000","last_fullsized":"2024-09-11T00:15:12.005409+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_clean_scrub_stamp":"2024-09-11T00:15:09.955417+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:05:08.232715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:11.995083+0000","last_change":"2024-09-11T00:15:11.986504+0000","last_active":"2024-09-11T00:15:11.995083+0000","last_peered":"2024-09-11T00:15:11.995083+0000","last_clean":"2024-09-11T00:15:11.995083+0000","last_became_active":"2024-09-11T00:15:11.986188+0000","last_became_peered":"2024-09-11T00:15:11.986188+0000","last_unstale":"2024-09-11T00:15:11.995083+0000","last_undegraded":"2024-09-11T00:15:11.995083+0000","last_fullsized":"2024-09-11T00:15:11.995083+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:58:17.603588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"38'1","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:11.995689+0000","last_change":"2024-09-11T00:15:10.989224+0000","last_active":"2024-09-11T00:15:11.995689+0000","last_peered":"2024-09-11T00:15:11.995689+0000","last_clean":"2024-09-11T00:15:11.995689+0000","last_became_active":"2024-09-11T00:15:10.988925+0000","last_became_peered":"2024-09-11T00:15:10.988925+0000","last_unstale":"2024-09-11T00:15:11.995689+0000","last_undegraded":"2024-09-11T00:15:11.995689+0000","last_fullsized":"2024-09-11T00:15:11.995689+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_clean_scrub_stamp":"2024-09-11T00:15:09.955417+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:48:52.690670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:11.995628+0000","last_change":"2024-09-11T00:15:11.982787+0000","last_active":"2024-09-11T00:15:11.995628+0000","last_peered":"2024-09-11T00:15:11.995628+0000","last_clean":"2024-09-11T00:15:11.995628+0000","last_became_active":"2024-09-11T00:15:11.982326+0000","last_became_peered":"2024-09-11T00:15:11.982326+0000","last_unstale":"2024-09-11T00:15:11.995628+0000","last_undegraded":"2024-09-11T00:15:11.995628+0000","last_fullsized":"2024-09-11T00:15:11.995628+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:56:07.914915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"38'2","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:12.002918+0000","last_change":"2024-09-11T00:15:10.981474+0000","last_active":"2024-09-11T00:15:12.002918+0000","last_peered":"2024-09-11T00:15:12.002918+0000","last_clean":"2024-09-11T00:15:12.002918+0000","last_became_active":"2024-09-11T00:15:10.981200+0000","last_became_peered":"2024-09-11T00:15:10.981200+0000","last_unstale":"2024-09-11T00:15:12.002918+0000","last_undegraded":"2024-09-11T00:15:12.002918+0000","last_fullsized":"2024-09-11T00:15:12.002918+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_clean_scrub_stamp":"2024-09-11T00:15:09.955417+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:33:53.976909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:12.002128+0000","last_change":"2024-09-11T00:15:11.998394+0000","last_active":"2024-09-11T00:15:12.002128+0000","last_peered":"2024-09-11T00:15:12.002128+0000","last_clean":"2024-09-11T00:15:12.002128+0000","last_became_active":"2024-09-11T00:15:11.998135+0000","last_became_peered":"2024-09-11T00:15:11.998135+0000","last_unstale":"2024-09-11T00:15:12.002128+0000","last_undegraded":"2024-09-11T00:15:12.002128+0000","last_fullsized":"2024-09-11T00:15:12.002128+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:18:10.378079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":10,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-11T00:15:10.991230+0000","last_change":"2024-09-11T00:15:10.987926+0000","last_active":"2024-09-11T00:15:10.991230+0000","last_peered":"2024-09-11T00:15:10.991230+0000","last_clean":"2024-09-11T00:15:10.991230+0000","last_became_active":"2024-09-11T00:15:10.987658+0000","last_became_peered":"2024-09-11T00:15:10.987658+0000","last_unstale":"2024-09-11T00:15:10.991230+0000","last_undegraded":"2024-09-11T00:15:10.991230+0000","last_fullsized":"2024-09-11T00:15:10.991230+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_clean_scrub_stamp":"2024-09-11T00:15:09.955417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:50:53.177894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-11T00:15:10.972453+0000","last_change":"2024-09-11T00:15:10.972453+0000","last_active":"2024-09-11T00:15:10.961693+0000","last_peered":"2024-09-11T00:15:10.961693+0000","last_clean":"2024-09-11T00:15:10.961693+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:15:10.972453+0000","last_undegraded":"2024-09-11T00:15:10.972453+0000","last_fullsized":"2024-09-11T00:15:10.972453+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:11.975134+0000","last_change":"2024-09-11T00:15:10.982457+0000","last_active":"2024-09-11T00:15:11.975134+0000","last_peered":"2024-09-11T00:15:11.975134+0000","last_clean":"2024-09-11T00:15:11.975134+0000","last_became_active":"2024-09-11T00:15:10.982196+0000","last_became_peered":"2024-09-11T00:15:10.982196+0000","last_unstale":"2024-09-11T00:15:11.975134+0000","last_undegraded":"2024-09-11T00:15:11.975134+0000","last_fullsized":"2024-09-11T00:15:11.975134+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_clean_scrub_stamp":"2024-09-11T00:15:09.955417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:53:21.168815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:12.005206+0000","last_change":"2024-09-11T00:15:11.998392+0000","last_active":"2024-09-11T00:15:12.005206+0000","last_peered":"2024-09-11T00:15:12.005206+0000","last_clean":"2024-09-11T00:15:12.005206+0000","last_became_active":"2024-09-11T00:15:11.998147+0000","last_became_peered":"2024-09-11T00:15:11.998147+0000","last_unstale":"2024-09-11T00:15:12.005206+0000","last_undegraded":"2024-09-11T00:15:12.005206+0000","last_fullsized":"2024-09-11T00:15:12.005206+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:28:04.414078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":10,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-11T00:15:10.985035+0000","last_change":"2024-09-11T00:15:10.982090+0000","last_active":"2024-09-11T00:15:10.985035+0000","last_peered":"2024-09-11T00:15:10.985035+0000","last_clean":"2024-09-11T00:15:10.985035+0000","last_became_active":"2024-09-11T00:15:10.980995+0000","last_became_peered":"2024-09-11T00:15:10.980995+0000","last_unstale":"2024-09-11T00:15:10.985035+0000","last_undegraded":"2024-09-11T00:15:10.985035+0000","last_fullsized":"2024-09-11T00:15:10.985035+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_clean_scrub_stamp":"2024-09-11T00:15:09.955417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:54:46.111637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:12.006040+0000","last_change":"2024-09-11T00:15:12.004792+0000","last_active":"2024-09-11T00:15:12.006040+0000","last_peered":"2024-09-11T00:15:12.006040+0000","last_clean":"2024-09-11T00:15:12.006040+0000","last_became_active":"2024-09-11T00:15:12.004535+0000","last_became_peered":"2024-09-11T00:15:12.004535+0000","last_unstale":"2024-09-11T00:15:12.006040+0000","last_undegraded":"2024-09-11T00:15:12.006040+0000","last_fullsized":"2024-09-11T00:15:12.006040+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:43:33.394237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":10,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-11T00:15:10.985090+0000","last_change":"2024-09-11T00:15:10.982293+0000","last_active":"2024-09-11T00:15:10.985090+0000","last_peered":"2024-09-11T00:15:10.985090+0000","last_clean":"2024-09-11T00:15:10.985090+0000","last_became_active":"2024-09-11T00:15:10.981953+0000","last_became_peered":"2024-09-11T00:15:10.981953+0000","last_unstale":"2024-09-11T00:15:10.985090+0000","last_undegraded":"2024-09-11T00:15:10.985090+0000","last_fullsized":"2024-09-11T00:15:10.985090+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_clean_scrub_stamp":"2024-09-11T00:15:09.955417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:00:19.178831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:11.995204+0000","last_change":"2024-09-11T00:15:11.979526+0000","last_active":"2024-09-11T00:15:11.995204+0000","last_peered":"2024-09-11T00:15:11.995204+0000","last_clean":"2024-09-11T00:15:11.995204+0000","last_became_active":"2024-09-11T00:15:11.979276+0000","last_became_peered":"2024-09-11T00:15:11.979276+0000","last_unstale":"2024-09-11T00:15:11.995204+0000","last_undegraded":"2024-09-11T00:15:11.995204+0000","last_fullsized":"2024-09-11T00:15:11.995204+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:43:33.394237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:11.997752+0000","last_change":"2024-09-11T00:15:10.983758+0000","last_active":"2024-09-11T00:15:11.997752+0000","last_peered":"2024-09-11T00:15:11.997752+0000","last_clean":"2024-09-11T00:15:11.997752+0000","last_became_active":"2024-09-11T00:15:10.983483+0000","last_became_peered":"2024-09-11T00:15:10.983483+0000","last_unstale":"2024-09-11T00:15:11.997752+0000","last_undegraded":"2024-09-11T00:15:11.997752+0000","last_fullsized":"2024-09-11T00:15:11.997752+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_clean_scrub_stamp":"2024-09-11T00:15:09.955417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:58:30.377476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:12.008217+0000","last_change":"2024-09-11T00:15:12.002877+0000","last_active":"2024-09-11T00:15:12.008217+0000","last_peered":"2024-09-11T00:15:12.008217+0000","last_clean":"2024-09-11T00:15:12.008217+0000","last_became_active":"2024-09-11T00:15:12.002631+0000","last_became_peered":"2024-09-11T00:15:12.002631+0000","last_unstale":"2024-09-11T00:15:12.008217+0000","last_undegraded":"2024-09-11T00:15:12.008217+0000","last_fullsized":"2024-09-11T00:15:12.008217+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:54:49.591743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":10,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-11T00:15:10.984320+0000","last_change":"2024-09-11T00:15:10.981282+0000","last_active":"2024-09-11T00:15:10.984320+0000","last_peered":"2024-09-11T00:15:10.984320+0000","last_clean":"2024-09-11T00:15:10.984320+0000","last_became_active":"2024-09-11T00:15:10.981000+0000","last_became_peered":"2024-09-11T00:15:10.981000+0000","last_unstale":"2024-09-11T00:15:10.984320+0000","last_undegraded":"2024-09-11T00:15:10.984320+0000","last_fullsized":"2024-09-11T00:15:10.984320+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_clean_scrub_stamp":"2024-09-11T00:15:09.955417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:43:23.737238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:11.998112+0000","last_change":"2024-09-11T00:15:11.991223+0000","last_active":"2024-09-11T00:15:11.998112+0000","last_peered":"2024-09-11T00:15:11.998112+0000","last_clean":"2024-09-11T00:15:11.998112+0000","last_became_active":"2024-09-11T00:15:11.990994+0000","last_became_peered":"2024-09-11T00:15:11.990994+0000","last_unstale":"2024-09-11T00:15:11.998112+0000","last_undegraded":"2024-09-11T00:15:11.998112+0000","last_fullsized":"2024-09-11T00:15:11.998112+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:48:53.696945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"38'2","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:11.995540+0000","last_change":"2024-09-11T00:15:10.984511+0000","last_active":"2024-09-11T00:15:11.995540+0000","last_peered":"2024-09-11T00:15:11.995540+0000","last_clean":"2024-09-11T00:15:11.995540+0000","last_became_active":"2024-09-11T00:15:10.984234+0000","last_became_peered":"2024-09-11T00:15:10.984234+0000","last_unstale":"2024-09-11T00:15:11.995540+0000","last_undegraded":"2024-09-11T00:15:11.995540+0000","last_fullsized":"2024-09-11T00:15:11.995540+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_clean_scrub_stamp":"2024-09-11T00:15:09.955417+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:36:08.333344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:12.003942+0000","last_change":"2024-09-11T00:15:12.001691+0000","last_active":"2024-09-11T00:15:12.003942+0000","last_peered":"2024-09-11T00:15:12.003942+0000","last_clean":"2024-09-11T00:15:12.003942+0000","last_became_active":"2024-09-11T00:15:12.001180+0000","last_became_peered":"2024-09-11T00:15:12.001180+0000","last_unstale":"2024-09-11T00:15:12.003942+0000","last_undegraded":"2024-09-11T00:15:12.003942+0000","last_fullsized":"2024-09-11T00:15:12.003942+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:16:47.443195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":10,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-11T00:15:10.983339+0000","last_change":"2024-09-11T00:15:10.980366+0000","last_active":"2024-09-11T00:15:10.983339+0000","last_peered":"2024-09-11T00:15:10.983339+0000","last_clean":"2024-09-11T00:15:10.983339+0000","last_became_active":"2024-09-11T00:15:10.980077+0000","last_became_peered":"2024-09-11T00:15:10.980077+0000","last_unstale":"2024-09-11T00:15:10.983339+0000","last_undegraded":"2024-09-11T00:15:10.983339+0000","last_fullsized":"2024-09-11T00:15:10.983339+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_clean_scrub_stamp":"2024-09-11T00:15:09.955417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:15:22.628414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:11.997180+0000","last_change":"2024-09-11T00:15:11.994143+0000","last_active":"2024-09-11T00:15:11.997180+0000","last_peered":"2024-09-11T00:15:11.997180+0000","last_clean":"2024-09-11T00:15:11.997180+0000","last_became_active":"2024-09-11T00:15:11.993393+0000","last_became_peered":"2024-09-11T00:15:11.993393+0000","last_unstale":"2024-09-11T00:15:11.997180+0000","last_undegraded":"2024-09-11T00:15:11.997180+0000","last_fullsized":"2024-09-11T00:15:11.997180+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:49:11.620971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:11.977996+0000","last_change":"2024-09-11T00:15:10.984774+0000","last_active":"2024-09-11T00:15:11.977996+0000","last_peered":"2024-09-11T00:15:11.977996+0000","last_clean":"2024-09-11T00:15:11.977996+0000","last_became_active":"2024-09-11T00:15:10.983875+0000","last_became_peered":"2024-09-11T00:15:10.983875+0000","last_unstale":"2024-09-11T00:15:11.977996+0000","last_undegraded":"2024-09-11T00:15:11.977996+0000","last_fullsized":"2024-09-11T00:15:11.977996+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_clean_scrub_stamp":"2024-09-11T00:15:09.955417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:05:08.232715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:11.993302+0000","last_change":"2024-09-11T00:15:11.988649+0000","last_active":"2024-09-11T00:15:11.993302+0000","last_peered":"2024-09-11T00:15:11.993302+0000","last_clean":"2024-09-11T00:15:11.993302+0000","last_became_active":"2024-09-11T00:15:11.988254+0000","last_became_peered":"2024-09-11T00:15:11.988254+0000","last_unstale":"2024-09-11T00:15:11.993302+0000","last_undegraded":"2024-09-11T00:15:11.993302+0000","last_fullsized":"2024-09-11T00:15:11.993302+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:58:31.383752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:11.979262+0000","last_change":"2024-09-11T00:15:10.984350+0000","last_active":"2024-09-11T00:15:11.979262+0000","last_peered":"2024-09-11T00:15:11.979262+0000","last_clean":"2024-09-11T00:15:11.979262+0000","last_became_active":"2024-09-11T00:15:10.984092+0000","last_became_peered":"2024-09-11T00:15:10.984092+0000","last_unstale":"2024-09-11T00:15:11.979262+0000","last_undegraded":"2024-09-11T00:15:11.979262+0000","last_fullsized":"2024-09-11T00:15:11.979262+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_clean_scrub_stamp":"2024-09-11T00:15:09.955417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:41:46.193502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:11.987168+0000","last_change":"2024-09-11T00:15:11.981492+0000","last_active":"2024-09-11T00:15:11.987168+0000","last_peered":"2024-09-11T00:15:11.987168+0000","last_clean":"2024-09-11T00:15:11.987168+0000","last_became_active":"2024-09-11T00:15:11.981199+0000","last_became_peered":"2024-09-11T00:15:11.981199+0000","last_unstale":"2024-09-11T00:15:11.987168+0000","last_undegraded":"2024-09-11T00:15:11.987168+0000","last_fullsized":"2024-09-11T00:15:11.987168+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:58:31.383752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-09-11T00:15:09.965689+0000","last_change":"2024-09-11T00:15:09.965689+0000","last_active":"2024-09-11T00:15:09.955417+0000","last_peered":"2024-09-11T00:15:09.955417+0000","last_clean":"2024-09-11T00:15:09.955417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:15:09.965689+0000","last_undegraded":"2024-09-11T00:15:09.965689+0000","last_fullsized":"2024-09-11T00:15:09.965689+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_clean_scrub_stamp":"2024-09-11T00:15:09.955417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:12.002886+0000","last_change":"2024-09-11T00:15:11.999345+0000","last_active":"2024-09-11T00:15:12.002886+0000","last_peered":"2024-09-11T00:15:12.002886+0000","last_clean":"2024-09-11T00:15:12.002886+0000","last_became_active":"2024-09-11T00:15:11.999031+0000","last_became_peered":"2024-09-11T00:15:11.999031+0000","last_unstale":"2024-09-11T00:15:12.002886+0000","last_undegraded":"2024-09-11T00:15:12.002886+0000","last_fullsized":"2024-09-11T00:15:12.002886+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:28:22.582823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:11.984760+0000","last_change":"2024-09-11T00:15:10.983535+0000","last_active":"2024-09-11T00:15:11.984760+0000","last_peered":"2024-09-11T00:15:11.984760+0000","last_clean":"2024-09-11T00:15:11.984760+0000","last_became_active":"2024-09-11T00:15:10.983265+0000","last_became_peered":"2024-09-11T00:15:10.983265+0000","last_unstale":"2024-09-11T00:15:11.984760+0000","last_undegraded":"2024-09-11T00:15:11.984760+0000","last_fullsized":"2024-09-11T00:15:11.984760+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_clean_scrub_stamp":"2024-09-11T00:15:09.955417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:46:54.895627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:12.004119+0000","last_change":"2024-09-11T00:15:12.001186+0000","last_active":"2024-09-11T00:15:12.004119+0000","last_peered":"2024-09-11T00:15:12.004119+0000","last_clean":"2024-09-11T00:15:12.004119+0000","last_became_active":"2024-09-11T00:15:11.998947+0000","last_became_peered":"2024-09-11T00:15:11.998947+0000","last_unstale":"2024-09-11T00:15:12.004119+0000","last_undegraded":"2024-09-11T00:15:12.004119+0000","last_fullsized":"2024-09-11T00:15:12.004119+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:48:53.696945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:11.976607+0000","last_change":"2024-09-11T00:15:10.980323+0000","last_active":"2024-09-11T00:15:11.976607+0000","last_peered":"2024-09-11T00:15:11.976607+0000","last_clean":"2024-09-11T00:15:11.976607+0000","last_became_active":"2024-09-11T00:15:10.980050+0000","last_became_peered":"2024-09-11T00:15:10.980050+0000","last_unstale":"2024-09-11T00:15:11.976607+0000","last_undegraded":"2024-09-11T00:15:11.976607+0000","last_fullsized":"2024-09-11T00:15:11.976607+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_clean_scrub_stamp":"2024-09-11T00:15:09.955417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:43:32.387961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:11.998138+0000","last_change":"2024-09-11T00:15:11.989310+0000","last_active":"2024-09-11T00:15:11.998138+0000","last_peered":"2024-09-11T00:15:11.998138+0000","last_clean":"2024-09-11T00:15:11.998138+0000","last_became_active":"2024-09-11T00:15:11.989042+0000","last_became_peered":"2024-09-11T00:15:11.989042+0000","last_unstale":"2024-09-11T00:15:11.998138+0000","last_undegraded":"2024-09-11T00:15:11.998138+0000","last_fullsized":"2024-09-11T00:15:11.998138+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:19:07.626300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:11.988408+0000","last_change":"2024-09-11T00:15:10.984732+0000","last_active":"2024-09-11T00:15:11.988408+0000","last_peered":"2024-09-11T00:15:11.988408+0000","last_clean":"2024-09-11T00:15:11.988408+0000","last_became_active":"2024-09-11T00:15:10.984375+0000","last_became_peered":"2024-09-11T00:15:10.984375+0000","last_unstale":"2024-09-11T00:15:11.988408+0000","last_undegraded":"2024-09-11T00:15:11.988408+0000","last_fullsized":"2024-09-11T00:15:11.988408+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_clean_scrub_stamp":"2024-09-11T00:15:09.955417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:34:50.761829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":143,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:11.985741+0000","last_change":"2024-09-11T00:14:08.221813+0000","last_active":"2024-09-11T00:15:11.985741+0000","last_peered":"2024-09-11T00:15:11.985741+0000","last_clean":"2024-09-11T00:15:11.985741+0000","last_became_active":"2024-09-11T00:14:08.220663+0000","last_became_peered":"2024-09-11T00:14:08.220663+0000","last_unstale":"2024-09-11T00:15:11.985741+0000","last_undegraded":"2024-09-11T00:15:11.985741+0000","last_fullsized":"2024-09-11T00:15:11.985741+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:06.563107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:06.563107+0000","last_clean_scrub_stamp":"2024-09-11T00:14:06.563107+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:44:49.322583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":116,"acting":116,"num_store_stats":7},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1758,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":4168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":31,"ondisk_log_size":31,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509457,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28020,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343820,"statfs":{"total":96636764160,"available":96608071680,"internally_reserved":0,"allocated":1011712,"data_stored":768982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509457,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27460,"kb_used_data":428,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344380,"statfs":{"total":96636764160,"available":96608645120,"internally_reserved":0,"allocated":438272,"data_stored":185893,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509456,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27464,"kb_used_data":428,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344376,"statfs":{"total":96636764160,"available":96608641024,"internally_reserved":0,"allocated":438272,"data_stored":186385,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509456,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27436,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344404,"statfs":{"total":96636764160,"available":96608669696,"internally_reserved":0,"allocated":417792,"data_stored":178614,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509458,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27452,"kb_used_data":424,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344388,"statfs":{"total":96636764160,"available":96608653312,"internally_reserved":0,"allocated":434176,"data_stored":185871,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509457,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28040,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343800,"statfs":{"total":96636764160,"available":96608051200,"internally_reserved":0,"allocated":1028096,"data_stored":776183,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542161,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27424,"kb_used_data":396,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344416,"statfs":{"total":96636764160,"available":96608681984,"internally_reserved":0,"allocated":405504,"data_stored":171947,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574865,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27424,"kb_used_data":396,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344416,"statfs":{"total":96636764160,"available":96608681984,"internally_reserved":0,"allocated":405504,"data_stored":171947,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T00:15:14.959 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T00:15:15.095 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:15.093+0000 7fab218b6640 1 -- 172.21.15.92:0/1623300724 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fab1c0d0a00 msgr2=0x7fab1c070760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:15.095 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:15.093+0000 7fab218b6640 1 --2- 172.21.15.92:0/1623300724 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fab1c0d0a00 0x7fab1c070760 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fab1c0ccb30 tx=0x7fab0402a510 comp rx=0 tx=0).stop 2024-09-11T00:15:15.095 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:15.093+0000 7fab218b6640 1 -- 172.21.15.92:0/1623300724 shutdown_connections 2024-09-11T00:15:15.095 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:15.093+0000 7fab218b6640 1 --2- 172.21.15.92:0/1623300724 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fab1c0d0a00 0x7fab1c070760 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:15.095 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:15.093+0000 7fab218b6640 1 -- 172.21.15.92:0/1623300724 >> 172.21.15.92:0/1623300724 conn(0x7fab1c0d1d10 msgr2=0x7fab1c0d2120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:15:15.095 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:15.093+0000 7fab218b6640 1 -- 172.21.15.92:0/1623300724 shutdown_connections 2024-09-11T00:15:15.096 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:15.093+0000 7fab218b6640 1 -- 172.21.15.92:0/1623300724 wait complete. 2024-09-11T00:15:15.096 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:15.094+0000 7fab218b6640 1 Processor -- start 2024-09-11T00:15:15.096 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:15.094+0000 7fab218b6640 1 -- start start 2024-09-11T00:15:15.098 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:15.095+0000 7fab218b6640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fab1c0d0a00 0x7fab1c0ca820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:15.098 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:15.095+0000 7fab218b6640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fab1c0d2830 0x7fab1c1518c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:15.098 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:15.095+0000 7fab218b6640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fab1c15be00 0x7fab1c0c7850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:15.098 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:15.095+0000 7fab218b6640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fab1c0cfc70 con 0x7fab1c15be00 2024-09-11T00:15:15.098 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:15.095+0000 7fab218b6640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fab1c0cfaf0 con 0x7fab1c0d0a00 2024-09-11T00:15:15.099 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:15.095+0000 7fab218b6640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7fab1c0cfdf0 con 0x7fab1c0d2830 2024-09-11T00:15:15.099 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:15.095+0000 7fab1b7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fab1c15be00 0x7fab1c0c7850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:15.099 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:15.095+0000 7fab1b7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fab1c15be00 0x7fab1c0c7850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:54680/0 (socket says 172.21.15.92:54680) 2024-09-11T00:15:15.099 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:15.095+0000 7fab1b7fe640 1 -- 172.21.15.92:0/142249453 learned_addr learned my addr 172.21.15.92:0/142249453 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-11T00:15:15.099 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:15.096+0000 7fab1affd640 1 --2- 172.21.15.92:0/142249453 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fab1c0d0a00 0x7fab1c0ca820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:15.099 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:15.096+0000 7fab1a7fc640 1 --2- 172.21.15.92:0/142249453 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fab1c0d2830 0x7fab1c1518c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:15.099 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:15.096+0000 7fab1b7fe640 1 -- 172.21.15.92:0/142249453 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fab1c0d2830 msgr2=0x7fab1c1518c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:15.099 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:15.096+0000 7fab1b7fe640 1 --2- 172.21.15.92:0/142249453 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fab1c0d2830 0x7fab1c1518c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:15.099 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:15.096+0000 7fab1b7fe640 1 -- 172.21.15.92:0/142249453 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fab1c0d0a00 msgr2=0x7fab1c0ca820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:15.099 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:15.096+0000 7fab1b7fe640 1 --2- 172.21.15.92:0/142249453 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fab1c0d0a00 0x7fab1c0ca820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:15.099 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:15.096+0000 7fab1b7fe640 1 -- 172.21.15.92:0/142249453 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab1c0cad60 con 0x7fab1c15be00 2024-09-11T00:15:15.099 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:15.096+0000 7fab1affd640 1 --2- 172.21.15.92:0/142249453 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fab1c0d0a00 0x7fab1c0ca820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:15:15.099 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:15.096+0000 7fab1b7fe640 1 --2- 172.21.15.92:0/142249453 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fab1c15be00 0x7fab1c0c7850 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fab0c00c390 tx=0x7fab0c00c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:15:15.100 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:15.096+0000 7fab13fff640 1 -- 172.21.15.92:0/142249453 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab0c017070 con 0x7fab1c15be00 2024-09-11T00:15:15.100 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:15.096+0000 7fab13fff640 1 -- 172.21.15.92:0/142249453 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fab0c0035f0 con 0x7fab1c15be00 2024-09-11T00:15:15.100 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:15.096+0000 7fab218b6640 1 -- 172.21.15.92:0/142249453 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fab1c1f67b0 con 0x7fab1c15be00 2024-09-11T00:15:15.100 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:15.096+0000 7fab13fff640 1 -- 172.21.15.92:0/142249453 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab0c003a40 con 0x7fab1c15be00 2024-09-11T00:15:15.100 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:15.096+0000 7fab218b6640 1 -- 172.21.15.92:0/142249453 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fab1c1f6a50 con 0x7fab1c15be00 2024-09-11T00:15:15.101 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:15.097+0000 7fab218b6640 1 -- 172.21.15.92:0/142249453 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fab1c0cd880 con 0x7fab1c15be00 2024-09-11T00:15:15.101 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:15.098+0000 7fab13fff640 1 -- 172.21.15.92:0/142249453 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fab0c003be0 con 0x7fab1c15be00 2024-09-11T00:15:15.101 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:15.098+0000 7fab13fff640 1 --2- 172.21.15.92:0/142249453 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7faafc077f70 0x7faafc07a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:15.101 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:15.098+0000 7fab13fff640 1 -- 172.21.15.92:0/142249453 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7fab0c0994a0 con 0x7fab1c15be00 2024-09-11T00:15:15.101 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:15.098+0000 7fab1affd640 1 --2- 172.21.15.92:0/142249453 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7faafc077f70 0x7faafc07a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:15.101 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:15.099+0000 7fab1affd640 1 --2- 172.21.15.92:0/142249453 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7faafc077f70 0x7faafc07a430 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fab140020f0 tx=0x7fab14009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:15:15.103 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:15.102+0000 7fab13fff640 1 -- 172.21.15.92:0/142249453 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fab1c0cad60 con 0x7fab1c15be00 2024-09-11T00:15:15.276 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:15.275+0000 7fab218b6640 1 -- 172.21.15.92:0/142249453 --> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fab1c0c8ba0 con 0x7faafc077f70 2024-09-11T00:15:15.281 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:15.279+0000 7fab13fff640 1 -- 172.21.15.92:0/142249453 <== mgr.4100 v2:172.21.15.145:6800/325490785 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+250277 (secure 0 0 0) 0x7fab1c0c8ba0 con 0x7faafc077f70 2024-09-11T00:15:15.283 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:15:15.285 INFO:teuthology.orchestra.run.smithi092.stderr:dumped all 2024-09-11T00:15:15.287 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:15.282+0000 7fab218b6640 1 -- 172.21.15.92:0/142249453 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7faafc077f70 msgr2=0x7faafc07a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:15.287 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:15.282+0000 7fab218b6640 1 --2- 172.21.15.92:0/142249453 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7faafc077f70 0x7faafc07a430 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fab140020f0 tx=0x7fab14009040 comp rx=0 tx=0).stop 2024-09-11T00:15:15.287 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:15.282+0000 7fab218b6640 1 -- 172.21.15.92:0/142249453 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fab1c15be00 msgr2=0x7fab1c0c7850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:15.287 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:15.282+0000 7fab218b6640 1 --2- 172.21.15.92:0/142249453 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fab1c15be00 0x7fab1c0c7850 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fab0c00c390 tx=0x7fab0c00c850 comp rx=0 tx=0).stop 2024-09-11T00:15:15.287 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:15.282+0000 7fab218b6640 1 -- 172.21.15.92:0/142249453 shutdown_connections 2024-09-11T00:15:15.288 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:15.282+0000 7fab218b6640 1 --2- 172.21.15.92:0/142249453 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7faafc077f70 0x7faafc07a430 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:15.288 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:15.283+0000 7fab218b6640 1 --2- 172.21.15.92:0/142249453 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fab1c15be00 0x7fab1c0c7850 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:15.288 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:15.283+0000 7fab218b6640 1 --2- 172.21.15.92:0/142249453 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fab1c0d2830 0x7fab1c1518c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:15.288 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:15.283+0000 7fab218b6640 1 --2- 172.21.15.92:0/142249453 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fab1c0d0a00 0x7fab1c0ca820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:15.288 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:15.283+0000 7fab218b6640 1 -- 172.21.15.92:0/142249453 >> 172.21.15.92:0/142249453 conn(0x7fab1c0d1d10 msgr2=0x7fab1c0ce1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:15:15.288 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:15.283+0000 7fab218b6640 1 -- 172.21.15.92:0/142249453 shutdown_connections 2024-09-11T00:15:15.288 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:15.283+0000 7fab218b6640 1 -- 172.21.15.92:0/142249453 wait complete. 2024-09-11T00:15:15.295 INFO:teuthology.orchestra.run.smithi092.stdout:{"pg_ready":true,"pg_map":{"version":67,"stamp":"2024-09-11T00:15:14.286766+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592126,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":139,"num_write_kb":1640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":103,"ondisk_log_size":103,"up":182,"acting":182,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":5,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220720,"kb_used_data":4472,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754000,"statfs":{"total":773094113280,"available":772868096000,"internally_reserved":0,"allocated":4579328,"data_stored":2625822,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":26,"apply_latency_ms":26,"commit_latency_ns":26000000,"apply_latency_ns":26000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1758,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.324271"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:11.996813+0000","last_change":"2024-09-11T00:15:11.990745+0000","last_active":"2024-09-11T00:15:11.996813+0000","last_peered":"2024-09-11T00:15:11.996813+0000","last_clean":"2024-09-11T00:15:11.996813+0000","last_became_active":"2024-09-11T00:15:11.990485+0000","last_became_peered":"2024-09-11T00:15:11.990485+0000","last_unstale":"2024-09-11T00:15:11.996813+0000","last_undegraded":"2024-09-11T00:15:11.996813+0000","last_fullsized":"2024-09-11T00:15:11.996813+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:14:44.693719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:11.996830+0000","last_change":"2024-09-11T00:15:11.989933+0000","last_active":"2024-09-11T00:15:11.996830+0000","last_peered":"2024-09-11T00:15:11.996830+0000","last_clean":"2024-09-11T00:15:11.996830+0000","last_became_active":"2024-09-11T00:15:11.989547+0000","last_became_peered":"2024-09-11T00:15:11.989547+0000","last_unstale":"2024-09-11T00:15:11.996830+0000","last_undegraded":"2024-09-11T00:15:11.996830+0000","last_fullsized":"2024-09-11T00:15:11.996830+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:38:48.432712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:11.999391+0000","last_change":"2024-09-11T00:15:11.996802+0000","last_active":"2024-09-11T00:15:11.999391+0000","last_peered":"2024-09-11T00:15:11.999391+0000","last_clean":"2024-09-11T00:15:11.999391+0000","last_became_active":"2024-09-11T00:15:11.996464+0000","last_became_peered":"2024-09-11T00:15:11.996464+0000","last_unstale":"2024-09-11T00:15:11.999391+0000","last_undegraded":"2024-09-11T00:15:11.999391+0000","last_fullsized":"2024-09-11T00:15:11.999391+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:48:53.696945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-11T00:15:10.973081+0000","last_change":"2024-09-11T00:15:10.973081+0000","last_active":"2024-09-11T00:15:10.961693+0000","last_peered":"2024-09-11T00:15:10.961693+0000","last_clean":"2024-09-11T00:15:10.961693+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:15:10.973081+0000","last_undegraded":"2024-09-11T00:15:10.973081+0000","last_fullsized":"2024-09-11T00:15:10.973081+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-11T00:15:10.972932+0000","last_change":"2024-09-11T00:15:10.972932+0000","last_active":"2024-09-11T00:15:10.961693+0000","last_peered":"2024-09-11T00:15:10.961693+0000","last_clean":"2024-09-11T00:15:10.961693+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:15:10.972932+0000","last_undegraded":"2024-09-11T00:15:10.972932+0000","last_fullsized":"2024-09-11T00:15:10.972932+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:11.987916+0000","last_change":"2024-09-11T00:15:11.981800+0000","last_active":"2024-09-11T00:15:11.987916+0000","last_peered":"2024-09-11T00:15:11.987916+0000","last_clean":"2024-09-11T00:15:11.987916+0000","last_became_active":"2024-09-11T00:15:11.981553+0000","last_became_peered":"2024-09-11T00:15:11.981553+0000","last_unstale":"2024-09-11T00:15:11.987916+0000","last_undegraded":"2024-09-11T00:15:11.987916+0000","last_fullsized":"2024-09-11T00:15:11.987916+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:28:04.414078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:11.995625+0000","last_change":"2024-09-11T00:15:11.985908+0000","last_active":"2024-09-11T00:15:11.995625+0000","last_peered":"2024-09-11T00:15:11.995625+0000","last_clean":"2024-09-11T00:15:11.995625+0000","last_became_active":"2024-09-11T00:15:11.983107+0000","last_became_peered":"2024-09-11T00:15:11.983107+0000","last_unstale":"2024-09-11T00:15:11.995625+0000","last_undegraded":"2024-09-11T00:15:11.995625+0000","last_fullsized":"2024-09-11T00:15:11.995625+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:41:28.124141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:11.996966+0000","last_change":"2024-09-11T00:15:11.991693+0000","last_active":"2024-09-11T00:15:11.996966+0000","last_peered":"2024-09-11T00:15:11.996966+0000","last_clean":"2024-09-11T00:15:11.996966+0000","last_became_active":"2024-09-11T00:15:11.991452+0000","last_became_peered":"2024-09-11T00:15:11.991452+0000","last_unstale":"2024-09-11T00:15:11.996966+0000","last_undegraded":"2024-09-11T00:15:11.996966+0000","last_fullsized":"2024-09-11T00:15:11.996966+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:19:07.626300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:11.999360+0000","last_change":"2024-09-11T00:15:11.996272+0000","last_active":"2024-09-11T00:15:11.999360+0000","last_peered":"2024-09-11T00:15:11.999360+0000","last_clean":"2024-09-11T00:15:11.999360+0000","last_became_active":"2024-09-11T00:15:11.996016+0000","last_became_peered":"2024-09-11T00:15:11.996016+0000","last_unstale":"2024-09-11T00:15:11.999360+0000","last_undegraded":"2024-09-11T00:15:11.999360+0000","last_fullsized":"2024-09-11T00:15:11.999360+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:16:47.443195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:12.004395+0000","last_change":"2024-09-11T00:15:12.000547+0000","last_active":"2024-09-11T00:15:12.004395+0000","last_peered":"2024-09-11T00:15:12.004395+0000","last_clean":"2024-09-11T00:15:12.004395+0000","last_became_active":"2024-09-11T00:15:12.000275+0000","last_became_peered":"2024-09-11T00:15:12.000275+0000","last_unstale":"2024-09-11T00:15:12.004395+0000","last_undegraded":"2024-09-11T00:15:12.004395+0000","last_fullsized":"2024-09-11T00:15:12.004395+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:49:11.620971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:11.998030+0000","last_change":"2024-09-11T00:15:11.991652+0000","last_active":"2024-09-11T00:15:11.998030+0000","last_peered":"2024-09-11T00:15:11.998030+0000","last_clean":"2024-09-11T00:15:11.998030+0000","last_became_active":"2024-09-11T00:15:11.990905+0000","last_became_peered":"2024-09-11T00:15:11.990905+0000","last_unstale":"2024-09-11T00:15:11.998030+0000","last_undegraded":"2024-09-11T00:15:11.998030+0000","last_fullsized":"2024-09-11T00:15:11.998030+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:14:44.693719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:11.988524+0000","last_change":"2024-09-11T00:15:11.984051+0000","last_active":"2024-09-11T00:15:11.988524+0000","last_peered":"2024-09-11T00:15:11.988524+0000","last_clean":"2024-09-11T00:15:11.988524+0000","last_became_active":"2024-09-11T00:15:11.983773+0000","last_became_peered":"2024-09-11T00:15:11.983773+0000","last_unstale":"2024-09-11T00:15:11.988524+0000","last_undegraded":"2024-09-11T00:15:11.988524+0000","last_fullsized":"2024-09-11T00:15:11.988524+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:34:51.768105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:12.003723+0000","last_change":"2024-09-11T00:15:12.000158+0000","last_active":"2024-09-11T00:15:12.003723+0000","last_peered":"2024-09-11T00:15:12.003723+0000","last_clean":"2024-09-11T00:15:12.003723+0000","last_became_active":"2024-09-11T00:15:11.999876+0000","last_became_peered":"2024-09-11T00:15:11.999876+0000","last_unstale":"2024-09-11T00:15:12.003723+0000","last_undegraded":"2024-09-11T00:15:12.003723+0000","last_fullsized":"2024-09-11T00:15:12.003723+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:51:23.369565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:11.999202+0000","last_change":"2024-09-11T00:15:11.990614+0000","last_active":"2024-09-11T00:15:11.999202+0000","last_peered":"2024-09-11T00:15:11.999202+0000","last_clean":"2024-09-11T00:15:11.999202+0000","last_became_active":"2024-09-11T00:15:11.990346+0000","last_became_peered":"2024-09-11T00:15:11.990346+0000","last_unstale":"2024-09-11T00:15:11.999202+0000","last_undegraded":"2024-09-11T00:15:11.999202+0000","last_fullsized":"2024-09-11T00:15:11.999202+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:29:18.376105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:11.995647+0000","last_change":"2024-09-11T00:15:11.986763+0000","last_active":"2024-09-11T00:15:11.995647+0000","last_peered":"2024-09-11T00:15:11.995647+0000","last_clean":"2024-09-11T00:15:11.995647+0000","last_became_active":"2024-09-11T00:15:11.986468+0000","last_became_peered":"2024-09-11T00:15:11.986468+0000","last_unstale":"2024-09-11T00:15:11.995647+0000","last_undegraded":"2024-09-11T00:15:11.995647+0000","last_fullsized":"2024-09-11T00:15:11.995647+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:59:36.084840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:12.009647+0000","last_change":"2024-09-11T00:15:12.005753+0000","last_active":"2024-09-11T00:15:12.009647+0000","last_peered":"2024-09-11T00:15:12.009647+0000","last_clean":"2024-09-11T00:15:12.009647+0000","last_became_active":"2024-09-11T00:15:12.005460+0000","last_became_peered":"2024-09-11T00:15:12.005460+0000","last_unstale":"2024-09-11T00:15:12.009647+0000","last_undegraded":"2024-09-11T00:15:12.009647+0000","last_fullsized":"2024-09-11T00:15:12.009647+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:56:07.914915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:12.009660+0000","last_change":"2024-09-11T00:15:12.005879+0000","last_active":"2024-09-11T00:15:12.009660+0000","last_peered":"2024-09-11T00:15:12.009660+0000","last_clean":"2024-09-11T00:15:12.009660+0000","last_became_active":"2024-09-11T00:15:12.005591+0000","last_became_peered":"2024-09-11T00:15:12.005591+0000","last_unstale":"2024-09-11T00:15:12.009660+0000","last_undegraded":"2024-09-11T00:15:12.009660+0000","last_fullsized":"2024-09-11T00:15:12.009660+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:58:17.603588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T00:15:10.961693+0000","last_change":"2024-09-11T00:15:10.961693+0000","last_active":"2024-09-11T00:15:10.961693+0000","last_peered":"2024-09-11T00:15:10.961693+0000","last_clean":"2024-09-11T00:15:10.961693+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:15:10.961693+0000","last_undegraded":"2024-09-11T00:15:10.961693+0000","last_fullsized":"2024-09-11T00:15:10.961693+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-11T00:15:10.972624+0000","last_change":"2024-09-11T00:15:10.972624+0000","last_active":"2024-09-11T00:15:10.961693+0000","last_peered":"2024-09-11T00:15:10.961693+0000","last_clean":"2024-09-11T00:15:10.961693+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:15:10.972624+0000","last_undegraded":"2024-09-11T00:15:10.972624+0000","last_fullsized":"2024-09-11T00:15:10.972624+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T00:15:10.961693+0000","last_change":"2024-09-11T00:15:10.961693+0000","last_active":"2024-09-11T00:15:10.961693+0000","last_peered":"2024-09-11T00:15:10.961693+0000","last_clean":"2024-09-11T00:15:10.961693+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:15:10.961693+0000","last_undegraded":"2024-09-11T00:15:10.961693+0000","last_fullsized":"2024-09-11T00:15:10.961693+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:11.995476+0000","last_change":"2024-09-11T00:15:11.982721+0000","last_active":"2024-09-11T00:15:11.995476+0000","last_peered":"2024-09-11T00:15:11.995476+0000","last_clean":"2024-09-11T00:15:11.995476+0000","last_became_active":"2024-09-11T00:15:11.981979+0000","last_became_peered":"2024-09-11T00:15:11.981979+0000","last_unstale":"2024-09-11T00:15:11.995476+0000","last_undegraded":"2024-09-11T00:15:11.995476+0000","last_fullsized":"2024-09-11T00:15:11.995476+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:29:04.812424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:12.001333+0000","last_change":"2024-09-11T00:15:11.996951+0000","last_active":"2024-09-11T00:15:12.001333+0000","last_peered":"2024-09-11T00:15:12.001333+0000","last_clean":"2024-09-11T00:15:12.001333+0000","last_became_active":"2024-09-11T00:15:11.996664+0000","last_became_peered":"2024-09-11T00:15:11.996664+0000","last_unstale":"2024-09-11T00:15:12.001333+0000","last_undegraded":"2024-09-11T00:15:12.001333+0000","last_fullsized":"2024-09-11T00:15:12.001333+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:30:48.631902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:12.009565+0000","last_change":"2024-09-11T00:15:12.004148+0000","last_active":"2024-09-11T00:15:12.009565+0000","last_peered":"2024-09-11T00:15:12.009565+0000","last_clean":"2024-09-11T00:15:12.009565+0000","last_became_active":"2024-09-11T00:15:12.003829+0000","last_became_peered":"2024-09-11T00:15:12.003829+0000","last_unstale":"2024-09-11T00:15:12.009565+0000","last_undegraded":"2024-09-11T00:15:12.009565+0000","last_fullsized":"2024-09-11T00:15:12.009565+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:43:33.394237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-11T00:15:10.972983+0000","last_change":"2024-09-11T00:15:10.972983+0000","last_active":"2024-09-11T00:15:10.961693+0000","last_peered":"2024-09-11T00:15:10.961693+0000","last_clean":"2024-09-11T00:15:10.961693+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:15:10.972983+0000","last_undegraded":"2024-09-11T00:15:10.972983+0000","last_fullsized":"2024-09-11T00:15:10.972983+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T00:15:10.961693+0000","last_change":"2024-09-11T00:15:10.961693+0000","last_active":"2024-09-11T00:15:10.961693+0000","last_peered":"2024-09-11T00:15:10.961693+0000","last_clean":"2024-09-11T00:15:10.961693+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:15:10.961693+0000","last_undegraded":"2024-09-11T00:15:10.961693+0000","last_fullsized":"2024-09-11T00:15:10.961693+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:11.997420+0000","last_change":"2024-09-11T00:15:11.990612+0000","last_active":"2024-09-11T00:15:11.997420+0000","last_peered":"2024-09-11T00:15:11.997420+0000","last_clean":"2024-09-11T00:15:11.997420+0000","last_became_active":"2024-09-11T00:15:11.989737+0000","last_became_peered":"2024-09-11T00:15:11.989737+0000","last_unstale":"2024-09-11T00:15:11.997420+0000","last_undegraded":"2024-09-11T00:15:11.997420+0000","last_fullsized":"2024-09-11T00:15:11.997420+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:16:47.443195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T00:15:10.961693+0000","last_change":"2024-09-11T00:15:10.961693+0000","last_active":"2024-09-11T00:15:10.961693+0000","last_peered":"2024-09-11T00:15:10.961693+0000","last_clean":"2024-09-11T00:15:10.961693+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:15:10.961693+0000","last_undegraded":"2024-09-11T00:15:10.961693+0000","last_fullsized":"2024-09-11T00:15:10.961693+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:11.995375+0000","last_change":"2024-09-11T00:15:11.984503+0000","last_active":"2024-09-11T00:15:11.995375+0000","last_peered":"2024-09-11T00:15:11.995375+0000","last_clean":"2024-09-11T00:15:11.995375+0000","last_became_active":"2024-09-11T00:15:11.984226+0000","last_became_peered":"2024-09-11T00:15:11.984226+0000","last_unstale":"2024-09-11T00:15:11.995375+0000","last_undegraded":"2024-09-11T00:15:11.995375+0000","last_fullsized":"2024-09-11T00:15:11.995375+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:58:17.603588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T00:15:10.961693+0000","last_change":"2024-09-11T00:15:10.961693+0000","last_active":"2024-09-11T00:15:10.961693+0000","last_peered":"2024-09-11T00:15:10.961693+0000","last_clean":"2024-09-11T00:15:10.961693+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:15:10.961693+0000","last_undegraded":"2024-09-11T00:15:10.961693+0000","last_fullsized":"2024-09-11T00:15:10.961693+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T00:15:10.961693+0000","last_change":"2024-09-11T00:15:10.961693+0000","last_active":"2024-09-11T00:15:10.961693+0000","last_peered":"2024-09-11T00:15:10.961693+0000","last_clean":"2024-09-11T00:15:10.961693+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:15:10.961693+0000","last_undegraded":"2024-09-11T00:15:10.961693+0000","last_fullsized":"2024-09-11T00:15:10.961693+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:12.009620+0000","last_change":"2024-09-11T00:15:12.005579+0000","last_active":"2024-09-11T00:15:12.009620+0000","last_peered":"2024-09-11T00:15:12.009620+0000","last_clean":"2024-09-11T00:15:12.009620+0000","last_became_active":"2024-09-11T00:15:12.004267+0000","last_became_peered":"2024-09-11T00:15:12.004267+0000","last_unstale":"2024-09-11T00:15:12.009620+0000","last_undegraded":"2024-09-11T00:15:12.009620+0000","last_fullsized":"2024-09-11T00:15:12.009620+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:21:58.807270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:11.990529+0000","last_change":"2024-09-11T00:15:11.984826+0000","last_active":"2024-09-11T00:15:11.990529+0000","last_peered":"2024-09-11T00:15:11.990529+0000","last_clean":"2024-09-11T00:15:11.990529+0000","last_became_active":"2024-09-11T00:15:11.984307+0000","last_became_peered":"2024-09-11T00:15:11.984307+0000","last_unstale":"2024-09-11T00:15:11.990529+0000","last_undegraded":"2024-09-11T00:15:11.990529+0000","last_fullsized":"2024-09-11T00:15:11.990529+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:27:00.007857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:12.009626+0000","last_change":"2024-09-11T00:15:12.005723+0000","last_active":"2024-09-11T00:15:12.009626+0000","last_peered":"2024-09-11T00:15:12.009626+0000","last_clean":"2024-09-11T00:15:12.009626+0000","last_became_active":"2024-09-11T00:15:12.005398+0000","last_became_peered":"2024-09-11T00:15:12.005398+0000","last_unstale":"2024-09-11T00:15:12.009626+0000","last_undegraded":"2024-09-11T00:15:12.009626+0000","last_fullsized":"2024-09-11T00:15:12.009626+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:29:04.812424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-09-11T00:15:09.965757+0000","last_change":"2024-09-11T00:15:09.965757+0000","last_active":"2024-09-11T00:15:09.955417+0000","last_peered":"2024-09-11T00:15:09.955417+0000","last_clean":"2024-09-11T00:15:09.955417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:15:09.965757+0000","last_undegraded":"2024-09-11T00:15:09.965757+0000","last_fullsized":"2024-09-11T00:15:09.965757+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_clean_scrub_stamp":"2024-09-11T00:15:09.955417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:11.998169+0000","last_change":"2024-09-11T00:15:11.994104+0000","last_active":"2024-09-11T00:15:11.998169+0000","last_peered":"2024-09-11T00:15:11.998169+0000","last_clean":"2024-09-11T00:15:11.998169+0000","last_became_active":"2024-09-11T00:15:11.993787+0000","last_became_peered":"2024-09-11T00:15:11.993787+0000","last_unstale":"2024-09-11T00:15:11.998169+0000","last_undegraded":"2024-09-11T00:15:11.998169+0000","last_fullsized":"2024-09-11T00:15:11.998169+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:36:09.339619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"38'1","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:12.003434+0000","last_change":"2024-09-11T00:15:10.987651+0000","last_active":"2024-09-11T00:15:12.003434+0000","last_peered":"2024-09-11T00:15:12.003434+0000","last_clean":"2024-09-11T00:15:12.003434+0000","last_became_active":"2024-09-11T00:15:10.987365+0000","last_became_peered":"2024-09-11T00:15:10.987365+0000","last_unstale":"2024-09-11T00:15:12.003434+0000","last_undegraded":"2024-09-11T00:15:12.003434+0000","last_fullsized":"2024-09-11T00:15:12.003434+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_clean_scrub_stamp":"2024-09-11T00:15:09.955417+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:53:21.168815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:11.997253+0000","last_change":"2024-09-11T00:15:11.989911+0000","last_active":"2024-09-11T00:15:11.997253+0000","last_peered":"2024-09-11T00:15:11.997253+0000","last_clean":"2024-09-11T00:15:11.997253+0000","last_became_active":"2024-09-11T00:15:11.989434+0000","last_became_peered":"2024-09-11T00:15:11.989434+0000","last_unstale":"2024-09-11T00:15:11.997253+0000","last_undegraded":"2024-09-11T00:15:11.997253+0000","last_fullsized":"2024-09-11T00:15:11.997253+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:09:53.019331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"38'2","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:11.997740+0000","last_change":"2024-09-11T00:15:10.988735+0000","last_active":"2024-09-11T00:15:11.997740+0000","last_peered":"2024-09-11T00:15:11.997740+0000","last_clean":"2024-09-11T00:15:11.997740+0000","last_became_active":"2024-09-11T00:15:10.988449+0000","last_became_peered":"2024-09-11T00:15:10.988449+0000","last_unstale":"2024-09-11T00:15:11.997740+0000","last_undegraded":"2024-09-11T00:15:11.997740+0000","last_fullsized":"2024-09-11T00:15:11.997740+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_clean_scrub_stamp":"2024-09-11T00:15:09.955417+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:34:50.761829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:11.995258+0000","last_change":"2024-09-11T00:15:11.988181+0000","last_active":"2024-09-11T00:15:11.995258+0000","last_peered":"2024-09-11T00:15:11.995258+0000","last_clean":"2024-09-11T00:15:11.995258+0000","last_became_active":"2024-09-11T00:15:11.987724+0000","last_became_peered":"2024-09-11T00:15:11.987724+0000","last_unstale":"2024-09-11T00:15:11.995258+0000","last_undegraded":"2024-09-11T00:15:11.995258+0000","last_fullsized":"2024-09-11T00:15:11.995258+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:59:36.084840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"38'2","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:11.998938+0000","last_change":"2024-09-11T00:15:10.983607+0000","last_active":"2024-09-11T00:15:11.998938+0000","last_peered":"2024-09-11T00:15:11.998938+0000","last_clean":"2024-09-11T00:15:11.998938+0000","last_became_active":"2024-09-11T00:15:10.983327+0000","last_became_peered":"2024-09-11T00:15:10.983327+0000","last_unstale":"2024-09-11T00:15:11.998938+0000","last_undegraded":"2024-09-11T00:15:11.998938+0000","last_fullsized":"2024-09-11T00:15:11.998938+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_clean_scrub_stamp":"2024-09-11T00:15:09.955417+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:25:22.909623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:11.993330+0000","last_change":"2024-09-11T00:15:11.990149+0000","last_active":"2024-09-11T00:15:11.993330+0000","last_peered":"2024-09-11T00:15:11.993330+0000","last_clean":"2024-09-11T00:15:11.993330+0000","last_became_active":"2024-09-11T00:15:11.989909+0000","last_became_peered":"2024-09-11T00:15:11.989909+0000","last_unstale":"2024-09-11T00:15:11.993330+0000","last_undegraded":"2024-09-11T00:15:11.993330+0000","last_fullsized":"2024-09-11T00:15:11.993330+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:28:04.414078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"38'1","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:11.995511+0000","last_change":"2024-09-11T00:15:10.984669+0000","last_active":"2024-09-11T00:15:11.995511+0000","last_peered":"2024-09-11T00:15:11.995511+0000","last_clean":"2024-09-11T00:15:11.995511+0000","last_became_active":"2024-09-11T00:15:10.984215+0000","last_became_peered":"2024-09-11T00:15:10.984215+0000","last_unstale":"2024-09-11T00:15:11.995511+0000","last_undegraded":"2024-09-11T00:15:11.995511+0000","last_fullsized":"2024-09-11T00:15:11.995511+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_clean_scrub_stamp":"2024-09-11T00:15:09.955417+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:28:03.407802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:11.995599+0000","last_change":"2024-09-11T00:15:11.982642+0000","last_active":"2024-09-11T00:15:11.995599+0000","last_peered":"2024-09-11T00:15:11.995599+0000","last_clean":"2024-09-11T00:15:11.995599+0000","last_became_active":"2024-09-11T00:15:11.982021+0000","last_became_peered":"2024-09-11T00:15:11.982021+0000","last_unstale":"2024-09-11T00:15:11.995599+0000","last_undegraded":"2024-09-11T00:15:11.995599+0000","last_fullsized":"2024-09-11T00:15:11.995599+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:21:58.807270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"38'1","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:12.003994+0000","last_change":"2024-09-11T00:15:10.987655+0000","last_active":"2024-09-11T00:15:12.003994+0000","last_peered":"2024-09-11T00:15:12.003994+0000","last_clean":"2024-09-11T00:15:12.003994+0000","last_became_active":"2024-09-11T00:15:10.987373+0000","last_became_peered":"2024-09-11T00:15:10.987373+0000","last_unstale":"2024-09-11T00:15:12.003994+0000","last_undegraded":"2024-09-11T00:15:12.003994+0000","last_fullsized":"2024-09-11T00:15:12.003994+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_clean_scrub_stamp":"2024-09-11T00:15:09.955417+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:41:46.193502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:12.002915+0000","last_change":"2024-09-11T00:15:12.000133+0000","last_active":"2024-09-11T00:15:12.002915+0000","last_peered":"2024-09-11T00:15:12.002915+0000","last_clean":"2024-09-11T00:15:12.002915+0000","last_became_active":"2024-09-11T00:15:11.999840+0000","last_became_peered":"2024-09-11T00:15:11.999840+0000","last_unstale":"2024-09-11T00:15:12.002915+0000","last_undegraded":"2024-09-11T00:15:12.002915+0000","last_fullsized":"2024-09-11T00:15:12.002915+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:16:37.462915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:11.975235+0000","last_change":"2024-09-11T00:15:10.987183+0000","last_active":"2024-09-11T00:15:11.975235+0000","last_peered":"2024-09-11T00:15:11.975235+0000","last_clean":"2024-09-11T00:15:11.975235+0000","last_became_active":"2024-09-11T00:15:10.986886+0000","last_became_peered":"2024-09-11T00:15:10.986886+0000","last_unstale":"2024-09-11T00:15:11.975235+0000","last_undegraded":"2024-09-11T00:15:11.975235+0000","last_fullsized":"2024-09-11T00:15:11.975235+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_clean_scrub_stamp":"2024-09-11T00:15:09.955417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:57:48.764730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:12.008243+0000","last_change":"2024-09-11T00:15:12.002956+0000","last_active":"2024-09-11T00:15:12.008243+0000","last_peered":"2024-09-11T00:15:12.008243+0000","last_clean":"2024-09-11T00:15:12.008243+0000","last_became_active":"2024-09-11T00:15:12.002703+0000","last_became_peered":"2024-09-11T00:15:12.002703+0000","last_unstale":"2024-09-11T00:15:12.008243+0000","last_undegraded":"2024-09-11T00:15:12.008243+0000","last_fullsized":"2024-09-11T00:15:12.008243+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:10:10.614680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:11.982026+0000","last_change":"2024-09-11T00:15:10.977955+0000","last_active":"2024-09-11T00:15:11.982026+0000","last_peered":"2024-09-11T00:15:11.982026+0000","last_clean":"2024-09-11T00:15:11.982026+0000","last_became_active":"2024-09-11T00:15:10.977692+0000","last_became_peered":"2024-09-11T00:15:10.977692+0000","last_unstale":"2024-09-11T00:15:11.982026+0000","last_undegraded":"2024-09-11T00:15:11.982026+0000","last_fullsized":"2024-09-11T00:15:11.982026+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_clean_scrub_stamp":"2024-09-11T00:15:09.955417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:29:56.077160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-11T00:15:10.972569+0000","last_change":"2024-09-11T00:15:10.972569+0000","last_active":"2024-09-11T00:15:10.961693+0000","last_peered":"2024-09-11T00:15:10.961693+0000","last_clean":"2024-09-11T00:15:10.961693+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:15:10.972569+0000","last_undegraded":"2024-09-11T00:15:10.972569+0000","last_fullsized":"2024-09-11T00:15:10.972569+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:11.979505+0000","last_change":"2024-09-11T00:15:10.980706+0000","last_active":"2024-09-11T00:15:11.979505+0000","last_peered":"2024-09-11T00:15:11.979505+0000","last_clean":"2024-09-11T00:15:11.979505+0000","last_became_active":"2024-09-11T00:15:10.980429+0000","last_became_peered":"2024-09-11T00:15:10.980429+0000","last_unstale":"2024-09-11T00:15:11.979505+0000","last_undegraded":"2024-09-11T00:15:11.979505+0000","last_fullsized":"2024-09-11T00:15:11.979505+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_clean_scrub_stamp":"2024-09-11T00:15:09.955417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:21:57.800994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:12.003909+0000","last_change":"2024-09-11T00:15:12.001080+0000","last_active":"2024-09-11T00:15:12.003909+0000","last_peered":"2024-09-11T00:15:12.003909+0000","last_clean":"2024-09-11T00:15:12.003909+0000","last_became_active":"2024-09-11T00:15:11.998765+0000","last_became_peered":"2024-09-11T00:15:11.998765+0000","last_unstale":"2024-09-11T00:15:12.003909+0000","last_undegraded":"2024-09-11T00:15:12.003909+0000","last_fullsized":"2024-09-11T00:15:12.003909+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:27:00.007857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:11.975780+0000","last_change":"2024-09-11T00:15:10.987659+0000","last_active":"2024-09-11T00:15:11.975780+0000","last_peered":"2024-09-11T00:15:11.975780+0000","last_clean":"2024-09-11T00:15:11.975780+0000","last_became_active":"2024-09-11T00:15:10.987382+0000","last_became_peered":"2024-09-11T00:15:10.987382+0000","last_unstale":"2024-09-11T00:15:11.975780+0000","last_undegraded":"2024-09-11T00:15:11.975780+0000","last_fullsized":"2024-09-11T00:15:11.975780+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_clean_scrub_stamp":"2024-09-11T00:15:09.955417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:26:59.001581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:11.999601+0000","last_change":"2024-09-11T00:15:11.998770+0000","last_active":"2024-09-11T00:15:11.999601+0000","last_peered":"2024-09-11T00:15:11.999601+0000","last_clean":"2024-09-11T00:15:11.999601+0000","last_became_active":"2024-09-11T00:15:11.998477+0000","last_became_peered":"2024-09-11T00:15:11.998477+0000","last_unstale":"2024-09-11T00:15:11.999601+0000","last_undegraded":"2024-09-11T00:15:11.999601+0000","last_fullsized":"2024-09-11T00:15:11.999601+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:36:09.339619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"38'3","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:11.997971+0000","last_change":"2024-09-11T00:15:10.985997+0000","last_active":"2024-09-11T00:15:11.997971+0000","last_peered":"2024-09-11T00:15:11.997971+0000","last_clean":"2024-09-11T00:15:11.997971+0000","last_became_active":"2024-09-11T00:15:10.985724+0000","last_became_peered":"2024-09-11T00:15:10.985724+0000","last_unstale":"2024-09-11T00:15:11.997971+0000","last_undegraded":"2024-09-11T00:15:11.997971+0000","last_fullsized":"2024-09-11T00:15:11.997971+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_clean_scrub_stamp":"2024-09-11T00:15:09.955417+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:16:46.436919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:12.002091+0000","last_change":"2024-09-11T00:15:11.997734+0000","last_active":"2024-09-11T00:15:12.002091+0000","last_peered":"2024-09-11T00:15:12.002091+0000","last_clean":"2024-09-11T00:15:12.002091+0000","last_became_active":"2024-09-11T00:15:11.997379+0000","last_became_peered":"2024-09-11T00:15:11.997379+0000","last_unstale":"2024-09-11T00:15:12.002091+0000","last_undegraded":"2024-09-11T00:15:12.002091+0000","last_fullsized":"2024-09-11T00:15:12.002091+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:20:52.661018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"38'6","reported_seq":19,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:12.011940+0000","last_change":"2024-09-11T00:15:10.985361+0000","last_active":"2024-09-11T00:15:12.011940+0000","last_peered":"2024-09-11T00:15:12.011940+0000","last_clean":"2024-09-11T00:15:12.011940+0000","last_became_active":"2024-09-11T00:15:10.985070+0000","last_became_peered":"2024-09-11T00:15:10.985070+0000","last_unstale":"2024-09-11T00:15:12.011940+0000","last_undegraded":"2024-09-11T00:15:12.011940+0000","last_fullsized":"2024-09-11T00:15:12.011940+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_clean_scrub_stamp":"2024-09-11T00:15:09.955417+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:36:08.333344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:11.999375+0000","last_change":"2024-09-11T00:15:11.996031+0000","last_active":"2024-09-11T00:15:11.999375+0000","last_peered":"2024-09-11T00:15:11.999375+0000","last_clean":"2024-09-11T00:15:11.999375+0000","last_became_active":"2024-09-11T00:15:11.995734+0000","last_became_peered":"2024-09-11T00:15:11.995734+0000","last_unstale":"2024-09-11T00:15:11.999375+0000","last_undegraded":"2024-09-11T00:15:11.999375+0000","last_fullsized":"2024-09-11T00:15:11.999375+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:27:00.007857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"38'2","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:11.998091+0000","last_change":"2024-09-11T00:15:10.982086+0000","last_active":"2024-09-11T00:15:11.998091+0000","last_peered":"2024-09-11T00:15:11.998091+0000","last_clean":"2024-09-11T00:15:11.998091+0000","last_became_active":"2024-09-11T00:15:10.981821+0000","last_became_peered":"2024-09-11T00:15:10.981821+0000","last_unstale":"2024-09-11T00:15:11.998091+0000","last_undegraded":"2024-09-11T00:15:11.998091+0000","last_fullsized":"2024-09-11T00:15:11.998091+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_clean_scrub_stamp":"2024-09-11T00:15:09.955417+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:29:03.806148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:11.993534+0000","last_change":"2024-09-11T00:15:11.985531+0000","last_active":"2024-09-11T00:15:11.993534+0000","last_peered":"2024-09-11T00:15:11.993534+0000","last_clean":"2024-09-11T00:15:11.993534+0000","last_became_active":"2024-09-11T00:15:11.985177+0000","last_became_peered":"2024-09-11T00:15:11.985177+0000","last_unstale":"2024-09-11T00:15:11.993534+0000","last_undegraded":"2024-09-11T00:15:11.993534+0000","last_fullsized":"2024-09-11T00:15:11.993534+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:56:07.914915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:11.975224+0000","last_change":"2024-09-11T00:15:10.986902+0000","last_active":"2024-09-11T00:15:11.975224+0000","last_peered":"2024-09-11T00:15:11.975224+0000","last_clean":"2024-09-11T00:15:11.975224+0000","last_became_active":"2024-09-11T00:15:10.986618+0000","last_became_peered":"2024-09-11T00:15:10.986618+0000","last_unstale":"2024-09-11T00:15:11.975224+0000","last_undegraded":"2024-09-11T00:15:11.975224+0000","last_fullsized":"2024-09-11T00:15:11.975224+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_clean_scrub_stamp":"2024-09-11T00:15:09.955417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:05:08.232715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:12.004072+0000","last_change":"2024-09-11T00:15:12.001039+0000","last_active":"2024-09-11T00:15:12.004072+0000","last_peered":"2024-09-11T00:15:12.004072+0000","last_clean":"2024-09-11T00:15:12.004072+0000","last_became_active":"2024-09-11T00:15:11.998778+0000","last_became_peered":"2024-09-11T00:15:11.998778+0000","last_unstale":"2024-09-11T00:15:12.004072+0000","last_undegraded":"2024-09-11T00:15:12.004072+0000","last_fullsized":"2024-09-11T00:15:12.004072+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:36:09.339619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-09-11T00:15:09.965664+0000","last_change":"2024-09-11T00:15:09.965664+0000","last_active":"2024-09-11T00:15:09.955417+0000","last_peered":"2024-09-11T00:15:09.955417+0000","last_clean":"2024-09-11T00:15:09.955417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:15:09.965664+0000","last_undegraded":"2024-09-11T00:15:09.965664+0000","last_fullsized":"2024-09-11T00:15:09.965664+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_clean_scrub_stamp":"2024-09-11T00:15:09.955417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:11.995274+0000","last_change":"2024-09-11T00:15:11.987485+0000","last_active":"2024-09-11T00:15:11.995274+0000","last_peered":"2024-09-11T00:15:11.995274+0000","last_clean":"2024-09-11T00:15:11.995274+0000","last_became_active":"2024-09-11T00:15:11.987231+0000","last_became_peered":"2024-09-11T00:15:11.987231+0000","last_unstale":"2024-09-11T00:15:11.995274+0000","last_undegraded":"2024-09-11T00:15:11.995274+0000","last_fullsized":"2024-09-11T00:15:11.995274+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:41:28.124141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"38'8","reported_seq":21,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:12.005409+0000","last_change":"2024-09-11T00:15:10.988757+0000","last_active":"2024-09-11T00:15:12.005409+0000","last_peered":"2024-09-11T00:15:12.005409+0000","last_clean":"2024-09-11T00:15:12.005409+0000","last_became_active":"2024-09-11T00:15:10.988326+0000","last_became_peered":"2024-09-11T00:15:10.988326+0000","last_unstale":"2024-09-11T00:15:12.005409+0000","last_undegraded":"2024-09-11T00:15:12.005409+0000","last_fullsized":"2024-09-11T00:15:12.005409+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_clean_scrub_stamp":"2024-09-11T00:15:09.955417+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:05:08.232715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:11.995083+0000","last_change":"2024-09-11T00:15:11.986504+0000","last_active":"2024-09-11T00:15:11.995083+0000","last_peered":"2024-09-11T00:15:11.995083+0000","last_clean":"2024-09-11T00:15:11.995083+0000","last_became_active":"2024-09-11T00:15:11.986188+0000","last_became_peered":"2024-09-11T00:15:11.986188+0000","last_unstale":"2024-09-11T00:15:11.995083+0000","last_undegraded":"2024-09-11T00:15:11.995083+0000","last_fullsized":"2024-09-11T00:15:11.995083+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:58:17.603588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"38'1","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:11.995689+0000","last_change":"2024-09-11T00:15:10.989224+0000","last_active":"2024-09-11T00:15:11.995689+0000","last_peered":"2024-09-11T00:15:11.995689+0000","last_clean":"2024-09-11T00:15:11.995689+0000","last_became_active":"2024-09-11T00:15:10.988925+0000","last_became_peered":"2024-09-11T00:15:10.988925+0000","last_unstale":"2024-09-11T00:15:11.995689+0000","last_undegraded":"2024-09-11T00:15:11.995689+0000","last_fullsized":"2024-09-11T00:15:11.995689+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_clean_scrub_stamp":"2024-09-11T00:15:09.955417+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:48:52.690670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:11.995628+0000","last_change":"2024-09-11T00:15:11.982787+0000","last_active":"2024-09-11T00:15:11.995628+0000","last_peered":"2024-09-11T00:15:11.995628+0000","last_clean":"2024-09-11T00:15:11.995628+0000","last_became_active":"2024-09-11T00:15:11.982326+0000","last_became_peered":"2024-09-11T00:15:11.982326+0000","last_unstale":"2024-09-11T00:15:11.995628+0000","last_undegraded":"2024-09-11T00:15:11.995628+0000","last_fullsized":"2024-09-11T00:15:11.995628+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:56:07.914915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"38'2","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:12.002918+0000","last_change":"2024-09-11T00:15:10.981474+0000","last_active":"2024-09-11T00:15:12.002918+0000","last_peered":"2024-09-11T00:15:12.002918+0000","last_clean":"2024-09-11T00:15:12.002918+0000","last_became_active":"2024-09-11T00:15:10.981200+0000","last_became_peered":"2024-09-11T00:15:10.981200+0000","last_unstale":"2024-09-11T00:15:12.002918+0000","last_undegraded":"2024-09-11T00:15:12.002918+0000","last_fullsized":"2024-09-11T00:15:12.002918+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_clean_scrub_stamp":"2024-09-11T00:15:09.955417+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:33:53.976909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:12.002128+0000","last_change":"2024-09-11T00:15:11.998394+0000","last_active":"2024-09-11T00:15:12.002128+0000","last_peered":"2024-09-11T00:15:12.002128+0000","last_clean":"2024-09-11T00:15:12.002128+0000","last_became_active":"2024-09-11T00:15:11.998135+0000","last_became_peered":"2024-09-11T00:15:11.998135+0000","last_unstale":"2024-09-11T00:15:12.002128+0000","last_undegraded":"2024-09-11T00:15:12.002128+0000","last_fullsized":"2024-09-11T00:15:12.002128+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:18:10.378079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":10,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-11T00:15:10.991230+0000","last_change":"2024-09-11T00:15:10.987926+0000","last_active":"2024-09-11T00:15:10.991230+0000","last_peered":"2024-09-11T00:15:10.991230+0000","last_clean":"2024-09-11T00:15:10.991230+0000","last_became_active":"2024-09-11T00:15:10.987658+0000","last_became_peered":"2024-09-11T00:15:10.987658+0000","last_unstale":"2024-09-11T00:15:10.991230+0000","last_undegraded":"2024-09-11T00:15:10.991230+0000","last_fullsized":"2024-09-11T00:15:10.991230+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_clean_scrub_stamp":"2024-09-11T00:15:09.955417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:50:53.177894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-11T00:15:10.972453+0000","last_change":"2024-09-11T00:15:10.972453+0000","last_active":"2024-09-11T00:15:10.961693+0000","last_peered":"2024-09-11T00:15:10.961693+0000","last_clean":"2024-09-11T00:15:10.961693+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:15:10.972453+0000","last_undegraded":"2024-09-11T00:15:10.972453+0000","last_fullsized":"2024-09-11T00:15:10.972453+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:11.975134+0000","last_change":"2024-09-11T00:15:10.982457+0000","last_active":"2024-09-11T00:15:11.975134+0000","last_peered":"2024-09-11T00:15:11.975134+0000","last_clean":"2024-09-11T00:15:11.975134+0000","last_became_active":"2024-09-11T00:15:10.982196+0000","last_became_peered":"2024-09-11T00:15:10.982196+0000","last_unstale":"2024-09-11T00:15:11.975134+0000","last_undegraded":"2024-09-11T00:15:11.975134+0000","last_fullsized":"2024-09-11T00:15:11.975134+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_clean_scrub_stamp":"2024-09-11T00:15:09.955417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:53:21.168815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:12.005206+0000","last_change":"2024-09-11T00:15:11.998392+0000","last_active":"2024-09-11T00:15:12.005206+0000","last_peered":"2024-09-11T00:15:12.005206+0000","last_clean":"2024-09-11T00:15:12.005206+0000","last_became_active":"2024-09-11T00:15:11.998147+0000","last_became_peered":"2024-09-11T00:15:11.998147+0000","last_unstale":"2024-09-11T00:15:12.005206+0000","last_undegraded":"2024-09-11T00:15:12.005206+0000","last_fullsized":"2024-09-11T00:15:12.005206+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:28:04.414078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":10,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-11T00:15:10.985035+0000","last_change":"2024-09-11T00:15:10.982090+0000","last_active":"2024-09-11T00:15:10.985035+0000","last_peered":"2024-09-11T00:15:10.985035+0000","last_clean":"2024-09-11T00:15:10.985035+0000","last_became_active":"2024-09-11T00:15:10.980995+0000","last_became_peered":"2024-09-11T00:15:10.980995+0000","last_unstale":"2024-09-11T00:15:10.985035+0000","last_undegraded":"2024-09-11T00:15:10.985035+0000","last_fullsized":"2024-09-11T00:15:10.985035+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_clean_scrub_stamp":"2024-09-11T00:15:09.955417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:54:46.111637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:12.006040+0000","last_change":"2024-09-11T00:15:12.004792+0000","last_active":"2024-09-11T00:15:12.006040+0000","last_peered":"2024-09-11T00:15:12.006040+0000","last_clean":"2024-09-11T00:15:12.006040+0000","last_became_active":"2024-09-11T00:15:12.004535+0000","last_became_peered":"2024-09-11T00:15:12.004535+0000","last_unstale":"2024-09-11T00:15:12.006040+0000","last_undegraded":"2024-09-11T00:15:12.006040+0000","last_fullsized":"2024-09-11T00:15:12.006040+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:43:33.394237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":10,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-11T00:15:10.985090+0000","last_change":"2024-09-11T00:15:10.982293+0000","last_active":"2024-09-11T00:15:10.985090+0000","last_peered":"2024-09-11T00:15:10.985090+0000","last_clean":"2024-09-11T00:15:10.985090+0000","last_became_active":"2024-09-11T00:15:10.981953+0000","last_became_peered":"2024-09-11T00:15:10.981953+0000","last_unstale":"2024-09-11T00:15:10.985090+0000","last_undegraded":"2024-09-11T00:15:10.985090+0000","last_fullsized":"2024-09-11T00:15:10.985090+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_clean_scrub_stamp":"2024-09-11T00:15:09.955417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:00:19.178831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:11.995204+0000","last_change":"2024-09-11T00:15:11.979526+0000","last_active":"2024-09-11T00:15:11.995204+0000","last_peered":"2024-09-11T00:15:11.995204+0000","last_clean":"2024-09-11T00:15:11.995204+0000","last_became_active":"2024-09-11T00:15:11.979276+0000","last_became_peered":"2024-09-11T00:15:11.979276+0000","last_unstale":"2024-09-11T00:15:11.995204+0000","last_undegraded":"2024-09-11T00:15:11.995204+0000","last_fullsized":"2024-09-11T00:15:11.995204+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:43:33.394237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:11.997752+0000","last_change":"2024-09-11T00:15:10.983758+0000","last_active":"2024-09-11T00:15:11.997752+0000","last_peered":"2024-09-11T00:15:11.997752+0000","last_clean":"2024-09-11T00:15:11.997752+0000","last_became_active":"2024-09-11T00:15:10.983483+0000","last_became_peered":"2024-09-11T00:15:10.983483+0000","last_unstale":"2024-09-11T00:15:11.997752+0000","last_undegraded":"2024-09-11T00:15:11.997752+0000","last_fullsized":"2024-09-11T00:15:11.997752+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_clean_scrub_stamp":"2024-09-11T00:15:09.955417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:58:30.377476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:12.008217+0000","last_change":"2024-09-11T00:15:12.002877+0000","last_active":"2024-09-11T00:15:12.008217+0000","last_peered":"2024-09-11T00:15:12.008217+0000","last_clean":"2024-09-11T00:15:12.008217+0000","last_became_active":"2024-09-11T00:15:12.002631+0000","last_became_peered":"2024-09-11T00:15:12.002631+0000","last_unstale":"2024-09-11T00:15:12.008217+0000","last_undegraded":"2024-09-11T00:15:12.008217+0000","last_fullsized":"2024-09-11T00:15:12.008217+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:54:49.591743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":10,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-11T00:15:10.984320+0000","last_change":"2024-09-11T00:15:10.981282+0000","last_active":"2024-09-11T00:15:10.984320+0000","last_peered":"2024-09-11T00:15:10.984320+0000","last_clean":"2024-09-11T00:15:10.984320+0000","last_became_active":"2024-09-11T00:15:10.981000+0000","last_became_peered":"2024-09-11T00:15:10.981000+0000","last_unstale":"2024-09-11T00:15:10.984320+0000","last_undegraded":"2024-09-11T00:15:10.984320+0000","last_fullsized":"2024-09-11T00:15:10.984320+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_clean_scrub_stamp":"2024-09-11T00:15:09.955417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:43:23.737238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:11.998112+0000","last_change":"2024-09-11T00:15:11.991223+0000","last_active":"2024-09-11T00:15:11.998112+0000","last_peered":"2024-09-11T00:15:11.998112+0000","last_clean":"2024-09-11T00:15:11.998112+0000","last_became_active":"2024-09-11T00:15:11.990994+0000","last_became_peered":"2024-09-11T00:15:11.990994+0000","last_unstale":"2024-09-11T00:15:11.998112+0000","last_undegraded":"2024-09-11T00:15:11.998112+0000","last_fullsized":"2024-09-11T00:15:11.998112+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:48:53.696945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"38'2","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:11.995540+0000","last_change":"2024-09-11T00:15:10.984511+0000","last_active":"2024-09-11T00:15:11.995540+0000","last_peered":"2024-09-11T00:15:11.995540+0000","last_clean":"2024-09-11T00:15:11.995540+0000","last_became_active":"2024-09-11T00:15:10.984234+0000","last_became_peered":"2024-09-11T00:15:10.984234+0000","last_unstale":"2024-09-11T00:15:11.995540+0000","last_undegraded":"2024-09-11T00:15:11.995540+0000","last_fullsized":"2024-09-11T00:15:11.995540+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_clean_scrub_stamp":"2024-09-11T00:15:09.955417+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:36:08.333344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:12.003942+0000","last_change":"2024-09-11T00:15:12.001691+0000","last_active":"2024-09-11T00:15:12.003942+0000","last_peered":"2024-09-11T00:15:12.003942+0000","last_clean":"2024-09-11T00:15:12.003942+0000","last_became_active":"2024-09-11T00:15:12.001180+0000","last_became_peered":"2024-09-11T00:15:12.001180+0000","last_unstale":"2024-09-11T00:15:12.003942+0000","last_undegraded":"2024-09-11T00:15:12.003942+0000","last_fullsized":"2024-09-11T00:15:12.003942+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:16:47.443195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":10,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-11T00:15:10.983339+0000","last_change":"2024-09-11T00:15:10.980366+0000","last_active":"2024-09-11T00:15:10.983339+0000","last_peered":"2024-09-11T00:15:10.983339+0000","last_clean":"2024-09-11T00:15:10.983339+0000","last_became_active":"2024-09-11T00:15:10.980077+0000","last_became_peered":"2024-09-11T00:15:10.980077+0000","last_unstale":"2024-09-11T00:15:10.983339+0000","last_undegraded":"2024-09-11T00:15:10.983339+0000","last_fullsized":"2024-09-11T00:15:10.983339+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_clean_scrub_stamp":"2024-09-11T00:15:09.955417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:15:22.628414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:11.997180+0000","last_change":"2024-09-11T00:15:11.994143+0000","last_active":"2024-09-11T00:15:11.997180+0000","last_peered":"2024-09-11T00:15:11.997180+0000","last_clean":"2024-09-11T00:15:11.997180+0000","last_became_active":"2024-09-11T00:15:11.993393+0000","last_became_peered":"2024-09-11T00:15:11.993393+0000","last_unstale":"2024-09-11T00:15:11.997180+0000","last_undegraded":"2024-09-11T00:15:11.997180+0000","last_fullsized":"2024-09-11T00:15:11.997180+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:49:11.620971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:11.977996+0000","last_change":"2024-09-11T00:15:10.984774+0000","last_active":"2024-09-11T00:15:11.977996+0000","last_peered":"2024-09-11T00:15:11.977996+0000","last_clean":"2024-09-11T00:15:11.977996+0000","last_became_active":"2024-09-11T00:15:10.983875+0000","last_became_peered":"2024-09-11T00:15:10.983875+0000","last_unstale":"2024-09-11T00:15:11.977996+0000","last_undegraded":"2024-09-11T00:15:11.977996+0000","last_fullsized":"2024-09-11T00:15:11.977996+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_clean_scrub_stamp":"2024-09-11T00:15:09.955417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:05:08.232715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:11.993302+0000","last_change":"2024-09-11T00:15:11.988649+0000","last_active":"2024-09-11T00:15:11.993302+0000","last_peered":"2024-09-11T00:15:11.993302+0000","last_clean":"2024-09-11T00:15:11.993302+0000","last_became_active":"2024-09-11T00:15:11.988254+0000","last_became_peered":"2024-09-11T00:15:11.988254+0000","last_unstale":"2024-09-11T00:15:11.993302+0000","last_undegraded":"2024-09-11T00:15:11.993302+0000","last_fullsized":"2024-09-11T00:15:11.993302+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:58:31.383752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:11.979262+0000","last_change":"2024-09-11T00:15:10.984350+0000","last_active":"2024-09-11T00:15:11.979262+0000","last_peered":"2024-09-11T00:15:11.979262+0000","last_clean":"2024-09-11T00:15:11.979262+0000","last_became_active":"2024-09-11T00:15:10.984092+0000","last_became_peered":"2024-09-11T00:15:10.984092+0000","last_unstale":"2024-09-11T00:15:11.979262+0000","last_undegraded":"2024-09-11T00:15:11.979262+0000","last_fullsized":"2024-09-11T00:15:11.979262+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_clean_scrub_stamp":"2024-09-11T00:15:09.955417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:41:46.193502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:11.987168+0000","last_change":"2024-09-11T00:15:11.981492+0000","last_active":"2024-09-11T00:15:11.987168+0000","last_peered":"2024-09-11T00:15:11.987168+0000","last_clean":"2024-09-11T00:15:11.987168+0000","last_became_active":"2024-09-11T00:15:11.981199+0000","last_became_peered":"2024-09-11T00:15:11.981199+0000","last_unstale":"2024-09-11T00:15:11.987168+0000","last_undegraded":"2024-09-11T00:15:11.987168+0000","last_fullsized":"2024-09-11T00:15:11.987168+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:58:31.383752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-09-11T00:15:09.965689+0000","last_change":"2024-09-11T00:15:09.965689+0000","last_active":"2024-09-11T00:15:09.955417+0000","last_peered":"2024-09-11T00:15:09.955417+0000","last_clean":"2024-09-11T00:15:09.955417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:15:09.965689+0000","last_undegraded":"2024-09-11T00:15:09.965689+0000","last_fullsized":"2024-09-11T00:15:09.965689+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_clean_scrub_stamp":"2024-09-11T00:15:09.955417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:12.002886+0000","last_change":"2024-09-11T00:15:11.999345+0000","last_active":"2024-09-11T00:15:12.002886+0000","last_peered":"2024-09-11T00:15:12.002886+0000","last_clean":"2024-09-11T00:15:12.002886+0000","last_became_active":"2024-09-11T00:15:11.999031+0000","last_became_peered":"2024-09-11T00:15:11.999031+0000","last_unstale":"2024-09-11T00:15:12.002886+0000","last_undegraded":"2024-09-11T00:15:12.002886+0000","last_fullsized":"2024-09-11T00:15:12.002886+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:28:22.582823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:11.984760+0000","last_change":"2024-09-11T00:15:10.983535+0000","last_active":"2024-09-11T00:15:11.984760+0000","last_peered":"2024-09-11T00:15:11.984760+0000","last_clean":"2024-09-11T00:15:11.984760+0000","last_became_active":"2024-09-11T00:15:10.983265+0000","last_became_peered":"2024-09-11T00:15:10.983265+0000","last_unstale":"2024-09-11T00:15:11.984760+0000","last_undegraded":"2024-09-11T00:15:11.984760+0000","last_fullsized":"2024-09-11T00:15:11.984760+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_clean_scrub_stamp":"2024-09-11T00:15:09.955417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:46:54.895627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:12.004119+0000","last_change":"2024-09-11T00:15:12.001186+0000","last_active":"2024-09-11T00:15:12.004119+0000","last_peered":"2024-09-11T00:15:12.004119+0000","last_clean":"2024-09-11T00:15:12.004119+0000","last_became_active":"2024-09-11T00:15:11.998947+0000","last_became_peered":"2024-09-11T00:15:11.998947+0000","last_unstale":"2024-09-11T00:15:12.004119+0000","last_undegraded":"2024-09-11T00:15:12.004119+0000","last_fullsized":"2024-09-11T00:15:12.004119+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:48:53.696945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:11.976607+0000","last_change":"2024-09-11T00:15:10.980323+0000","last_active":"2024-09-11T00:15:11.976607+0000","last_peered":"2024-09-11T00:15:11.976607+0000","last_clean":"2024-09-11T00:15:11.976607+0000","last_became_active":"2024-09-11T00:15:10.980050+0000","last_became_peered":"2024-09-11T00:15:10.980050+0000","last_unstale":"2024-09-11T00:15:11.976607+0000","last_undegraded":"2024-09-11T00:15:11.976607+0000","last_fullsized":"2024-09-11T00:15:11.976607+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_clean_scrub_stamp":"2024-09-11T00:15:09.955417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:43:32.387961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:11.998138+0000","last_change":"2024-09-11T00:15:11.989310+0000","last_active":"2024-09-11T00:15:11.998138+0000","last_peered":"2024-09-11T00:15:11.998138+0000","last_clean":"2024-09-11T00:15:11.998138+0000","last_became_active":"2024-09-11T00:15:11.989042+0000","last_became_peered":"2024-09-11T00:15:11.989042+0000","last_unstale":"2024-09-11T00:15:11.998138+0000","last_undegraded":"2024-09-11T00:15:11.998138+0000","last_fullsized":"2024-09-11T00:15:11.998138+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:19:07.626300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:11.988408+0000","last_change":"2024-09-11T00:15:10.984732+0000","last_active":"2024-09-11T00:15:11.988408+0000","last_peered":"2024-09-11T00:15:11.988408+0000","last_clean":"2024-09-11T00:15:11.988408+0000","last_became_active":"2024-09-11T00:15:10.984375+0000","last_became_peered":"2024-09-11T00:15:10.984375+0000","last_unstale":"2024-09-11T00:15:11.988408+0000","last_undegraded":"2024-09-11T00:15:11.988408+0000","last_fullsized":"2024-09-11T00:15:11.988408+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_clean_scrub_stamp":"2024-09-11T00:15:09.955417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:34:50.761829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":143,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:11.985741+0000","last_change":"2024-09-11T00:14:08.221813+0000","last_active":"2024-09-11T00:15:11.985741+0000","last_peered":"2024-09-11T00:15:11.985741+0000","last_clean":"2024-09-11T00:15:11.985741+0000","last_became_active":"2024-09-11T00:14:08.220663+0000","last_became_peered":"2024-09-11T00:14:08.220663+0000","last_unstale":"2024-09-11T00:15:11.985741+0000","last_undegraded":"2024-09-11T00:15:11.985741+0000","last_fullsized":"2024-09-11T00:15:11.985741+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:06.563107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:06.563107+0000","last_clean_scrub_stamp":"2024-09-11T00:14:06.563107+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:44:49.322583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":116,"acting":116,"num_store_stats":7},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1758,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":4168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":31,"ondisk_log_size":31,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509457,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28020,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343820,"statfs":{"total":96636764160,"available":96608071680,"internally_reserved":0,"allocated":1011712,"data_stored":768982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509457,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27460,"kb_used_data":428,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344380,"statfs":{"total":96636764160,"available":96608645120,"internally_reserved":0,"allocated":438272,"data_stored":185893,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509456,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27464,"kb_used_data":428,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344376,"statfs":{"total":96636764160,"available":96608641024,"internally_reserved":0,"allocated":438272,"data_stored":186385,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509456,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27436,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344404,"statfs":{"total":96636764160,"available":96608669696,"internally_reserved":0,"allocated":417792,"data_stored":178614,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509458,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27452,"kb_used_data":424,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344388,"statfs":{"total":96636764160,"available":96608653312,"internally_reserved":0,"allocated":434176,"data_stored":185871,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509457,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28040,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343800,"statfs":{"total":96636764160,"available":96608051200,"internally_reserved":0,"allocated":1028096,"data_stored":776183,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542161,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27424,"kb_used_data":396,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344416,"statfs":{"total":96636764160,"available":96608681984,"internally_reserved":0,"allocated":405504,"data_stored":171947,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574865,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27424,"kb_used_data":396,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344416,"statfs":{"total":96636764160,"available":96608681984,"internally_reserved":0,"allocated":405504,"data_stored":171947,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T00:15:15.299 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T00:15:15.437 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:15.436+0000 7fd3c3a16640 1 -- 172.21.15.92:0/48135620 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd3bc072680 msgr2=0x7fd3bc072aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:15.438 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:15.436+0000 7fd3c3a16640 1 --2- 172.21.15.92:0/48135620 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd3bc072680 0x7fd3bc072aa0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fd3ac005fd0 tx=0x7fd3ac02a540 comp rx=0 tx=0).stop 2024-09-11T00:15:15.438 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:15.436+0000 7fd3c3a16640 1 -- 172.21.15.92:0/48135620 shutdown_connections 2024-09-11T00:15:15.438 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:15.436+0000 7fd3c3a16640 1 --2- 172.21.15.92:0/48135620 >> v2:172.21.15.145:3300/0 conn(0x7fd3bc0ceb00 0x7fd3bc0cef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:15.438 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:15.436+0000 7fd3c3a16640 1 --2- 172.21.15.92:0/48135620 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd3bc072680 0x7fd3bc072aa0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:15.438 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:15.436+0000 7fd3c3a16640 1 -- 172.21.15.92:0/48135620 >> 172.21.15.92:0/48135620 conn(0x7fd3bc0b1760 msgr2=0x7fd3bc0b1b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:15:15.438 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:15.436+0000 7fd3c3a16640 1 -- 172.21.15.92:0/48135620 shutdown_connections 2024-09-11T00:15:15.438 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:15.436+0000 7fd3c3a16640 1 -- 172.21.15.92:0/48135620 wait complete. 2024-09-11T00:15:15.439 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:15.437+0000 7fd3c3a16640 1 Processor -- start 2024-09-11T00:15:15.439 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:15.437+0000 7fd3c3a16640 1 -- start start 2024-09-11T00:15:15.440 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:15.438+0000 7fd3c3a16640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd3bc072680 0x7fd3bc13bb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:15.441 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:15.438+0000 7fd3c3a16640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd3bc0ceb00 0x7fd3bc13e220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:15.441 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:15.438+0000 7fd3c3a16640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd3bc144780 0x7fd3bc1f2530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:15.441 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:15.438+0000 7fd3c3a16640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fd3bc15c960 con 0x7fd3bc072680 2024-09-11T00:15:15.441 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:15.438+0000 7fd3c3a16640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fd3bc15c7e0 con 0x7fd3bc144780 2024-09-11T00:15:15.441 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:15.438+0000 7fd3c3a16640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7fd3bc15cae0 con 0x7fd3bc0ceb00 2024-09-11T00:15:15.441 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:15.438+0000 7fd3c17b2640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd3bc072680 0x7fd3bc13bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:15.441 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:15.438+0000 7fd3c17b2640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd3bc072680 0x7fd3bc13bb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:54690/0 (socket says 172.21.15.92:54690) 2024-09-11T00:15:15.441 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:15.438+0000 7fd3c17b2640 1 -- 172.21.15.92:0/3399334581 learned_addr learned my addr 172.21.15.92:0/3399334581 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-11T00:15:15.441 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:15.438+0000 7fd3c1fb3640 1 --2- 172.21.15.92:0/3399334581 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd3bc144780 0x7fd3bc1f2530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:15.441 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:15.438+0000 7fd3c0fb1640 1 --2- 172.21.15.92:0/3399334581 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd3bc0ceb00 0x7fd3bc13e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:15.441 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:15.438+0000 7fd3c17b2640 1 -- 172.21.15.92:0/3399334581 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd3bc0ceb00 msgr2=0x7fd3bc13e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:15.441 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:15.438+0000 7fd3c17b2640 1 --2- 172.21.15.92:0/3399334581 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd3bc0ceb00 0x7fd3bc13e220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:15.441 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:15.438+0000 7fd3c17b2640 1 -- 172.21.15.92:0/3399334581 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd3bc144780 msgr2=0x7fd3bc1f2530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:15.442 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:15.438+0000 7fd3c17b2640 1 --2- 172.21.15.92:0/3399334581 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd3bc144780 0x7fd3bc1f2530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:15.442 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:15.438+0000 7fd3c17b2640 1 -- 172.21.15.92:0/3399334581 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3bc13f510 con 0x7fd3bc072680 2024-09-11T00:15:15.442 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:15.438+0000 7fd3c17b2640 1 --2- 172.21.15.92:0/3399334581 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd3bc072680 0x7fd3bc13bb20 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fd3b800c3a0 tx=0x7fd3b800c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:15:15.442 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:15.438+0000 7fd3b1ffb640 1 -- 172.21.15.92:0/3399334581 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3b80052d0 con 0x7fd3bc072680 2024-09-11T00:15:15.442 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:15.438+0000 7fd3b1ffb640 1 -- 172.21.15.92:0/3399334581 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd3b8007020 con 0x7fd3bc072680 2024-09-11T00:15:15.442 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:15.438+0000 7fd3c3a16640 1 -- 172.21.15.92:0/3399334581 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd3bc13ec70 con 0x7fd3bc072680 2024-09-11T00:15:15.442 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:15.438+0000 7fd3b1ffb640 1 -- 172.21.15.92:0/3399334581 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3b8007470 con 0x7fd3bc072680 2024-09-11T00:15:15.442 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:15.439+0000 7fd3c3a16640 1 -- 172.21.15.92:0/3399334581 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3bc13f230 con 0x7fd3bc072680 2024-09-11T00:15:15.443 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:15.440+0000 7fd3c3a16640 1 -- 172.21.15.92:0/3399334581 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd3bc15d000 con 0x7fd3bc072680 2024-09-11T00:15:15.443 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:15.440+0000 7fd3b1ffb640 1 -- 172.21.15.92:0/3399334581 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fd3b80067d0 con 0x7fd3bc072680 2024-09-11T00:15:15.443 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:15.440+0000 7fd3b1ffb640 1 --2- 172.21.15.92:0/3399334581 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7fd3a0077f70 0x7fd3a007a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:15.443 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:15.441+0000 7fd3b1ffb640 1 -- 172.21.15.92:0/3399334581 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7fd3b8099210 con 0x7fd3bc072680 2024-09-11T00:15:15.443 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:15.441+0000 7fd3c0fb1640 1 --2- 172.21.15.92:0/3399334581 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7fd3a0077f70 0x7fd3a007a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:15.443 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:15.441+0000 7fd3c0fb1640 1 --2- 172.21.15.92:0/3399334581 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7fd3a0077f70 0x7fd3a007a430 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fd3ac033000 tx=0x7fd3ac004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:15:15.446 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:15.444+0000 7fd3b1ffb640 1 -- 172.21.15.92:0/3399334581 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fd3b80615c0 con 0x7fd3bc072680 2024-09-11T00:15:15.618 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:15.616+0000 7fd3c3a16640 1 -- 172.21.15.92:0/3399334581 --> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fd3bc076070 con 0x7fd3a0077f70 2024-09-11T00:15:15.622 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:15.620+0000 7fd3b1ffb640 1 -- 172.21.15.92:0/3399334581 <== mgr.4100 v2:172.21.15.145:6800/325490785 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+250277 (secure 0 0 0) 0x7fd3bc076070 con 0x7fd3a0077f70 2024-09-11T00:15:15.625 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:15:15.626 INFO:teuthology.orchestra.run.smithi092.stderr:dumped all 2024-09-11T00:15:15.627 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:15.624+0000 7fd3c3a16640 1 -- 172.21.15.92:0/3399334581 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7fd3a0077f70 msgr2=0x7fd3a007a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:15.627 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:15.624+0000 7fd3c3a16640 1 --2- 172.21.15.92:0/3399334581 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7fd3a0077f70 0x7fd3a007a430 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fd3ac033000 tx=0x7fd3ac004730 comp rx=0 tx=0).stop 2024-09-11T00:15:15.627 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:15.624+0000 7fd3c3a16640 1 -- 172.21.15.92:0/3399334581 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd3bc072680 msgr2=0x7fd3bc13bb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:15.627 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:15.624+0000 7fd3c3a16640 1 --2- 172.21.15.92:0/3399334581 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd3bc072680 0x7fd3bc13bb20 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fd3b800c3a0 tx=0x7fd3b800c860 comp rx=0 tx=0).stop 2024-09-11T00:15:15.628 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:15.624+0000 7fd3c3a16640 1 -- 172.21.15.92:0/3399334581 shutdown_connections 2024-09-11T00:15:15.628 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:15.624+0000 7fd3c3a16640 1 --2- 172.21.15.92:0/3399334581 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7fd3a0077f70 0x7fd3a007a430 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:15.628 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:15.624+0000 7fd3c3a16640 1 --2- 172.21.15.92:0/3399334581 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd3bc144780 0x7fd3bc1f2530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:15.628 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:15.624+0000 7fd3c3a16640 1 --2- 172.21.15.92:0/3399334581 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd3bc0ceb00 0x7fd3bc13e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:15.628 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:15.624+0000 7fd3c3a16640 1 --2- 172.21.15.92:0/3399334581 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd3bc072680 0x7fd3bc13bb20 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:15.628 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:15.624+0000 7fd3c3a16640 1 -- 172.21.15.92:0/3399334581 >> 172.21.15.92:0/3399334581 conn(0x7fd3bc0b1760 msgr2=0x7fd3bc0b1b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:15:15.628 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:15.624+0000 7fd3c3a16640 1 -- 172.21.15.92:0/3399334581 shutdown_connections 2024-09-11T00:15:15.628 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:15.624+0000 7fd3c3a16640 1 -- 172.21.15.92:0/3399334581 wait complete. 2024-09-11T00:15:15.636 INFO:teuthology.orchestra.run.smithi092.stdout:{"pg_ready":true,"pg_map":{"version":67,"stamp":"2024-09-11T00:15:14.286766+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592126,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":139,"num_write_kb":1640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":103,"ondisk_log_size":103,"up":182,"acting":182,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":5,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220720,"kb_used_data":4472,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754000,"statfs":{"total":773094113280,"available":772868096000,"internally_reserved":0,"allocated":4579328,"data_stored":2625822,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":26,"apply_latency_ms":26,"commit_latency_ns":26000000,"apply_latency_ns":26000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1758,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.324271"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:11.996813+0000","last_change":"2024-09-11T00:15:11.990745+0000","last_active":"2024-09-11T00:15:11.996813+0000","last_peered":"2024-09-11T00:15:11.996813+0000","last_clean":"2024-09-11T00:15:11.996813+0000","last_became_active":"2024-09-11T00:15:11.990485+0000","last_became_peered":"2024-09-11T00:15:11.990485+0000","last_unstale":"2024-09-11T00:15:11.996813+0000","last_undegraded":"2024-09-11T00:15:11.996813+0000","last_fullsized":"2024-09-11T00:15:11.996813+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:14:44.693719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:11.996830+0000","last_change":"2024-09-11T00:15:11.989933+0000","last_active":"2024-09-11T00:15:11.996830+0000","last_peered":"2024-09-11T00:15:11.996830+0000","last_clean":"2024-09-11T00:15:11.996830+0000","last_became_active":"2024-09-11T00:15:11.989547+0000","last_became_peered":"2024-09-11T00:15:11.989547+0000","last_unstale":"2024-09-11T00:15:11.996830+0000","last_undegraded":"2024-09-11T00:15:11.996830+0000","last_fullsized":"2024-09-11T00:15:11.996830+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:38:48.432712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:11.999391+0000","last_change":"2024-09-11T00:15:11.996802+0000","last_active":"2024-09-11T00:15:11.999391+0000","last_peered":"2024-09-11T00:15:11.999391+0000","last_clean":"2024-09-11T00:15:11.999391+0000","last_became_active":"2024-09-11T00:15:11.996464+0000","last_became_peered":"2024-09-11T00:15:11.996464+0000","last_unstale":"2024-09-11T00:15:11.999391+0000","last_undegraded":"2024-09-11T00:15:11.999391+0000","last_fullsized":"2024-09-11T00:15:11.999391+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:48:53.696945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-11T00:15:10.973081+0000","last_change":"2024-09-11T00:15:10.973081+0000","last_active":"2024-09-11T00:15:10.961693+0000","last_peered":"2024-09-11T00:15:10.961693+0000","last_clean":"2024-09-11T00:15:10.961693+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:15:10.973081+0000","last_undegraded":"2024-09-11T00:15:10.973081+0000","last_fullsized":"2024-09-11T00:15:10.973081+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-11T00:15:10.972932+0000","last_change":"2024-09-11T00:15:10.972932+0000","last_active":"2024-09-11T00:15:10.961693+0000","last_peered":"2024-09-11T00:15:10.961693+0000","last_clean":"2024-09-11T00:15:10.961693+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:15:10.972932+0000","last_undegraded":"2024-09-11T00:15:10.972932+0000","last_fullsized":"2024-09-11T00:15:10.972932+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:11.987916+0000","last_change":"2024-09-11T00:15:11.981800+0000","last_active":"2024-09-11T00:15:11.987916+0000","last_peered":"2024-09-11T00:15:11.987916+0000","last_clean":"2024-09-11T00:15:11.987916+0000","last_became_active":"2024-09-11T00:15:11.981553+0000","last_became_peered":"2024-09-11T00:15:11.981553+0000","last_unstale":"2024-09-11T00:15:11.987916+0000","last_undegraded":"2024-09-11T00:15:11.987916+0000","last_fullsized":"2024-09-11T00:15:11.987916+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:28:04.414078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:11.995625+0000","last_change":"2024-09-11T00:15:11.985908+0000","last_active":"2024-09-11T00:15:11.995625+0000","last_peered":"2024-09-11T00:15:11.995625+0000","last_clean":"2024-09-11T00:15:11.995625+0000","last_became_active":"2024-09-11T00:15:11.983107+0000","last_became_peered":"2024-09-11T00:15:11.983107+0000","last_unstale":"2024-09-11T00:15:11.995625+0000","last_undegraded":"2024-09-11T00:15:11.995625+0000","last_fullsized":"2024-09-11T00:15:11.995625+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:41:28.124141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:11.996966+0000","last_change":"2024-09-11T00:15:11.991693+0000","last_active":"2024-09-11T00:15:11.996966+0000","last_peered":"2024-09-11T00:15:11.996966+0000","last_clean":"2024-09-11T00:15:11.996966+0000","last_became_active":"2024-09-11T00:15:11.991452+0000","last_became_peered":"2024-09-11T00:15:11.991452+0000","last_unstale":"2024-09-11T00:15:11.996966+0000","last_undegraded":"2024-09-11T00:15:11.996966+0000","last_fullsized":"2024-09-11T00:15:11.996966+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:19:07.626300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:11.999360+0000","last_change":"2024-09-11T00:15:11.996272+0000","last_active":"2024-09-11T00:15:11.999360+0000","last_peered":"2024-09-11T00:15:11.999360+0000","last_clean":"2024-09-11T00:15:11.999360+0000","last_became_active":"2024-09-11T00:15:11.996016+0000","last_became_peered":"2024-09-11T00:15:11.996016+0000","last_unstale":"2024-09-11T00:15:11.999360+0000","last_undegraded":"2024-09-11T00:15:11.999360+0000","last_fullsized":"2024-09-11T00:15:11.999360+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:16:47.443195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:12.004395+0000","last_change":"2024-09-11T00:15:12.000547+0000","last_active":"2024-09-11T00:15:12.004395+0000","last_peered":"2024-09-11T00:15:12.004395+0000","last_clean":"2024-09-11T00:15:12.004395+0000","last_became_active":"2024-09-11T00:15:12.000275+0000","last_became_peered":"2024-09-11T00:15:12.000275+0000","last_unstale":"2024-09-11T00:15:12.004395+0000","last_undegraded":"2024-09-11T00:15:12.004395+0000","last_fullsized":"2024-09-11T00:15:12.004395+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:49:11.620971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:11.998030+0000","last_change":"2024-09-11T00:15:11.991652+0000","last_active":"2024-09-11T00:15:11.998030+0000","last_peered":"2024-09-11T00:15:11.998030+0000","last_clean":"2024-09-11T00:15:11.998030+0000","last_became_active":"2024-09-11T00:15:11.990905+0000","last_became_peered":"2024-09-11T00:15:11.990905+0000","last_unstale":"2024-09-11T00:15:11.998030+0000","last_undegraded":"2024-09-11T00:15:11.998030+0000","last_fullsized":"2024-09-11T00:15:11.998030+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:14:44.693719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:11.988524+0000","last_change":"2024-09-11T00:15:11.984051+0000","last_active":"2024-09-11T00:15:11.988524+0000","last_peered":"2024-09-11T00:15:11.988524+0000","last_clean":"2024-09-11T00:15:11.988524+0000","last_became_active":"2024-09-11T00:15:11.983773+0000","last_became_peered":"2024-09-11T00:15:11.983773+0000","last_unstale":"2024-09-11T00:15:11.988524+0000","last_undegraded":"2024-09-11T00:15:11.988524+0000","last_fullsized":"2024-09-11T00:15:11.988524+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:34:51.768105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:12.003723+0000","last_change":"2024-09-11T00:15:12.000158+0000","last_active":"2024-09-11T00:15:12.003723+0000","last_peered":"2024-09-11T00:15:12.003723+0000","last_clean":"2024-09-11T00:15:12.003723+0000","last_became_active":"2024-09-11T00:15:11.999876+0000","last_became_peered":"2024-09-11T00:15:11.999876+0000","last_unstale":"2024-09-11T00:15:12.003723+0000","last_undegraded":"2024-09-11T00:15:12.003723+0000","last_fullsized":"2024-09-11T00:15:12.003723+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:51:23.369565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:11.999202+0000","last_change":"2024-09-11T00:15:11.990614+0000","last_active":"2024-09-11T00:15:11.999202+0000","last_peered":"2024-09-11T00:15:11.999202+0000","last_clean":"2024-09-11T00:15:11.999202+0000","last_became_active":"2024-09-11T00:15:11.990346+0000","last_became_peered":"2024-09-11T00:15:11.990346+0000","last_unstale":"2024-09-11T00:15:11.999202+0000","last_undegraded":"2024-09-11T00:15:11.999202+0000","last_fullsized":"2024-09-11T00:15:11.999202+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:29:18.376105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:11.995647+0000","last_change":"2024-09-11T00:15:11.986763+0000","last_active":"2024-09-11T00:15:11.995647+0000","last_peered":"2024-09-11T00:15:11.995647+0000","last_clean":"2024-09-11T00:15:11.995647+0000","last_became_active":"2024-09-11T00:15:11.986468+0000","last_became_peered":"2024-09-11T00:15:11.986468+0000","last_unstale":"2024-09-11T00:15:11.995647+0000","last_undegraded":"2024-09-11T00:15:11.995647+0000","last_fullsized":"2024-09-11T00:15:11.995647+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:59:36.084840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:12.009647+0000","last_change":"2024-09-11T00:15:12.005753+0000","last_active":"2024-09-11T00:15:12.009647+0000","last_peered":"2024-09-11T00:15:12.009647+0000","last_clean":"2024-09-11T00:15:12.009647+0000","last_became_active":"2024-09-11T00:15:12.005460+0000","last_became_peered":"2024-09-11T00:15:12.005460+0000","last_unstale":"2024-09-11T00:15:12.009647+0000","last_undegraded":"2024-09-11T00:15:12.009647+0000","last_fullsized":"2024-09-11T00:15:12.009647+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:56:07.914915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:12.009660+0000","last_change":"2024-09-11T00:15:12.005879+0000","last_active":"2024-09-11T00:15:12.009660+0000","last_peered":"2024-09-11T00:15:12.009660+0000","last_clean":"2024-09-11T00:15:12.009660+0000","last_became_active":"2024-09-11T00:15:12.005591+0000","last_became_peered":"2024-09-11T00:15:12.005591+0000","last_unstale":"2024-09-11T00:15:12.009660+0000","last_undegraded":"2024-09-11T00:15:12.009660+0000","last_fullsized":"2024-09-11T00:15:12.009660+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:58:17.603588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T00:15:10.961693+0000","last_change":"2024-09-11T00:15:10.961693+0000","last_active":"2024-09-11T00:15:10.961693+0000","last_peered":"2024-09-11T00:15:10.961693+0000","last_clean":"2024-09-11T00:15:10.961693+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:15:10.961693+0000","last_undegraded":"2024-09-11T00:15:10.961693+0000","last_fullsized":"2024-09-11T00:15:10.961693+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-11T00:15:10.972624+0000","last_change":"2024-09-11T00:15:10.972624+0000","last_active":"2024-09-11T00:15:10.961693+0000","last_peered":"2024-09-11T00:15:10.961693+0000","last_clean":"2024-09-11T00:15:10.961693+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:15:10.972624+0000","last_undegraded":"2024-09-11T00:15:10.972624+0000","last_fullsized":"2024-09-11T00:15:10.972624+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T00:15:10.961693+0000","last_change":"2024-09-11T00:15:10.961693+0000","last_active":"2024-09-11T00:15:10.961693+0000","last_peered":"2024-09-11T00:15:10.961693+0000","last_clean":"2024-09-11T00:15:10.961693+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:15:10.961693+0000","last_undegraded":"2024-09-11T00:15:10.961693+0000","last_fullsized":"2024-09-11T00:15:10.961693+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:11.995476+0000","last_change":"2024-09-11T00:15:11.982721+0000","last_active":"2024-09-11T00:15:11.995476+0000","last_peered":"2024-09-11T00:15:11.995476+0000","last_clean":"2024-09-11T00:15:11.995476+0000","last_became_active":"2024-09-11T00:15:11.981979+0000","last_became_peered":"2024-09-11T00:15:11.981979+0000","last_unstale":"2024-09-11T00:15:11.995476+0000","last_undegraded":"2024-09-11T00:15:11.995476+0000","last_fullsized":"2024-09-11T00:15:11.995476+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:29:04.812424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:12.001333+0000","last_change":"2024-09-11T00:15:11.996951+0000","last_active":"2024-09-11T00:15:12.001333+0000","last_peered":"2024-09-11T00:15:12.001333+0000","last_clean":"2024-09-11T00:15:12.001333+0000","last_became_active":"2024-09-11T00:15:11.996664+0000","last_became_peered":"2024-09-11T00:15:11.996664+0000","last_unstale":"2024-09-11T00:15:12.001333+0000","last_undegraded":"2024-09-11T00:15:12.001333+0000","last_fullsized":"2024-09-11T00:15:12.001333+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:30:48.631902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:12.009565+0000","last_change":"2024-09-11T00:15:12.004148+0000","last_active":"2024-09-11T00:15:12.009565+0000","last_peered":"2024-09-11T00:15:12.009565+0000","last_clean":"2024-09-11T00:15:12.009565+0000","last_became_active":"2024-09-11T00:15:12.003829+0000","last_became_peered":"2024-09-11T00:15:12.003829+0000","last_unstale":"2024-09-11T00:15:12.009565+0000","last_undegraded":"2024-09-11T00:15:12.009565+0000","last_fullsized":"2024-09-11T00:15:12.009565+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:43:33.394237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-11T00:15:10.972983+0000","last_change":"2024-09-11T00:15:10.972983+0000","last_active":"2024-09-11T00:15:10.961693+0000","last_peered":"2024-09-11T00:15:10.961693+0000","last_clean":"2024-09-11T00:15:10.961693+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:15:10.972983+0000","last_undegraded":"2024-09-11T00:15:10.972983+0000","last_fullsized":"2024-09-11T00:15:10.972983+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T00:15:10.961693+0000","last_change":"2024-09-11T00:15:10.961693+0000","last_active":"2024-09-11T00:15:10.961693+0000","last_peered":"2024-09-11T00:15:10.961693+0000","last_clean":"2024-09-11T00:15:10.961693+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:15:10.961693+0000","last_undegraded":"2024-09-11T00:15:10.961693+0000","last_fullsized":"2024-09-11T00:15:10.961693+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:11.997420+0000","last_change":"2024-09-11T00:15:11.990612+0000","last_active":"2024-09-11T00:15:11.997420+0000","last_peered":"2024-09-11T00:15:11.997420+0000","last_clean":"2024-09-11T00:15:11.997420+0000","last_became_active":"2024-09-11T00:15:11.989737+0000","last_became_peered":"2024-09-11T00:15:11.989737+0000","last_unstale":"2024-09-11T00:15:11.997420+0000","last_undegraded":"2024-09-11T00:15:11.997420+0000","last_fullsized":"2024-09-11T00:15:11.997420+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:16:47.443195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T00:15:10.961693+0000","last_change":"2024-09-11T00:15:10.961693+0000","last_active":"2024-09-11T00:15:10.961693+0000","last_peered":"2024-09-11T00:15:10.961693+0000","last_clean":"2024-09-11T00:15:10.961693+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:15:10.961693+0000","last_undegraded":"2024-09-11T00:15:10.961693+0000","last_fullsized":"2024-09-11T00:15:10.961693+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:11.995375+0000","last_change":"2024-09-11T00:15:11.984503+0000","last_active":"2024-09-11T00:15:11.995375+0000","last_peered":"2024-09-11T00:15:11.995375+0000","last_clean":"2024-09-11T00:15:11.995375+0000","last_became_active":"2024-09-11T00:15:11.984226+0000","last_became_peered":"2024-09-11T00:15:11.984226+0000","last_unstale":"2024-09-11T00:15:11.995375+0000","last_undegraded":"2024-09-11T00:15:11.995375+0000","last_fullsized":"2024-09-11T00:15:11.995375+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:58:17.603588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T00:15:10.961693+0000","last_change":"2024-09-11T00:15:10.961693+0000","last_active":"2024-09-11T00:15:10.961693+0000","last_peered":"2024-09-11T00:15:10.961693+0000","last_clean":"2024-09-11T00:15:10.961693+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:15:10.961693+0000","last_undegraded":"2024-09-11T00:15:10.961693+0000","last_fullsized":"2024-09-11T00:15:10.961693+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T00:15:10.961693+0000","last_change":"2024-09-11T00:15:10.961693+0000","last_active":"2024-09-11T00:15:10.961693+0000","last_peered":"2024-09-11T00:15:10.961693+0000","last_clean":"2024-09-11T00:15:10.961693+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:15:10.961693+0000","last_undegraded":"2024-09-11T00:15:10.961693+0000","last_fullsized":"2024-09-11T00:15:10.961693+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:12.009620+0000","last_change":"2024-09-11T00:15:12.005579+0000","last_active":"2024-09-11T00:15:12.009620+0000","last_peered":"2024-09-11T00:15:12.009620+0000","last_clean":"2024-09-11T00:15:12.009620+0000","last_became_active":"2024-09-11T00:15:12.004267+0000","last_became_peered":"2024-09-11T00:15:12.004267+0000","last_unstale":"2024-09-11T00:15:12.009620+0000","last_undegraded":"2024-09-11T00:15:12.009620+0000","last_fullsized":"2024-09-11T00:15:12.009620+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:21:58.807270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:11.990529+0000","last_change":"2024-09-11T00:15:11.984826+0000","last_active":"2024-09-11T00:15:11.990529+0000","last_peered":"2024-09-11T00:15:11.990529+0000","last_clean":"2024-09-11T00:15:11.990529+0000","last_became_active":"2024-09-11T00:15:11.984307+0000","last_became_peered":"2024-09-11T00:15:11.984307+0000","last_unstale":"2024-09-11T00:15:11.990529+0000","last_undegraded":"2024-09-11T00:15:11.990529+0000","last_fullsized":"2024-09-11T00:15:11.990529+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:27:00.007857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:12.009626+0000","last_change":"2024-09-11T00:15:12.005723+0000","last_active":"2024-09-11T00:15:12.009626+0000","last_peered":"2024-09-11T00:15:12.009626+0000","last_clean":"2024-09-11T00:15:12.009626+0000","last_became_active":"2024-09-11T00:15:12.005398+0000","last_became_peered":"2024-09-11T00:15:12.005398+0000","last_unstale":"2024-09-11T00:15:12.009626+0000","last_undegraded":"2024-09-11T00:15:12.009626+0000","last_fullsized":"2024-09-11T00:15:12.009626+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:29:04.812424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-09-11T00:15:09.965757+0000","last_change":"2024-09-11T00:15:09.965757+0000","last_active":"2024-09-11T00:15:09.955417+0000","last_peered":"2024-09-11T00:15:09.955417+0000","last_clean":"2024-09-11T00:15:09.955417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:15:09.965757+0000","last_undegraded":"2024-09-11T00:15:09.965757+0000","last_fullsized":"2024-09-11T00:15:09.965757+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_clean_scrub_stamp":"2024-09-11T00:15:09.955417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:11.998169+0000","last_change":"2024-09-11T00:15:11.994104+0000","last_active":"2024-09-11T00:15:11.998169+0000","last_peered":"2024-09-11T00:15:11.998169+0000","last_clean":"2024-09-11T00:15:11.998169+0000","last_became_active":"2024-09-11T00:15:11.993787+0000","last_became_peered":"2024-09-11T00:15:11.993787+0000","last_unstale":"2024-09-11T00:15:11.998169+0000","last_undegraded":"2024-09-11T00:15:11.998169+0000","last_fullsized":"2024-09-11T00:15:11.998169+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:36:09.339619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"38'1","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:12.003434+0000","last_change":"2024-09-11T00:15:10.987651+0000","last_active":"2024-09-11T00:15:12.003434+0000","last_peered":"2024-09-11T00:15:12.003434+0000","last_clean":"2024-09-11T00:15:12.003434+0000","last_became_active":"2024-09-11T00:15:10.987365+0000","last_became_peered":"2024-09-11T00:15:10.987365+0000","last_unstale":"2024-09-11T00:15:12.003434+0000","last_undegraded":"2024-09-11T00:15:12.003434+0000","last_fullsized":"2024-09-11T00:15:12.003434+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_clean_scrub_stamp":"2024-09-11T00:15:09.955417+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:53:21.168815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:11.997253+0000","last_change":"2024-09-11T00:15:11.989911+0000","last_active":"2024-09-11T00:15:11.997253+0000","last_peered":"2024-09-11T00:15:11.997253+0000","last_clean":"2024-09-11T00:15:11.997253+0000","last_became_active":"2024-09-11T00:15:11.989434+0000","last_became_peered":"2024-09-11T00:15:11.989434+0000","last_unstale":"2024-09-11T00:15:11.997253+0000","last_undegraded":"2024-09-11T00:15:11.997253+0000","last_fullsized":"2024-09-11T00:15:11.997253+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:09:53.019331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"38'2","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:11.997740+0000","last_change":"2024-09-11T00:15:10.988735+0000","last_active":"2024-09-11T00:15:11.997740+0000","last_peered":"2024-09-11T00:15:11.997740+0000","last_clean":"2024-09-11T00:15:11.997740+0000","last_became_active":"2024-09-11T00:15:10.988449+0000","last_became_peered":"2024-09-11T00:15:10.988449+0000","last_unstale":"2024-09-11T00:15:11.997740+0000","last_undegraded":"2024-09-11T00:15:11.997740+0000","last_fullsized":"2024-09-11T00:15:11.997740+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_clean_scrub_stamp":"2024-09-11T00:15:09.955417+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:34:50.761829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:11.995258+0000","last_change":"2024-09-11T00:15:11.988181+0000","last_active":"2024-09-11T00:15:11.995258+0000","last_peered":"2024-09-11T00:15:11.995258+0000","last_clean":"2024-09-11T00:15:11.995258+0000","last_became_active":"2024-09-11T00:15:11.987724+0000","last_became_peered":"2024-09-11T00:15:11.987724+0000","last_unstale":"2024-09-11T00:15:11.995258+0000","last_undegraded":"2024-09-11T00:15:11.995258+0000","last_fullsized":"2024-09-11T00:15:11.995258+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:59:36.084840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"38'2","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:11.998938+0000","last_change":"2024-09-11T00:15:10.983607+0000","last_active":"2024-09-11T00:15:11.998938+0000","last_peered":"2024-09-11T00:15:11.998938+0000","last_clean":"2024-09-11T00:15:11.998938+0000","last_became_active":"2024-09-11T00:15:10.983327+0000","last_became_peered":"2024-09-11T00:15:10.983327+0000","last_unstale":"2024-09-11T00:15:11.998938+0000","last_undegraded":"2024-09-11T00:15:11.998938+0000","last_fullsized":"2024-09-11T00:15:11.998938+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_clean_scrub_stamp":"2024-09-11T00:15:09.955417+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:25:22.909623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:11.993330+0000","last_change":"2024-09-11T00:15:11.990149+0000","last_active":"2024-09-11T00:15:11.993330+0000","last_peered":"2024-09-11T00:15:11.993330+0000","last_clean":"2024-09-11T00:15:11.993330+0000","last_became_active":"2024-09-11T00:15:11.989909+0000","last_became_peered":"2024-09-11T00:15:11.989909+0000","last_unstale":"2024-09-11T00:15:11.993330+0000","last_undegraded":"2024-09-11T00:15:11.993330+0000","last_fullsized":"2024-09-11T00:15:11.993330+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:28:04.414078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"38'1","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:11.995511+0000","last_change":"2024-09-11T00:15:10.984669+0000","last_active":"2024-09-11T00:15:11.995511+0000","last_peered":"2024-09-11T00:15:11.995511+0000","last_clean":"2024-09-11T00:15:11.995511+0000","last_became_active":"2024-09-11T00:15:10.984215+0000","last_became_peered":"2024-09-11T00:15:10.984215+0000","last_unstale":"2024-09-11T00:15:11.995511+0000","last_undegraded":"2024-09-11T00:15:11.995511+0000","last_fullsized":"2024-09-11T00:15:11.995511+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_clean_scrub_stamp":"2024-09-11T00:15:09.955417+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:28:03.407802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:11.995599+0000","last_change":"2024-09-11T00:15:11.982642+0000","last_active":"2024-09-11T00:15:11.995599+0000","last_peered":"2024-09-11T00:15:11.995599+0000","last_clean":"2024-09-11T00:15:11.995599+0000","last_became_active":"2024-09-11T00:15:11.982021+0000","last_became_peered":"2024-09-11T00:15:11.982021+0000","last_unstale":"2024-09-11T00:15:11.995599+0000","last_undegraded":"2024-09-11T00:15:11.995599+0000","last_fullsized":"2024-09-11T00:15:11.995599+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:21:58.807270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"38'1","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:12.003994+0000","last_change":"2024-09-11T00:15:10.987655+0000","last_active":"2024-09-11T00:15:12.003994+0000","last_peered":"2024-09-11T00:15:12.003994+0000","last_clean":"2024-09-11T00:15:12.003994+0000","last_became_active":"2024-09-11T00:15:10.987373+0000","last_became_peered":"2024-09-11T00:15:10.987373+0000","last_unstale":"2024-09-11T00:15:12.003994+0000","last_undegraded":"2024-09-11T00:15:12.003994+0000","last_fullsized":"2024-09-11T00:15:12.003994+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_clean_scrub_stamp":"2024-09-11T00:15:09.955417+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:41:46.193502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:12.002915+0000","last_change":"2024-09-11T00:15:12.000133+0000","last_active":"2024-09-11T00:15:12.002915+0000","last_peered":"2024-09-11T00:15:12.002915+0000","last_clean":"2024-09-11T00:15:12.002915+0000","last_became_active":"2024-09-11T00:15:11.999840+0000","last_became_peered":"2024-09-11T00:15:11.999840+0000","last_unstale":"2024-09-11T00:15:12.002915+0000","last_undegraded":"2024-09-11T00:15:12.002915+0000","last_fullsized":"2024-09-11T00:15:12.002915+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:16:37.462915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:11.975235+0000","last_change":"2024-09-11T00:15:10.987183+0000","last_active":"2024-09-11T00:15:11.975235+0000","last_peered":"2024-09-11T00:15:11.975235+0000","last_clean":"2024-09-11T00:15:11.975235+0000","last_became_active":"2024-09-11T00:15:10.986886+0000","last_became_peered":"2024-09-11T00:15:10.986886+0000","last_unstale":"2024-09-11T00:15:11.975235+0000","last_undegraded":"2024-09-11T00:15:11.975235+0000","last_fullsized":"2024-09-11T00:15:11.975235+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_clean_scrub_stamp":"2024-09-11T00:15:09.955417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:57:48.764730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:12.008243+0000","last_change":"2024-09-11T00:15:12.002956+0000","last_active":"2024-09-11T00:15:12.008243+0000","last_peered":"2024-09-11T00:15:12.008243+0000","last_clean":"2024-09-11T00:15:12.008243+0000","last_became_active":"2024-09-11T00:15:12.002703+0000","last_became_peered":"2024-09-11T00:15:12.002703+0000","last_unstale":"2024-09-11T00:15:12.008243+0000","last_undegraded":"2024-09-11T00:15:12.008243+0000","last_fullsized":"2024-09-11T00:15:12.008243+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:10:10.614680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:11.982026+0000","last_change":"2024-09-11T00:15:10.977955+0000","last_active":"2024-09-11T00:15:11.982026+0000","last_peered":"2024-09-11T00:15:11.982026+0000","last_clean":"2024-09-11T00:15:11.982026+0000","last_became_active":"2024-09-11T00:15:10.977692+0000","last_became_peered":"2024-09-11T00:15:10.977692+0000","last_unstale":"2024-09-11T00:15:11.982026+0000","last_undegraded":"2024-09-11T00:15:11.982026+0000","last_fullsized":"2024-09-11T00:15:11.982026+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_clean_scrub_stamp":"2024-09-11T00:15:09.955417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:29:56.077160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-11T00:15:10.972569+0000","last_change":"2024-09-11T00:15:10.972569+0000","last_active":"2024-09-11T00:15:10.961693+0000","last_peered":"2024-09-11T00:15:10.961693+0000","last_clean":"2024-09-11T00:15:10.961693+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:15:10.972569+0000","last_undegraded":"2024-09-11T00:15:10.972569+0000","last_fullsized":"2024-09-11T00:15:10.972569+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:11.979505+0000","last_change":"2024-09-11T00:15:10.980706+0000","last_active":"2024-09-11T00:15:11.979505+0000","last_peered":"2024-09-11T00:15:11.979505+0000","last_clean":"2024-09-11T00:15:11.979505+0000","last_became_active":"2024-09-11T00:15:10.980429+0000","last_became_peered":"2024-09-11T00:15:10.980429+0000","last_unstale":"2024-09-11T00:15:11.979505+0000","last_undegraded":"2024-09-11T00:15:11.979505+0000","last_fullsized":"2024-09-11T00:15:11.979505+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_clean_scrub_stamp":"2024-09-11T00:15:09.955417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:21:57.800994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:12.003909+0000","last_change":"2024-09-11T00:15:12.001080+0000","last_active":"2024-09-11T00:15:12.003909+0000","last_peered":"2024-09-11T00:15:12.003909+0000","last_clean":"2024-09-11T00:15:12.003909+0000","last_became_active":"2024-09-11T00:15:11.998765+0000","last_became_peered":"2024-09-11T00:15:11.998765+0000","last_unstale":"2024-09-11T00:15:12.003909+0000","last_undegraded":"2024-09-11T00:15:12.003909+0000","last_fullsized":"2024-09-11T00:15:12.003909+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:27:00.007857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:11.975780+0000","last_change":"2024-09-11T00:15:10.987659+0000","last_active":"2024-09-11T00:15:11.975780+0000","last_peered":"2024-09-11T00:15:11.975780+0000","last_clean":"2024-09-11T00:15:11.975780+0000","last_became_active":"2024-09-11T00:15:10.987382+0000","last_became_peered":"2024-09-11T00:15:10.987382+0000","last_unstale":"2024-09-11T00:15:11.975780+0000","last_undegraded":"2024-09-11T00:15:11.975780+0000","last_fullsized":"2024-09-11T00:15:11.975780+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_clean_scrub_stamp":"2024-09-11T00:15:09.955417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:26:59.001581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:11.999601+0000","last_change":"2024-09-11T00:15:11.998770+0000","last_active":"2024-09-11T00:15:11.999601+0000","last_peered":"2024-09-11T00:15:11.999601+0000","last_clean":"2024-09-11T00:15:11.999601+0000","last_became_active":"2024-09-11T00:15:11.998477+0000","last_became_peered":"2024-09-11T00:15:11.998477+0000","last_unstale":"2024-09-11T00:15:11.999601+0000","last_undegraded":"2024-09-11T00:15:11.999601+0000","last_fullsized":"2024-09-11T00:15:11.999601+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:36:09.339619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"38'3","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:11.997971+0000","last_change":"2024-09-11T00:15:10.985997+0000","last_active":"2024-09-11T00:15:11.997971+0000","last_peered":"2024-09-11T00:15:11.997971+0000","last_clean":"2024-09-11T00:15:11.997971+0000","last_became_active":"2024-09-11T00:15:10.985724+0000","last_became_peered":"2024-09-11T00:15:10.985724+0000","last_unstale":"2024-09-11T00:15:11.997971+0000","last_undegraded":"2024-09-11T00:15:11.997971+0000","last_fullsized":"2024-09-11T00:15:11.997971+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_clean_scrub_stamp":"2024-09-11T00:15:09.955417+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:16:46.436919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:12.002091+0000","last_change":"2024-09-11T00:15:11.997734+0000","last_active":"2024-09-11T00:15:12.002091+0000","last_peered":"2024-09-11T00:15:12.002091+0000","last_clean":"2024-09-11T00:15:12.002091+0000","last_became_active":"2024-09-11T00:15:11.997379+0000","last_became_peered":"2024-09-11T00:15:11.997379+0000","last_unstale":"2024-09-11T00:15:12.002091+0000","last_undegraded":"2024-09-11T00:15:12.002091+0000","last_fullsized":"2024-09-11T00:15:12.002091+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:20:52.661018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"38'6","reported_seq":19,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:12.011940+0000","last_change":"2024-09-11T00:15:10.985361+0000","last_active":"2024-09-11T00:15:12.011940+0000","last_peered":"2024-09-11T00:15:12.011940+0000","last_clean":"2024-09-11T00:15:12.011940+0000","last_became_active":"2024-09-11T00:15:10.985070+0000","last_became_peered":"2024-09-11T00:15:10.985070+0000","last_unstale":"2024-09-11T00:15:12.011940+0000","last_undegraded":"2024-09-11T00:15:12.011940+0000","last_fullsized":"2024-09-11T00:15:12.011940+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_clean_scrub_stamp":"2024-09-11T00:15:09.955417+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:36:08.333344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:11.999375+0000","last_change":"2024-09-11T00:15:11.996031+0000","last_active":"2024-09-11T00:15:11.999375+0000","last_peered":"2024-09-11T00:15:11.999375+0000","last_clean":"2024-09-11T00:15:11.999375+0000","last_became_active":"2024-09-11T00:15:11.995734+0000","last_became_peered":"2024-09-11T00:15:11.995734+0000","last_unstale":"2024-09-11T00:15:11.999375+0000","last_undegraded":"2024-09-11T00:15:11.999375+0000","last_fullsized":"2024-09-11T00:15:11.999375+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:27:00.007857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"38'2","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:11.998091+0000","last_change":"2024-09-11T00:15:10.982086+0000","last_active":"2024-09-11T00:15:11.998091+0000","last_peered":"2024-09-11T00:15:11.998091+0000","last_clean":"2024-09-11T00:15:11.998091+0000","last_became_active":"2024-09-11T00:15:10.981821+0000","last_became_peered":"2024-09-11T00:15:10.981821+0000","last_unstale":"2024-09-11T00:15:11.998091+0000","last_undegraded":"2024-09-11T00:15:11.998091+0000","last_fullsized":"2024-09-11T00:15:11.998091+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_clean_scrub_stamp":"2024-09-11T00:15:09.955417+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:29:03.806148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:11.993534+0000","last_change":"2024-09-11T00:15:11.985531+0000","last_active":"2024-09-11T00:15:11.993534+0000","last_peered":"2024-09-11T00:15:11.993534+0000","last_clean":"2024-09-11T00:15:11.993534+0000","last_became_active":"2024-09-11T00:15:11.985177+0000","last_became_peered":"2024-09-11T00:15:11.985177+0000","last_unstale":"2024-09-11T00:15:11.993534+0000","last_undegraded":"2024-09-11T00:15:11.993534+0000","last_fullsized":"2024-09-11T00:15:11.993534+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:56:07.914915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:11.975224+0000","last_change":"2024-09-11T00:15:10.986902+0000","last_active":"2024-09-11T00:15:11.975224+0000","last_peered":"2024-09-11T00:15:11.975224+0000","last_clean":"2024-09-11T00:15:11.975224+0000","last_became_active":"2024-09-11T00:15:10.986618+0000","last_became_peered":"2024-09-11T00:15:10.986618+0000","last_unstale":"2024-09-11T00:15:11.975224+0000","last_undegraded":"2024-09-11T00:15:11.975224+0000","last_fullsized":"2024-09-11T00:15:11.975224+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_clean_scrub_stamp":"2024-09-11T00:15:09.955417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:05:08.232715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:12.004072+0000","last_change":"2024-09-11T00:15:12.001039+0000","last_active":"2024-09-11T00:15:12.004072+0000","last_peered":"2024-09-11T00:15:12.004072+0000","last_clean":"2024-09-11T00:15:12.004072+0000","last_became_active":"2024-09-11T00:15:11.998778+0000","last_became_peered":"2024-09-11T00:15:11.998778+0000","last_unstale":"2024-09-11T00:15:12.004072+0000","last_undegraded":"2024-09-11T00:15:12.004072+0000","last_fullsized":"2024-09-11T00:15:12.004072+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:36:09.339619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-09-11T00:15:09.965664+0000","last_change":"2024-09-11T00:15:09.965664+0000","last_active":"2024-09-11T00:15:09.955417+0000","last_peered":"2024-09-11T00:15:09.955417+0000","last_clean":"2024-09-11T00:15:09.955417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:15:09.965664+0000","last_undegraded":"2024-09-11T00:15:09.965664+0000","last_fullsized":"2024-09-11T00:15:09.965664+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_clean_scrub_stamp":"2024-09-11T00:15:09.955417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:11.995274+0000","last_change":"2024-09-11T00:15:11.987485+0000","last_active":"2024-09-11T00:15:11.995274+0000","last_peered":"2024-09-11T00:15:11.995274+0000","last_clean":"2024-09-11T00:15:11.995274+0000","last_became_active":"2024-09-11T00:15:11.987231+0000","last_became_peered":"2024-09-11T00:15:11.987231+0000","last_unstale":"2024-09-11T00:15:11.995274+0000","last_undegraded":"2024-09-11T00:15:11.995274+0000","last_fullsized":"2024-09-11T00:15:11.995274+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:41:28.124141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"38'8","reported_seq":21,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:12.005409+0000","last_change":"2024-09-11T00:15:10.988757+0000","last_active":"2024-09-11T00:15:12.005409+0000","last_peered":"2024-09-11T00:15:12.005409+0000","last_clean":"2024-09-11T00:15:12.005409+0000","last_became_active":"2024-09-11T00:15:10.988326+0000","last_became_peered":"2024-09-11T00:15:10.988326+0000","last_unstale":"2024-09-11T00:15:12.005409+0000","last_undegraded":"2024-09-11T00:15:12.005409+0000","last_fullsized":"2024-09-11T00:15:12.005409+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_clean_scrub_stamp":"2024-09-11T00:15:09.955417+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:05:08.232715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:11.995083+0000","last_change":"2024-09-11T00:15:11.986504+0000","last_active":"2024-09-11T00:15:11.995083+0000","last_peered":"2024-09-11T00:15:11.995083+0000","last_clean":"2024-09-11T00:15:11.995083+0000","last_became_active":"2024-09-11T00:15:11.986188+0000","last_became_peered":"2024-09-11T00:15:11.986188+0000","last_unstale":"2024-09-11T00:15:11.995083+0000","last_undegraded":"2024-09-11T00:15:11.995083+0000","last_fullsized":"2024-09-11T00:15:11.995083+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:58:17.603588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"38'1","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:11.995689+0000","last_change":"2024-09-11T00:15:10.989224+0000","last_active":"2024-09-11T00:15:11.995689+0000","last_peered":"2024-09-11T00:15:11.995689+0000","last_clean":"2024-09-11T00:15:11.995689+0000","last_became_active":"2024-09-11T00:15:10.988925+0000","last_became_peered":"2024-09-11T00:15:10.988925+0000","last_unstale":"2024-09-11T00:15:11.995689+0000","last_undegraded":"2024-09-11T00:15:11.995689+0000","last_fullsized":"2024-09-11T00:15:11.995689+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_clean_scrub_stamp":"2024-09-11T00:15:09.955417+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:48:52.690670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:11.995628+0000","last_change":"2024-09-11T00:15:11.982787+0000","last_active":"2024-09-11T00:15:11.995628+0000","last_peered":"2024-09-11T00:15:11.995628+0000","last_clean":"2024-09-11T00:15:11.995628+0000","last_became_active":"2024-09-11T00:15:11.982326+0000","last_became_peered":"2024-09-11T00:15:11.982326+0000","last_unstale":"2024-09-11T00:15:11.995628+0000","last_undegraded":"2024-09-11T00:15:11.995628+0000","last_fullsized":"2024-09-11T00:15:11.995628+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:56:07.914915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"38'2","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:12.002918+0000","last_change":"2024-09-11T00:15:10.981474+0000","last_active":"2024-09-11T00:15:12.002918+0000","last_peered":"2024-09-11T00:15:12.002918+0000","last_clean":"2024-09-11T00:15:12.002918+0000","last_became_active":"2024-09-11T00:15:10.981200+0000","last_became_peered":"2024-09-11T00:15:10.981200+0000","last_unstale":"2024-09-11T00:15:12.002918+0000","last_undegraded":"2024-09-11T00:15:12.002918+0000","last_fullsized":"2024-09-11T00:15:12.002918+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_clean_scrub_stamp":"2024-09-11T00:15:09.955417+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:33:53.976909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:12.002128+0000","last_change":"2024-09-11T00:15:11.998394+0000","last_active":"2024-09-11T00:15:12.002128+0000","last_peered":"2024-09-11T00:15:12.002128+0000","last_clean":"2024-09-11T00:15:12.002128+0000","last_became_active":"2024-09-11T00:15:11.998135+0000","last_became_peered":"2024-09-11T00:15:11.998135+0000","last_unstale":"2024-09-11T00:15:12.002128+0000","last_undegraded":"2024-09-11T00:15:12.002128+0000","last_fullsized":"2024-09-11T00:15:12.002128+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:18:10.378079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":10,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-11T00:15:10.991230+0000","last_change":"2024-09-11T00:15:10.987926+0000","last_active":"2024-09-11T00:15:10.991230+0000","last_peered":"2024-09-11T00:15:10.991230+0000","last_clean":"2024-09-11T00:15:10.991230+0000","last_became_active":"2024-09-11T00:15:10.987658+0000","last_became_peered":"2024-09-11T00:15:10.987658+0000","last_unstale":"2024-09-11T00:15:10.991230+0000","last_undegraded":"2024-09-11T00:15:10.991230+0000","last_fullsized":"2024-09-11T00:15:10.991230+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_clean_scrub_stamp":"2024-09-11T00:15:09.955417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:50:53.177894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-11T00:15:10.972453+0000","last_change":"2024-09-11T00:15:10.972453+0000","last_active":"2024-09-11T00:15:10.961693+0000","last_peered":"2024-09-11T00:15:10.961693+0000","last_clean":"2024-09-11T00:15:10.961693+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:15:10.972453+0000","last_undegraded":"2024-09-11T00:15:10.972453+0000","last_fullsized":"2024-09-11T00:15:10.972453+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:11.975134+0000","last_change":"2024-09-11T00:15:10.982457+0000","last_active":"2024-09-11T00:15:11.975134+0000","last_peered":"2024-09-11T00:15:11.975134+0000","last_clean":"2024-09-11T00:15:11.975134+0000","last_became_active":"2024-09-11T00:15:10.982196+0000","last_became_peered":"2024-09-11T00:15:10.982196+0000","last_unstale":"2024-09-11T00:15:11.975134+0000","last_undegraded":"2024-09-11T00:15:11.975134+0000","last_fullsized":"2024-09-11T00:15:11.975134+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_clean_scrub_stamp":"2024-09-11T00:15:09.955417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:53:21.168815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:12.005206+0000","last_change":"2024-09-11T00:15:11.998392+0000","last_active":"2024-09-11T00:15:12.005206+0000","last_peered":"2024-09-11T00:15:12.005206+0000","last_clean":"2024-09-11T00:15:12.005206+0000","last_became_active":"2024-09-11T00:15:11.998147+0000","last_became_peered":"2024-09-11T00:15:11.998147+0000","last_unstale":"2024-09-11T00:15:12.005206+0000","last_undegraded":"2024-09-11T00:15:12.005206+0000","last_fullsized":"2024-09-11T00:15:12.005206+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:28:04.414078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":10,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-11T00:15:10.985035+0000","last_change":"2024-09-11T00:15:10.982090+0000","last_active":"2024-09-11T00:15:10.985035+0000","last_peered":"2024-09-11T00:15:10.985035+0000","last_clean":"2024-09-11T00:15:10.985035+0000","last_became_active":"2024-09-11T00:15:10.980995+0000","last_became_peered":"2024-09-11T00:15:10.980995+0000","last_unstale":"2024-09-11T00:15:10.985035+0000","last_undegraded":"2024-09-11T00:15:10.985035+0000","last_fullsized":"2024-09-11T00:15:10.985035+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_clean_scrub_stamp":"2024-09-11T00:15:09.955417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:54:46.111637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:12.006040+0000","last_change":"2024-09-11T00:15:12.004792+0000","last_active":"2024-09-11T00:15:12.006040+0000","last_peered":"2024-09-11T00:15:12.006040+0000","last_clean":"2024-09-11T00:15:12.006040+0000","last_became_active":"2024-09-11T00:15:12.004535+0000","last_became_peered":"2024-09-11T00:15:12.004535+0000","last_unstale":"2024-09-11T00:15:12.006040+0000","last_undegraded":"2024-09-11T00:15:12.006040+0000","last_fullsized":"2024-09-11T00:15:12.006040+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:43:33.394237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":10,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-11T00:15:10.985090+0000","last_change":"2024-09-11T00:15:10.982293+0000","last_active":"2024-09-11T00:15:10.985090+0000","last_peered":"2024-09-11T00:15:10.985090+0000","last_clean":"2024-09-11T00:15:10.985090+0000","last_became_active":"2024-09-11T00:15:10.981953+0000","last_became_peered":"2024-09-11T00:15:10.981953+0000","last_unstale":"2024-09-11T00:15:10.985090+0000","last_undegraded":"2024-09-11T00:15:10.985090+0000","last_fullsized":"2024-09-11T00:15:10.985090+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_clean_scrub_stamp":"2024-09-11T00:15:09.955417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:00:19.178831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:11.995204+0000","last_change":"2024-09-11T00:15:11.979526+0000","last_active":"2024-09-11T00:15:11.995204+0000","last_peered":"2024-09-11T00:15:11.995204+0000","last_clean":"2024-09-11T00:15:11.995204+0000","last_became_active":"2024-09-11T00:15:11.979276+0000","last_became_peered":"2024-09-11T00:15:11.979276+0000","last_unstale":"2024-09-11T00:15:11.995204+0000","last_undegraded":"2024-09-11T00:15:11.995204+0000","last_fullsized":"2024-09-11T00:15:11.995204+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:43:33.394237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:11.997752+0000","last_change":"2024-09-11T00:15:10.983758+0000","last_active":"2024-09-11T00:15:11.997752+0000","last_peered":"2024-09-11T00:15:11.997752+0000","last_clean":"2024-09-11T00:15:11.997752+0000","last_became_active":"2024-09-11T00:15:10.983483+0000","last_became_peered":"2024-09-11T00:15:10.983483+0000","last_unstale":"2024-09-11T00:15:11.997752+0000","last_undegraded":"2024-09-11T00:15:11.997752+0000","last_fullsized":"2024-09-11T00:15:11.997752+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_clean_scrub_stamp":"2024-09-11T00:15:09.955417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:58:30.377476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:12.008217+0000","last_change":"2024-09-11T00:15:12.002877+0000","last_active":"2024-09-11T00:15:12.008217+0000","last_peered":"2024-09-11T00:15:12.008217+0000","last_clean":"2024-09-11T00:15:12.008217+0000","last_became_active":"2024-09-11T00:15:12.002631+0000","last_became_peered":"2024-09-11T00:15:12.002631+0000","last_unstale":"2024-09-11T00:15:12.008217+0000","last_undegraded":"2024-09-11T00:15:12.008217+0000","last_fullsized":"2024-09-11T00:15:12.008217+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:54:49.591743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":10,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-11T00:15:10.984320+0000","last_change":"2024-09-11T00:15:10.981282+0000","last_active":"2024-09-11T00:15:10.984320+0000","last_peered":"2024-09-11T00:15:10.984320+0000","last_clean":"2024-09-11T00:15:10.984320+0000","last_became_active":"2024-09-11T00:15:10.981000+0000","last_became_peered":"2024-09-11T00:15:10.981000+0000","last_unstale":"2024-09-11T00:15:10.984320+0000","last_undegraded":"2024-09-11T00:15:10.984320+0000","last_fullsized":"2024-09-11T00:15:10.984320+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_clean_scrub_stamp":"2024-09-11T00:15:09.955417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:43:23.737238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:11.998112+0000","last_change":"2024-09-11T00:15:11.991223+0000","last_active":"2024-09-11T00:15:11.998112+0000","last_peered":"2024-09-11T00:15:11.998112+0000","last_clean":"2024-09-11T00:15:11.998112+0000","last_became_active":"2024-09-11T00:15:11.990994+0000","last_became_peered":"2024-09-11T00:15:11.990994+0000","last_unstale":"2024-09-11T00:15:11.998112+0000","last_undegraded":"2024-09-11T00:15:11.998112+0000","last_fullsized":"2024-09-11T00:15:11.998112+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:48:53.696945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"38'2","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:11.995540+0000","last_change":"2024-09-11T00:15:10.984511+0000","last_active":"2024-09-11T00:15:11.995540+0000","last_peered":"2024-09-11T00:15:11.995540+0000","last_clean":"2024-09-11T00:15:11.995540+0000","last_became_active":"2024-09-11T00:15:10.984234+0000","last_became_peered":"2024-09-11T00:15:10.984234+0000","last_unstale":"2024-09-11T00:15:11.995540+0000","last_undegraded":"2024-09-11T00:15:11.995540+0000","last_fullsized":"2024-09-11T00:15:11.995540+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_clean_scrub_stamp":"2024-09-11T00:15:09.955417+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:36:08.333344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:12.003942+0000","last_change":"2024-09-11T00:15:12.001691+0000","last_active":"2024-09-11T00:15:12.003942+0000","last_peered":"2024-09-11T00:15:12.003942+0000","last_clean":"2024-09-11T00:15:12.003942+0000","last_became_active":"2024-09-11T00:15:12.001180+0000","last_became_peered":"2024-09-11T00:15:12.001180+0000","last_unstale":"2024-09-11T00:15:12.003942+0000","last_undegraded":"2024-09-11T00:15:12.003942+0000","last_fullsized":"2024-09-11T00:15:12.003942+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:16:47.443195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":10,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-11T00:15:10.983339+0000","last_change":"2024-09-11T00:15:10.980366+0000","last_active":"2024-09-11T00:15:10.983339+0000","last_peered":"2024-09-11T00:15:10.983339+0000","last_clean":"2024-09-11T00:15:10.983339+0000","last_became_active":"2024-09-11T00:15:10.980077+0000","last_became_peered":"2024-09-11T00:15:10.980077+0000","last_unstale":"2024-09-11T00:15:10.983339+0000","last_undegraded":"2024-09-11T00:15:10.983339+0000","last_fullsized":"2024-09-11T00:15:10.983339+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_clean_scrub_stamp":"2024-09-11T00:15:09.955417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:15:22.628414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:11.997180+0000","last_change":"2024-09-11T00:15:11.994143+0000","last_active":"2024-09-11T00:15:11.997180+0000","last_peered":"2024-09-11T00:15:11.997180+0000","last_clean":"2024-09-11T00:15:11.997180+0000","last_became_active":"2024-09-11T00:15:11.993393+0000","last_became_peered":"2024-09-11T00:15:11.993393+0000","last_unstale":"2024-09-11T00:15:11.997180+0000","last_undegraded":"2024-09-11T00:15:11.997180+0000","last_fullsized":"2024-09-11T00:15:11.997180+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:49:11.620971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:11.977996+0000","last_change":"2024-09-11T00:15:10.984774+0000","last_active":"2024-09-11T00:15:11.977996+0000","last_peered":"2024-09-11T00:15:11.977996+0000","last_clean":"2024-09-11T00:15:11.977996+0000","last_became_active":"2024-09-11T00:15:10.983875+0000","last_became_peered":"2024-09-11T00:15:10.983875+0000","last_unstale":"2024-09-11T00:15:11.977996+0000","last_undegraded":"2024-09-11T00:15:11.977996+0000","last_fullsized":"2024-09-11T00:15:11.977996+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_clean_scrub_stamp":"2024-09-11T00:15:09.955417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:05:08.232715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:11.993302+0000","last_change":"2024-09-11T00:15:11.988649+0000","last_active":"2024-09-11T00:15:11.993302+0000","last_peered":"2024-09-11T00:15:11.993302+0000","last_clean":"2024-09-11T00:15:11.993302+0000","last_became_active":"2024-09-11T00:15:11.988254+0000","last_became_peered":"2024-09-11T00:15:11.988254+0000","last_unstale":"2024-09-11T00:15:11.993302+0000","last_undegraded":"2024-09-11T00:15:11.993302+0000","last_fullsized":"2024-09-11T00:15:11.993302+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:58:31.383752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:11.979262+0000","last_change":"2024-09-11T00:15:10.984350+0000","last_active":"2024-09-11T00:15:11.979262+0000","last_peered":"2024-09-11T00:15:11.979262+0000","last_clean":"2024-09-11T00:15:11.979262+0000","last_became_active":"2024-09-11T00:15:10.984092+0000","last_became_peered":"2024-09-11T00:15:10.984092+0000","last_unstale":"2024-09-11T00:15:11.979262+0000","last_undegraded":"2024-09-11T00:15:11.979262+0000","last_fullsized":"2024-09-11T00:15:11.979262+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_clean_scrub_stamp":"2024-09-11T00:15:09.955417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:41:46.193502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:11.987168+0000","last_change":"2024-09-11T00:15:11.981492+0000","last_active":"2024-09-11T00:15:11.987168+0000","last_peered":"2024-09-11T00:15:11.987168+0000","last_clean":"2024-09-11T00:15:11.987168+0000","last_became_active":"2024-09-11T00:15:11.981199+0000","last_became_peered":"2024-09-11T00:15:11.981199+0000","last_unstale":"2024-09-11T00:15:11.987168+0000","last_undegraded":"2024-09-11T00:15:11.987168+0000","last_fullsized":"2024-09-11T00:15:11.987168+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:58:31.383752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-09-11T00:15:09.965689+0000","last_change":"2024-09-11T00:15:09.965689+0000","last_active":"2024-09-11T00:15:09.955417+0000","last_peered":"2024-09-11T00:15:09.955417+0000","last_clean":"2024-09-11T00:15:09.955417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:15:09.965689+0000","last_undegraded":"2024-09-11T00:15:09.965689+0000","last_fullsized":"2024-09-11T00:15:09.965689+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_clean_scrub_stamp":"2024-09-11T00:15:09.955417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:12.002886+0000","last_change":"2024-09-11T00:15:11.999345+0000","last_active":"2024-09-11T00:15:12.002886+0000","last_peered":"2024-09-11T00:15:12.002886+0000","last_clean":"2024-09-11T00:15:12.002886+0000","last_became_active":"2024-09-11T00:15:11.999031+0000","last_became_peered":"2024-09-11T00:15:11.999031+0000","last_unstale":"2024-09-11T00:15:12.002886+0000","last_undegraded":"2024-09-11T00:15:12.002886+0000","last_fullsized":"2024-09-11T00:15:12.002886+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:28:22.582823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:11.984760+0000","last_change":"2024-09-11T00:15:10.983535+0000","last_active":"2024-09-11T00:15:11.984760+0000","last_peered":"2024-09-11T00:15:11.984760+0000","last_clean":"2024-09-11T00:15:11.984760+0000","last_became_active":"2024-09-11T00:15:10.983265+0000","last_became_peered":"2024-09-11T00:15:10.983265+0000","last_unstale":"2024-09-11T00:15:11.984760+0000","last_undegraded":"2024-09-11T00:15:11.984760+0000","last_fullsized":"2024-09-11T00:15:11.984760+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_clean_scrub_stamp":"2024-09-11T00:15:09.955417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:46:54.895627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:12.004119+0000","last_change":"2024-09-11T00:15:12.001186+0000","last_active":"2024-09-11T00:15:12.004119+0000","last_peered":"2024-09-11T00:15:12.004119+0000","last_clean":"2024-09-11T00:15:12.004119+0000","last_became_active":"2024-09-11T00:15:11.998947+0000","last_became_peered":"2024-09-11T00:15:11.998947+0000","last_unstale":"2024-09-11T00:15:12.004119+0000","last_undegraded":"2024-09-11T00:15:12.004119+0000","last_fullsized":"2024-09-11T00:15:12.004119+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:48:53.696945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:11.976607+0000","last_change":"2024-09-11T00:15:10.980323+0000","last_active":"2024-09-11T00:15:11.976607+0000","last_peered":"2024-09-11T00:15:11.976607+0000","last_clean":"2024-09-11T00:15:11.976607+0000","last_became_active":"2024-09-11T00:15:10.980050+0000","last_became_peered":"2024-09-11T00:15:10.980050+0000","last_unstale":"2024-09-11T00:15:11.976607+0000","last_undegraded":"2024-09-11T00:15:11.976607+0000","last_fullsized":"2024-09-11T00:15:11.976607+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_clean_scrub_stamp":"2024-09-11T00:15:09.955417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:43:32.387961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:11.998138+0000","last_change":"2024-09-11T00:15:11.989310+0000","last_active":"2024-09-11T00:15:11.998138+0000","last_peered":"2024-09-11T00:15:11.998138+0000","last_clean":"2024-09-11T00:15:11.998138+0000","last_became_active":"2024-09-11T00:15:11.989042+0000","last_became_peered":"2024-09-11T00:15:11.989042+0000","last_unstale":"2024-09-11T00:15:11.998138+0000","last_undegraded":"2024-09-11T00:15:11.998138+0000","last_fullsized":"2024-09-11T00:15:11.998138+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:19:07.626300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:11.988408+0000","last_change":"2024-09-11T00:15:10.984732+0000","last_active":"2024-09-11T00:15:11.988408+0000","last_peered":"2024-09-11T00:15:11.988408+0000","last_clean":"2024-09-11T00:15:11.988408+0000","last_became_active":"2024-09-11T00:15:10.984375+0000","last_became_peered":"2024-09-11T00:15:10.984375+0000","last_unstale":"2024-09-11T00:15:11.988408+0000","last_undegraded":"2024-09-11T00:15:11.988408+0000","last_fullsized":"2024-09-11T00:15:11.988408+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_clean_scrub_stamp":"2024-09-11T00:15:09.955417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:34:50.761829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":143,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:11.985741+0000","last_change":"2024-09-11T00:14:08.221813+0000","last_active":"2024-09-11T00:15:11.985741+0000","last_peered":"2024-09-11T00:15:11.985741+0000","last_clean":"2024-09-11T00:15:11.985741+0000","last_became_active":"2024-09-11T00:14:08.220663+0000","last_became_peered":"2024-09-11T00:14:08.220663+0000","last_unstale":"2024-09-11T00:15:11.985741+0000","last_undegraded":"2024-09-11T00:15:11.985741+0000","last_fullsized":"2024-09-11T00:15:11.985741+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:06.563107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:06.563107+0000","last_clean_scrub_stamp":"2024-09-11T00:14:06.563107+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:44:49.322583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":116,"acting":116,"num_store_stats":7},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1758,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":4168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":31,"ondisk_log_size":31,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509457,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28020,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343820,"statfs":{"total":96636764160,"available":96608071680,"internally_reserved":0,"allocated":1011712,"data_stored":768982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509457,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27460,"kb_used_data":428,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344380,"statfs":{"total":96636764160,"available":96608645120,"internally_reserved":0,"allocated":438272,"data_stored":185893,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509456,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27464,"kb_used_data":428,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344376,"statfs":{"total":96636764160,"available":96608641024,"internally_reserved":0,"allocated":438272,"data_stored":186385,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509456,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27436,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344404,"statfs":{"total":96636764160,"available":96608669696,"internally_reserved":0,"allocated":417792,"data_stored":178614,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509458,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27452,"kb_used_data":424,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344388,"statfs":{"total":96636764160,"available":96608653312,"internally_reserved":0,"allocated":434176,"data_stored":185871,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509457,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28040,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343800,"statfs":{"total":96636764160,"available":96608051200,"internally_reserved":0,"allocated":1028096,"data_stored":776183,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542161,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27424,"kb_used_data":396,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344416,"statfs":{"total":96636764160,"available":96608681984,"internally_reserved":0,"allocated":405504,"data_stored":171947,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574865,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27424,"kb_used_data":396,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344416,"statfs":{"total":96636764160,"available":96608681984,"internally_reserved":0,"allocated":405504,"data_stored":171947,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T00:15:15.640 INFO:tasks.ceph.ceph_manager.ceph:PG 6.3c is not active+clean 2024-09-11T00:15:15.640 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.3c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-09-11T00:15:10.973081+0000', 'last_change': '2024-09-11T00:15:10.973081+0000', 'last_active': '2024-09-11T00:15:10.961693+0000', 'last_peered': '2024-09-11T00:15:10.961693+0000', 'last_clean': '2024-09-11T00:15:10.961693+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T00:15:10.973081+0000', 'last_undegraded': '2024-09-11T00:15:10.973081+0000', 'last_fullsized': '2024-09-11T00:15:10.973081+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T00:15:10.961693+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T00:15:10.961693+0000', 'last_clean_scrub_stamp': '2024-09-11T00:15:10.961693+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-11T00:15:15.640 INFO:tasks.ceph.ceph_manager.ceph:PG 6.3b is not active+clean 2024-09-11T00:15:15.640 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.3b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-09-11T00:15:10.972932+0000', 'last_change': '2024-09-11T00:15:10.972932+0000', 'last_active': '2024-09-11T00:15:10.961693+0000', 'last_peered': '2024-09-11T00:15:10.961693+0000', 'last_clean': '2024-09-11T00:15:10.961693+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T00:15:10.972932+0000', 'last_undegraded': '2024-09-11T00:15:10.972932+0000', 'last_fullsized': '2024-09-11T00:15:10.972932+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T00:15:10.961693+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T00:15:10.961693+0000', 'last_clean_scrub_stamp': '2024-09-11T00:15:10.961693+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-11T00:15:15.640 INFO:tasks.ceph.ceph_manager.ceph:PG 6.2e is not active+clean 2024-09-11T00:15:15.640 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-11T00:15:10.961693+0000', 'last_change': '2024-09-11T00:15:10.961693+0000', 'last_active': '2024-09-11T00:15:10.961693+0000', 'last_peered': '2024-09-11T00:15:10.961693+0000', 'last_clean': '2024-09-11T00:15:10.961693+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T00:15:10.961693+0000', 'last_undegraded': '2024-09-11T00:15:10.961693+0000', 'last_fullsized': '2024-09-11T00:15:10.961693+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T00:15:10.961693+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T00:15:10.961693+0000', 'last_clean_scrub_stamp': '2024-09-11T00:15:10.961693+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-11T00:15:15.641 INFO:tasks.ceph.ceph_manager.ceph:PG 6.2d is not active+clean 2024-09-11T00:15:15.641 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.2d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-09-11T00:15:10.972624+0000', 'last_change': '2024-09-11T00:15:10.972624+0000', 'last_active': '2024-09-11T00:15:10.961693+0000', 'last_peered': '2024-09-11T00:15:10.961693+0000', 'last_clean': '2024-09-11T00:15:10.961693+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T00:15:10.972624+0000', 'last_undegraded': '2024-09-11T00:15:10.972624+0000', 'last_fullsized': '2024-09-11T00:15:10.972624+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T00:15:10.961693+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T00:15:10.961693+0000', 'last_clean_scrub_stamp': '2024-09-11T00:15:10.961693+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-11T00:15:15.641 INFO:tasks.ceph.ceph_manager.ceph:PG 6.2c is not active+clean 2024-09-11T00:15:15.641 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-11T00:15:10.961693+0000', 'last_change': '2024-09-11T00:15:10.961693+0000', 'last_active': '2024-09-11T00:15:10.961693+0000', 'last_peered': '2024-09-11T00:15:10.961693+0000', 'last_clean': '2024-09-11T00:15:10.961693+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T00:15:10.961693+0000', 'last_undegraded': '2024-09-11T00:15:10.961693+0000', 'last_fullsized': '2024-09-11T00:15:10.961693+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T00:15:10.961693+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T00:15:10.961693+0000', 'last_clean_scrub_stamp': '2024-09-11T00:15:10.961693+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-11T00:15:15.641 INFO:tasks.ceph.ceph_manager.ceph:PG 6.28 is not active+clean 2024-09-11T00:15:15.641 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.28', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-09-11T00:15:10.972983+0000', 'last_change': '2024-09-11T00:15:10.972983+0000', 'last_active': '2024-09-11T00:15:10.961693+0000', 'last_peered': '2024-09-11T00:15:10.961693+0000', 'last_clean': '2024-09-11T00:15:10.961693+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T00:15:10.972983+0000', 'last_undegraded': '2024-09-11T00:15:10.972983+0000', 'last_fullsized': '2024-09-11T00:15:10.972983+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T00:15:10.961693+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T00:15:10.961693+0000', 'last_clean_scrub_stamp': '2024-09-11T00:15:10.961693+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-11T00:15:15.641 INFO:tasks.ceph.ceph_manager.ceph:PG 6.27 is not active+clean 2024-09-11T00:15:15.641 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-11T00:15:10.961693+0000', 'last_change': '2024-09-11T00:15:10.961693+0000', 'last_active': '2024-09-11T00:15:10.961693+0000', 'last_peered': '2024-09-11T00:15:10.961693+0000', 'last_clean': '2024-09-11T00:15:10.961693+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T00:15:10.961693+0000', 'last_undegraded': '2024-09-11T00:15:10.961693+0000', 'last_fullsized': '2024-09-11T00:15:10.961693+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T00:15:10.961693+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T00:15:10.961693+0000', 'last_clean_scrub_stamp': '2024-09-11T00:15:10.961693+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-11T00:15:15.641 INFO:tasks.ceph.ceph_manager.ceph:PG 6.25 is not active+clean 2024-09-11T00:15:15.641 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-11T00:15:10.961693+0000', 'last_change': '2024-09-11T00:15:10.961693+0000', 'last_active': '2024-09-11T00:15:10.961693+0000', 'last_peered': '2024-09-11T00:15:10.961693+0000', 'last_clean': '2024-09-11T00:15:10.961693+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T00:15:10.961693+0000', 'last_undegraded': '2024-09-11T00:15:10.961693+0000', 'last_fullsized': '2024-09-11T00:15:10.961693+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T00:15:10.961693+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T00:15:10.961693+0000', 'last_clean_scrub_stamp': '2024-09-11T00:15:10.961693+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-11T00:15:15.641 INFO:tasks.ceph.ceph_manager.ceph:PG 6.23 is not active+clean 2024-09-11T00:15:15.641 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-11T00:15:10.961693+0000', 'last_change': '2024-09-11T00:15:10.961693+0000', 'last_active': '2024-09-11T00:15:10.961693+0000', 'last_peered': '2024-09-11T00:15:10.961693+0000', 'last_clean': '2024-09-11T00:15:10.961693+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T00:15:10.961693+0000', 'last_undegraded': '2024-09-11T00:15:10.961693+0000', 'last_fullsized': '2024-09-11T00:15:10.961693+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T00:15:10.961693+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T00:15:10.961693+0000', 'last_clean_scrub_stamp': '2024-09-11T00:15:10.961693+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-11T00:15:15.642 INFO:tasks.ceph.ceph_manager.ceph:PG 6.22 is not active+clean 2024-09-11T00:15:15.642 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-11T00:15:10.961693+0000', 'last_change': '2024-09-11T00:15:10.961693+0000', 'last_active': '2024-09-11T00:15:10.961693+0000', 'last_peered': '2024-09-11T00:15:10.961693+0000', 'last_clean': '2024-09-11T00:15:10.961693+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T00:15:10.961693+0000', 'last_undegraded': '2024-09-11T00:15:10.961693+0000', 'last_fullsized': '2024-09-11T00:15:10.961693+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T00:15:10.961693+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T00:15:10.961693+0000', 'last_clean_scrub_stamp': '2024-09-11T00:15:10.961693+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-11T00:15:15.642 INFO:tasks.ceph.ceph_manager.ceph:PG 5.1f is not active+clean 2024-09-11T00:15:15.642 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-09-11T00:15:09.965757+0000', 'last_change': '2024-09-11T00:15:09.965757+0000', 'last_active': '2024-09-11T00:15:09.955417+0000', 'last_peered': '2024-09-11T00:15:09.955417+0000', 'last_clean': '2024-09-11T00:15:09.955417+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T00:15:09.965757+0000', 'last_undegraded': '2024-09-11T00:15:09.965757+0000', 'last_fullsized': '2024-09-11T00:15:09.965757+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T00:15:09.955417+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T00:15:09.955417+0000', 'last_clean_scrub_stamp': '2024-09-11T00:15:09.955417+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-11T00:15:15.642 INFO:tasks.ceph.ceph_manager.ceph:PG 6.14 is not active+clean 2024-09-11T00:15:15.642 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-09-11T00:15:10.972569+0000', 'last_change': '2024-09-11T00:15:10.972569+0000', 'last_active': '2024-09-11T00:15:10.961693+0000', 'last_peered': '2024-09-11T00:15:10.961693+0000', 'last_clean': '2024-09-11T00:15:10.961693+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T00:15:10.972569+0000', 'last_undegraded': '2024-09-11T00:15:10.972569+0000', 'last_fullsized': '2024-09-11T00:15:10.972569+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T00:15:10.961693+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T00:15:10.961693+0000', 'last_clean_scrub_stamp': '2024-09-11T00:15:10.961693+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-11T00:15:15.642 INFO:tasks.ceph.ceph_manager.ceph:PG 5.11 is not active+clean 2024-09-11T00:15:15.642 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-09-11T00:15:09.965664+0000', 'last_change': '2024-09-11T00:15:09.965664+0000', 'last_active': '2024-09-11T00:15:09.955417+0000', 'last_peered': '2024-09-11T00:15:09.955417+0000', 'last_clean': '2024-09-11T00:15:09.955417+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T00:15:09.965664+0000', 'last_undegraded': '2024-09-11T00:15:09.965664+0000', 'last_fullsized': '2024-09-11T00:15:09.965664+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T00:15:09.955417+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T00:15:09.955417+0000', 'last_clean_scrub_stamp': '2024-09-11T00:15:09.955417+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-11T00:15:15.642 INFO:tasks.ceph.ceph_manager.ceph:PG 6.f is not active+clean 2024-09-11T00:15:15.642 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-09-11T00:15:10.972453+0000', 'last_change': '2024-09-11T00:15:10.972453+0000', 'last_active': '2024-09-11T00:15:10.961693+0000', 'last_peered': '2024-09-11T00:15:10.961693+0000', 'last_clean': '2024-09-11T00:15:10.961693+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T00:15:10.972453+0000', 'last_undegraded': '2024-09-11T00:15:10.972453+0000', 'last_fullsized': '2024-09-11T00:15:10.972453+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T00:15:10.961693+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T00:15:10.961693+0000', 'last_clean_scrub_stamp': '2024-09-11T00:15:10.961693+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-11T00:15:15.642 INFO:tasks.ceph.ceph_manager.ceph:PG 5.2 is not active+clean 2024-09-11T00:15:15.643 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-09-11T00:15:09.965689+0000', 'last_change': '2024-09-11T00:15:09.965689+0000', 'last_active': '2024-09-11T00:15:09.955417+0000', 'last_peered': '2024-09-11T00:15:09.955417+0000', 'last_clean': '2024-09-11T00:15:09.955417+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T00:15:09.965689+0000', 'last_undegraded': '2024-09-11T00:15:09.965689+0000', 'last_fullsized': '2024-09-11T00:15:09.965689+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T00:15:09.955417+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T00:15:09.955417+0000', 'last_clean_scrub_stamp': '2024-09-11T00:15:09.955417+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-11T00:15:15.643 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-11T00:15:15.776 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:15.774+0000 7f362c0f6640 1 -- 172.21.15.92:0/3093906274 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f362415c470 msgr2=0x7f362415c8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:15.776 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:15.774+0000 7f362c0f6640 1 --2- 172.21.15.92:0/3093906274 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f362415c470 0x7f362415c8b0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f3614009900 tx=0x7f361402a560 comp rx=0 tx=0).stop 2024-09-11T00:15:15.776 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:15.774+0000 7f362c0f6640 1 -- 172.21.15.92:0/3093906274 shutdown_connections 2024-09-11T00:15:15.776 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:15.774+0000 7f362c0f6640 1 --2- 172.21.15.92:0/3093906274 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f362415c470 0x7f362415c8b0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:15.776 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:15.774+0000 7f362c0f6640 1 --2- 172.21.15.92:0/3093906274 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3624073780 0x7f3624073b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:15.776 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:15.774+0000 7f362c0f6640 1 -- 172.21.15.92:0/3093906274 >> 172.21.15.92:0/3093906274 conn(0x7f36240b1760 msgr2=0x7f36240b1b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:15:15.776 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:15.774+0000 7f362c0f6640 1 -- 172.21.15.92:0/3093906274 shutdown_connections 2024-09-11T00:15:15.777 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:15.774+0000 7f362c0f6640 1 -- 172.21.15.92:0/3093906274 wait complete. 2024-09-11T00:15:15.777 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:15.775+0000 7f362c0f6640 1 Processor -- start 2024-09-11T00:15:15.777 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:15.775+0000 7f362c0f6640 1 -- start start 2024-09-11T00:15:15.779 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:15.776+0000 7f362c0f6640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3624072560 0x7f3624154e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:15.779 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:15.776+0000 7f362c0f6640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3624073780 0x7f3624155b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:15.779 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:15.776+0000 7f362c0f6640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f362415c470 0x7f362415aca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:15.779 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:15.776+0000 7f362c0f6640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f362415cf70 con 0x7f362415c470 2024-09-11T00:15:15.779 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:15.776+0000 7f362c0f6640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f362415cdf0 con 0x7f3624073780 2024-09-11T00:15:15.779 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:15.776+0000 7f362c0f6640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f3624070150 con 0x7f3624072560 2024-09-11T00:15:15.779 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:15.776+0000 7f362a693640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f362415c470 0x7f362415aca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:15.780 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:15.776+0000 7f362a693640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f362415c470 0x7f362415aca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:54700/0 (socket says 172.21.15.92:54700) 2024-09-11T00:15:15.780 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:15.776+0000 7f362a693640 1 -- 172.21.15.92:0/3611610545 learned_addr learned my addr 172.21.15.92:0/3611610545 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-11T00:15:15.780 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:15.776+0000 7f3629e92640 1 --2- 172.21.15.92:0/3611610545 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3624072560 0x7f3624154e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:15.780 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:15.776+0000 7f3629691640 1 --2- 172.21.15.92:0/3611610545 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3624073780 0x7f3624155b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:15.780 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:15.776+0000 7f362a693640 1 -- 172.21.15.92:0/3611610545 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3624072560 msgr2=0x7f3624154e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:15.780 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:15.776+0000 7f362a693640 1 --2- 172.21.15.92:0/3611610545 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3624072560 0x7f3624154e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:15.780 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:15.776+0000 7f362a693640 1 -- 172.21.15.92:0/3611610545 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3624073780 msgr2=0x7f3624155b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:15.780 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:15.776+0000 7f362a693640 1 --2- 172.21.15.92:0/3611610545 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3624073780 0x7f3624155b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:15.780 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:15.776+0000 7f362a693640 1 -- 172.21.15.92:0/3611610545 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36241f83e0 con 0x7f362415c470 2024-09-11T00:15:15.780 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:15.777+0000 7f362a693640 1 --2- 172.21.15.92:0/3611610545 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f362415c470 0x7f362415aca0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f361c00c780 tx=0x7f361c00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:15:15.780 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:15.777+0000 7f361a7fc640 1 -- 172.21.15.92:0/3611610545 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f361c004b60 con 0x7f362415c470 2024-09-11T00:15:15.780 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:15.777+0000 7f361a7fc640 1 -- 172.21.15.92:0/3611610545 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f361c004df0 con 0x7f362415c470 2024-09-11T00:15:15.780 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:15.777+0000 7f361a7fc640 1 -- 172.21.15.92:0/3611610545 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f361c00aa70 con 0x7f362415c470 2024-09-11T00:15:15.780 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:15.777+0000 7f362c0f6640 1 -- 172.21.15.92:0/3611610545 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f36241f86c0 con 0x7f362415c470 2024-09-11T00:15:15.781 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:15.777+0000 7f362c0f6640 1 -- 172.21.15.92:0/3611610545 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36241f8c80 con 0x7f362415c470 2024-09-11T00:15:15.781 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:15.778+0000 7f362c0f6640 1 -- 172.21.15.92:0/3611610545 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3624073200 con 0x7f362415c470 2024-09-11T00:15:15.781 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:15.778+0000 7f361a7fc640 1 -- 172.21.15.92:0/3611610545 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f361c00ac10 con 0x7f362415c470 2024-09-11T00:15:15.781 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:15.779+0000 7f361a7fc640 1 --2- 172.21.15.92:0/3611610545 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f3608077f70 0x7f360807a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:15.782 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:15.779+0000 7f361a7fc640 1 -- 172.21.15.92:0/3611610545 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7f361c09a1c0 con 0x7f362415c470 2024-09-11T00:15:15.782 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:15.779+0000 7f3629e92640 1 --2- 172.21.15.92:0/3611610545 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f3608077f70 0x7f360807a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:15.782 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:15.779+0000 7f3629e92640 1 --2- 172.21.15.92:0/3611610545 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f3608077f70 0x7f360807a430 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f3620005fd0 tx=0x7f3620005850 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:15:15.784 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:15.783+0000 7f361a7fc640 1 -- 172.21.15.92:0/3611610545 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f361c020070 con 0x7f362415c470 2024-09-11T00:15:15.940 INFO:tasks.ceph.mds.a.smithi092.stderr:2024-09-11T00:15:15.939+0000 7fab3f788640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-11T00:15:16.028 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:16.027+0000 7f362c0f6640 1 -- 172.21.15.92:0/3611610545 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f36240cd6d0 con 0x7f362415c470 2024-09-11T00:15:16.029 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:16.027+0000 7f361a7fc640 1 -- 172.21.15.92:0/3611610545 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1764 (secure 0 0 0) 0x7f361c062b30 con 0x7f362415c470 2024-09-11T00:15:16.029 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:15:16.029 INFO:teuthology.orchestra.run.smithi092.stdout:{"fsid":"47039cb3-5d2a-46bf-9066-8055b5dfc583","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":82,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":39,"num_osds":8,"num_up_osds":8,"osd_up_since":1726013646,"num_in_osds":8,"osd_in_since":1726013636,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":82},{"state_name":"creating+peering","count":9},{"state_name":"unknown","count":6}],"num_pgs":97,"num_pools":3,"num_objects":19,"data_bytes":592126,"bytes_used":226017280,"bytes_avail":772868096000,"bytes_total":773094113280,"unknown_pgs_ratio":0.061855670064687729,"inactive_pgs_ratio":0.092783503234386444,"write_bytes_sec":2841,"read_op_per_sec":0,"write_op_per_sec":8},"fsmap":{"epoch":15,"btime":"2024-09-11T00:15:13:987293+0000","id":2,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":2,"rank":0,"name":"a","status":"up:active","gid":5001}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":4,"modified":"2024-09-11T00:15:08.285805+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-11T00:15:16.031 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:16.029+0000 7f362c0f6640 1 -- 172.21.15.92:0/3611610545 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f3608077f70 msgr2=0x7f360807a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:16.031 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:16.029+0000 7f362c0f6640 1 --2- 172.21.15.92:0/3611610545 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f3608077f70 0x7f360807a430 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f3620005fd0 tx=0x7f3620005850 comp rx=0 tx=0).stop 2024-09-11T00:15:16.031 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:16.029+0000 7f362c0f6640 1 -- 172.21.15.92:0/3611610545 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f362415c470 msgr2=0x7f362415aca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:16.031 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:16.029+0000 7f362c0f6640 1 --2- 172.21.15.92:0/3611610545 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f362415c470 0x7f362415aca0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f361c00c780 tx=0x7f361c00cc40 comp rx=0 tx=0).stop 2024-09-11T00:15:16.031 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:16.029+0000 7f362c0f6640 1 -- 172.21.15.92:0/3611610545 shutdown_connections 2024-09-11T00:15:16.032 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:16.029+0000 7f362c0f6640 1 --2- 172.21.15.92:0/3611610545 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f3608077f70 0x7f360807a430 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:16.032 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:16.029+0000 7f362c0f6640 1 --2- 172.21.15.92:0/3611610545 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f362415c470 0x7f362415aca0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:16.032 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:16.029+0000 7f362c0f6640 1 --2- 172.21.15.92:0/3611610545 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3624073780 0x7f3624155b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:16.032 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:16.029+0000 7f362c0f6640 1 --2- 172.21.15.92:0/3611610545 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3624072560 0x7f3624154e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:16.032 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:16.029+0000 7f362c0f6640 1 -- 172.21.15.92:0/3611610545 >> 172.21.15.92:0/3611610545 conn(0x7f36240b1760 msgr2=0x7f36240cd9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:15:16.032 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:16.029+0000 7f362c0f6640 1 -- 172.21.15.92:0/3611610545 shutdown_connections 2024-09-11T00:15:16.032 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:16.029+0000 7f362c0f6640 1 -- 172.21.15.92:0/3611610545 wait complete. 2024-09-11T00:15:16.041 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-11T00:15:16.042 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T00:15:16.142 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:16.140+0000 7fcc80457640 1 -- 172.21.15.92:0/2296543705 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcc78072680 msgr2=0x7fcc780ceb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:16.142 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:16.140+0000 7fcc80457640 1 --2- 172.21.15.92:0/2296543705 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcc78072680 0x7fcc780ceb00 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fcc7806de10 tx=0x7fcc6c02a4a0 comp rx=0 tx=0).stop 2024-09-11T00:15:16.142 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:16.140+0000 7fcc80457640 1 -- 172.21.15.92:0/2296543705 shutdown_connections 2024-09-11T00:15:16.142 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:16.140+0000 7fcc80457640 1 --2- 172.21.15.92:0/2296543705 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcc78072680 0x7fcc780ceb00 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:16.142 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:16.140+0000 7fcc80457640 1 --2- 172.21.15.92:0/2296543705 >> v2:172.21.15.145:3300/0 conn(0x7fcc78144780 0x7fcc780b3da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:16.142 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:16.140+0000 7fcc80457640 1 -- 172.21.15.92:0/2296543705 >> 172.21.15.92:0/2296543705 conn(0x7fcc780b1760 msgr2=0x7fcc780b1b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:15:16.142 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:16.140+0000 7fcc80457640 1 -- 172.21.15.92:0/2296543705 shutdown_connections 2024-09-11T00:15:16.142 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:16.140+0000 7fcc80457640 1 -- 172.21.15.92:0/2296543705 wait complete. 2024-09-11T00:15:16.145 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:16.141+0000 7fcc80457640 1 Processor -- start 2024-09-11T00:15:16.145 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:16.141+0000 7fcc80457640 1 -- start start 2024-09-11T00:15:16.145 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:16.142+0000 7fcc80457640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fcc78072680 0x7fcc7815a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:16.145 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:16.142+0000 7fcc80457640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcc78072ad0 0x7fcc781384c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:16.145 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:16.142+0000 7fcc80457640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fcc78144780 0x7fcc780cd9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:16.145 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:16.142+0000 7fcc80457640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fcc780cf3d0 con 0x7fcc78072ad0 2024-09-11T00:15:16.145 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:16.142+0000 7fcc80457640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fcc780cf250 con 0x7fcc78144780 2024-09-11T00:15:16.145 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:16.142+0000 7fcc80457640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7fcc7815cc60 con 0x7fcc78072680 2024-09-11T00:15:16.145 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:16.142+0000 7fcc7d9f2640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcc78072ad0 0x7fcc781384c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:16.145 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:16.142+0000 7fcc7d9f2640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcc78072ad0 0x7fcc781384c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:54728/0 (socket says 172.21.15.92:54728) 2024-09-11T00:15:16.146 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:16.142+0000 7fcc7d9f2640 1 -- 172.21.15.92:0/3378047249 learned_addr learned my addr 172.21.15.92:0/3378047249 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-11T00:15:16.146 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:16.142+0000 7fcc7e9f4640 1 --2- 172.21.15.92:0/3378047249 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fcc78144780 0x7fcc780cd9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:16.146 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:16.142+0000 7fcc7d9f2640 1 -- 172.21.15.92:0/3378047249 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fcc78072680 msgr2=0x7fcc7815a6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:16.146 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:16.142+0000 7fcc7d9f2640 1 --2- 172.21.15.92:0/3378047249 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fcc78072680 0x7fcc7815a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:16.146 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:16.142+0000 7fcc7d9f2640 1 -- 172.21.15.92:0/3378047249 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fcc78144780 msgr2=0x7fcc780cd9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:16.146 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:16.142+0000 7fcc7d9f2640 1 --2- 172.21.15.92:0/3378047249 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fcc78144780 0x7fcc780cd9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:16.146 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:16.142+0000 7fcc7d9f2640 1 -- 172.21.15.92:0/3378047249 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc781f2980 con 0x7fcc78072ad0 2024-09-11T00:15:16.146 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:16.142+0000 7fcc7e9f4640 1 --2- 172.21.15.92:0/3378047249 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fcc78144780 0x7fcc780cd9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:15:16.146 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:16.142+0000 7fcc7d9f2640 1 --2- 172.21.15.92:0/3378047249 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcc78072ad0 0x7fcc781384c0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fcc6c009780 tx=0x7fcc6c032d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:15:16.146 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:16.143+0000 7fcc76ffd640 1 -- 172.21.15.92:0/3378047249 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc6c040070 con 0x7fcc78072ad0 2024-09-11T00:15:16.146 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:16.143+0000 7fcc76ffd640 1 -- 172.21.15.92:0/3378047249 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcc6c005310 con 0x7fcc78072ad0 2024-09-11T00:15:16.146 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:16.143+0000 7fcc80457640 1 -- 172.21.15.92:0/3378047249 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc781f2c60 con 0x7fcc78072ad0 2024-09-11T00:15:16.146 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:16.143+0000 7fcc76ffd640 1 -- 172.21.15.92:0/3378047249 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc6c003800 con 0x7fcc78072ad0 2024-09-11T00:15:16.147 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:16.143+0000 7fcc80457640 1 -- 172.21.15.92:0/3378047249 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc781f3220 con 0x7fcc78072ad0 2024-09-11T00:15:16.147 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:16.143+0000 7fcc80457640 1 -- 172.21.15.92:0/3378047249 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcc780ceb00 con 0x7fcc78072ad0 2024-09-11T00:15:16.147 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:16.144+0000 7fcc76ffd640 1 -- 172.21.15.92:0/3378047249 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fcc6c0039a0 con 0x7fcc78072ad0 2024-09-11T00:15:16.148 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:16.145+0000 7fcc76ffd640 1 --2- 172.21.15.92:0/3378047249 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7fcc64077fa0 0x7fcc6407a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:16.148 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:16.145+0000 7fcc76ffd640 1 -- 172.21.15.92:0/3378047249 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7fcc6c0bb570 con 0x7fcc78072ad0 2024-09-11T00:15:16.148 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:16.145+0000 7fcc7e1f3640 1 --2- 172.21.15.92:0/3378047249 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7fcc64077fa0 0x7fcc6407a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:16.148 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:16.146+0000 7fcc7e1f3640 1 --2- 172.21.15.92:0/3378047249 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7fcc64077fa0 0x7fcc6407a460 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fcc78137ed0 tx=0x7fcc68009250 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:15:16.150 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:16.149+0000 7fcc76ffd640 1 -- 172.21.15.92:0/3378047249 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fcc6c083e60 con 0x7fcc78072ad0 2024-09-11T00:15:16.190 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T00:15:16.193 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T00:15:16.325 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:16.323+0000 7fcc80457640 1 -- 172.21.15.92:0/3378047249 --> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fcc780b4d40 con 0x7fcc64077fa0 2024-09-11T00:15:16.329 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:16.328+0000 7fcc76ffd640 1 -- 172.21.15.92:0/3378047249 <== mgr.4100 v2:172.21.15.145:6800/325490785 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251445 (secure 0 0 0) 0x7fcc780b4d40 con 0x7fcc64077fa0 2024-09-11T00:15:16.332 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:15:16.333 INFO:teuthology.orchestra.run.smithi092.stderr:dumped all 2024-09-11T00:15:16.334 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:16.331+0000 7fcc80457640 1 -- 172.21.15.92:0/3378047249 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7fcc64077fa0 msgr2=0x7fcc6407a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:16.334 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:16.331+0000 7fcc80457640 1 --2- 172.21.15.92:0/3378047249 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7fcc64077fa0 0x7fcc6407a460 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fcc78137ed0 tx=0x7fcc68009250 comp rx=0 tx=0).stop 2024-09-11T00:15:16.334 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:16.331+0000 7fcc80457640 1 -- 172.21.15.92:0/3378047249 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcc78072ad0 msgr2=0x7fcc781384c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:16.335 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:16.331+0000 7fcc80457640 1 --2- 172.21.15.92:0/3378047249 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcc78072ad0 0x7fcc781384c0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fcc6c009780 tx=0x7fcc6c032d50 comp rx=0 tx=0).stop 2024-09-11T00:15:16.335 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:16.331+0000 7fcc80457640 1 -- 172.21.15.92:0/3378047249 shutdown_connections 2024-09-11T00:15:16.335 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:16.331+0000 7fcc80457640 1 --2- 172.21.15.92:0/3378047249 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7fcc64077fa0 0x7fcc6407a460 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:16.335 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:16.331+0000 7fcc80457640 1 --2- 172.21.15.92:0/3378047249 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fcc78144780 0x7fcc780cd9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:16.335 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:16.331+0000 7fcc80457640 1 --2- 172.21.15.92:0/3378047249 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcc78072ad0 0x7fcc781384c0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:16.335 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:16.331+0000 7fcc80457640 1 --2- 172.21.15.92:0/3378047249 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fcc78072680 0x7fcc7815a6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:16.335 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:16.331+0000 7fcc80457640 1 -- 172.21.15.92:0/3378047249 >> 172.21.15.92:0/3378047249 conn(0x7fcc780b1760 msgr2=0x7fcc780d04b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:15:16.335 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:16.331+0000 7fcc80457640 1 -- 172.21.15.92:0/3378047249 shutdown_connections 2024-09-11T00:15:16.335 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:16.331+0000 7fcc80457640 1 -- 172.21.15.92:0/3378047249 wait complete. 2024-09-11T00:15:16.344 INFO:teuthology.orchestra.run.smithi092.stdout:{"pg_ready":true,"pg_map":{"version":68,"stamp":"2024-09-11T00:15:16.287088+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592708,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":143,"num_write_kb":1641,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":107,"ondisk_log_size":107,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220768,"kb_used_data":4512,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753952,"statfs":{"total":773094113280,"available":772868046848,"internally_reserved":0,"allocated":4620288,"data_stored":2646930,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":26,"apply_latency_ms":26,"commit_latency_ns":26000000,"apply_latency_ns":26000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2340,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001027"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:11.996813+0000","last_change":"2024-09-11T00:15:11.990745+0000","last_active":"2024-09-11T00:15:11.996813+0000","last_peered":"2024-09-11T00:15:11.996813+0000","last_clean":"2024-09-11T00:15:11.996813+0000","last_became_active":"2024-09-11T00:15:11.990485+0000","last_became_peered":"2024-09-11T00:15:11.990485+0000","last_unstale":"2024-09-11T00:15:11.996813+0000","last_undegraded":"2024-09-11T00:15:11.996813+0000","last_fullsized":"2024-09-11T00:15:11.996813+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:14:44.693719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:11.996830+0000","last_change":"2024-09-11T00:15:11.989933+0000","last_active":"2024-09-11T00:15:11.996830+0000","last_peered":"2024-09-11T00:15:11.996830+0000","last_clean":"2024-09-11T00:15:11.996830+0000","last_became_active":"2024-09-11T00:15:11.989547+0000","last_became_peered":"2024-09-11T00:15:11.989547+0000","last_unstale":"2024-09-11T00:15:11.996830+0000","last_undegraded":"2024-09-11T00:15:11.996830+0000","last_fullsized":"2024-09-11T00:15:11.996830+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:38:48.432712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:11.999391+0000","last_change":"2024-09-11T00:15:11.996802+0000","last_active":"2024-09-11T00:15:11.999391+0000","last_peered":"2024-09-11T00:15:11.999391+0000","last_clean":"2024-09-11T00:15:11.999391+0000","last_became_active":"2024-09-11T00:15:11.996464+0000","last_became_peered":"2024-09-11T00:15:11.996464+0000","last_unstale":"2024-09-11T00:15:11.999391+0000","last_undegraded":"2024-09-11T00:15:11.999391+0000","last_fullsized":"2024-09-11T00:15:11.999391+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:48:53.696945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-11T00:15:10.973081+0000","last_change":"2024-09-11T00:15:10.973081+0000","last_active":"2024-09-11T00:15:10.961693+0000","last_peered":"2024-09-11T00:15:10.961693+0000","last_clean":"2024-09-11T00:15:10.961693+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:15:10.973081+0000","last_undegraded":"2024-09-11T00:15:10.973081+0000","last_fullsized":"2024-09-11T00:15:10.973081+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-11T00:15:10.972932+0000","last_change":"2024-09-11T00:15:10.972932+0000","last_active":"2024-09-11T00:15:10.961693+0000","last_peered":"2024-09-11T00:15:10.961693+0000","last_clean":"2024-09-11T00:15:10.961693+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:15:10.972932+0000","last_undegraded":"2024-09-11T00:15:10.972932+0000","last_fullsized":"2024-09-11T00:15:10.972932+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:11.987916+0000","last_change":"2024-09-11T00:15:11.981800+0000","last_active":"2024-09-11T00:15:11.987916+0000","last_peered":"2024-09-11T00:15:11.987916+0000","last_clean":"2024-09-11T00:15:11.987916+0000","last_became_active":"2024-09-11T00:15:11.981553+0000","last_became_peered":"2024-09-11T00:15:11.981553+0000","last_unstale":"2024-09-11T00:15:11.987916+0000","last_undegraded":"2024-09-11T00:15:11.987916+0000","last_fullsized":"2024-09-11T00:15:11.987916+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:28:04.414078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:11.995625+0000","last_change":"2024-09-11T00:15:11.985908+0000","last_active":"2024-09-11T00:15:11.995625+0000","last_peered":"2024-09-11T00:15:11.995625+0000","last_clean":"2024-09-11T00:15:11.995625+0000","last_became_active":"2024-09-11T00:15:11.983107+0000","last_became_peered":"2024-09-11T00:15:11.983107+0000","last_unstale":"2024-09-11T00:15:11.995625+0000","last_undegraded":"2024-09-11T00:15:11.995625+0000","last_fullsized":"2024-09-11T00:15:11.995625+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:41:28.124141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:11.996966+0000","last_change":"2024-09-11T00:15:11.991693+0000","last_active":"2024-09-11T00:15:11.996966+0000","last_peered":"2024-09-11T00:15:11.996966+0000","last_clean":"2024-09-11T00:15:11.996966+0000","last_became_active":"2024-09-11T00:15:11.991452+0000","last_became_peered":"2024-09-11T00:15:11.991452+0000","last_unstale":"2024-09-11T00:15:11.996966+0000","last_undegraded":"2024-09-11T00:15:11.996966+0000","last_fullsized":"2024-09-11T00:15:11.996966+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:19:07.626300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:11.999360+0000","last_change":"2024-09-11T00:15:11.996272+0000","last_active":"2024-09-11T00:15:11.999360+0000","last_peered":"2024-09-11T00:15:11.999360+0000","last_clean":"2024-09-11T00:15:11.999360+0000","last_became_active":"2024-09-11T00:15:11.996016+0000","last_became_peered":"2024-09-11T00:15:11.996016+0000","last_unstale":"2024-09-11T00:15:11.999360+0000","last_undegraded":"2024-09-11T00:15:11.999360+0000","last_fullsized":"2024-09-11T00:15:11.999360+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:16:47.443195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:12.004395+0000","last_change":"2024-09-11T00:15:12.000547+0000","last_active":"2024-09-11T00:15:12.004395+0000","last_peered":"2024-09-11T00:15:12.004395+0000","last_clean":"2024-09-11T00:15:12.004395+0000","last_became_active":"2024-09-11T00:15:12.000275+0000","last_became_peered":"2024-09-11T00:15:12.000275+0000","last_unstale":"2024-09-11T00:15:12.004395+0000","last_undegraded":"2024-09-11T00:15:12.004395+0000","last_fullsized":"2024-09-11T00:15:12.004395+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:49:11.620971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:11.998030+0000","last_change":"2024-09-11T00:15:11.991652+0000","last_active":"2024-09-11T00:15:11.998030+0000","last_peered":"2024-09-11T00:15:11.998030+0000","last_clean":"2024-09-11T00:15:11.998030+0000","last_became_active":"2024-09-11T00:15:11.990905+0000","last_became_peered":"2024-09-11T00:15:11.990905+0000","last_unstale":"2024-09-11T00:15:11.998030+0000","last_undegraded":"2024-09-11T00:15:11.998030+0000","last_fullsized":"2024-09-11T00:15:11.998030+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:14:44.693719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:11.988524+0000","last_change":"2024-09-11T00:15:11.984051+0000","last_active":"2024-09-11T00:15:11.988524+0000","last_peered":"2024-09-11T00:15:11.988524+0000","last_clean":"2024-09-11T00:15:11.988524+0000","last_became_active":"2024-09-11T00:15:11.983773+0000","last_became_peered":"2024-09-11T00:15:11.983773+0000","last_unstale":"2024-09-11T00:15:11.988524+0000","last_undegraded":"2024-09-11T00:15:11.988524+0000","last_fullsized":"2024-09-11T00:15:11.988524+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:34:51.768105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:12.003723+0000","last_change":"2024-09-11T00:15:12.000158+0000","last_active":"2024-09-11T00:15:12.003723+0000","last_peered":"2024-09-11T00:15:12.003723+0000","last_clean":"2024-09-11T00:15:12.003723+0000","last_became_active":"2024-09-11T00:15:11.999876+0000","last_became_peered":"2024-09-11T00:15:11.999876+0000","last_unstale":"2024-09-11T00:15:12.003723+0000","last_undegraded":"2024-09-11T00:15:12.003723+0000","last_fullsized":"2024-09-11T00:15:12.003723+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:51:23.369565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:11.999202+0000","last_change":"2024-09-11T00:15:11.990614+0000","last_active":"2024-09-11T00:15:11.999202+0000","last_peered":"2024-09-11T00:15:11.999202+0000","last_clean":"2024-09-11T00:15:11.999202+0000","last_became_active":"2024-09-11T00:15:11.990346+0000","last_became_peered":"2024-09-11T00:15:11.990346+0000","last_unstale":"2024-09-11T00:15:11.999202+0000","last_undegraded":"2024-09-11T00:15:11.999202+0000","last_fullsized":"2024-09-11T00:15:11.999202+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:29:18.376105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:11.995647+0000","last_change":"2024-09-11T00:15:11.986763+0000","last_active":"2024-09-11T00:15:11.995647+0000","last_peered":"2024-09-11T00:15:11.995647+0000","last_clean":"2024-09-11T00:15:11.995647+0000","last_became_active":"2024-09-11T00:15:11.986468+0000","last_became_peered":"2024-09-11T00:15:11.986468+0000","last_unstale":"2024-09-11T00:15:11.995647+0000","last_undegraded":"2024-09-11T00:15:11.995647+0000","last_fullsized":"2024-09-11T00:15:11.995647+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:59:36.084840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:12.009647+0000","last_change":"2024-09-11T00:15:12.005753+0000","last_active":"2024-09-11T00:15:12.009647+0000","last_peered":"2024-09-11T00:15:12.009647+0000","last_clean":"2024-09-11T00:15:12.009647+0000","last_became_active":"2024-09-11T00:15:12.005460+0000","last_became_peered":"2024-09-11T00:15:12.005460+0000","last_unstale":"2024-09-11T00:15:12.009647+0000","last_undegraded":"2024-09-11T00:15:12.009647+0000","last_fullsized":"2024-09-11T00:15:12.009647+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:56:07.914915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:12.009660+0000","last_change":"2024-09-11T00:15:12.005879+0000","last_active":"2024-09-11T00:15:12.009660+0000","last_peered":"2024-09-11T00:15:12.009660+0000","last_clean":"2024-09-11T00:15:12.009660+0000","last_became_active":"2024-09-11T00:15:12.005591+0000","last_became_peered":"2024-09-11T00:15:12.005591+0000","last_unstale":"2024-09-11T00:15:12.009660+0000","last_undegraded":"2024-09-11T00:15:12.009660+0000","last_fullsized":"2024-09-11T00:15:12.009660+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:58:17.603588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T00:15:13.042586+0000","last_change":"2024-09-11T00:15:11.993586+0000","last_active":"2024-09-11T00:15:13.042586+0000","last_peered":"2024-09-11T00:15:13.042586+0000","last_clean":"2024-09-11T00:15:13.042586+0000","last_became_active":"2024-09-11T00:15:11.993208+0000","last_became_peered":"2024-09-11T00:15:11.993208+0000","last_unstale":"2024-09-11T00:15:13.042586+0000","last_undegraded":"2024-09-11T00:15:13.042586+0000","last_fullsized":"2024-09-11T00:15:13.042586+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:20:35.158910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-11T00:15:10.972624+0000","last_change":"2024-09-11T00:15:10.972624+0000","last_active":"2024-09-11T00:15:10.961693+0000","last_peered":"2024-09-11T00:15:10.961693+0000","last_clean":"2024-09-11T00:15:10.961693+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:15:10.972624+0000","last_undegraded":"2024-09-11T00:15:10.972624+0000","last_fullsized":"2024-09-11T00:15:10.972624+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T00:15:13.042527+0000","last_change":"2024-09-11T00:15:11.994474+0000","last_active":"2024-09-11T00:15:13.042527+0000","last_peered":"2024-09-11T00:15:13.042527+0000","last_clean":"2024-09-11T00:15:13.042527+0000","last_became_active":"2024-09-11T00:15:11.994161+0000","last_became_peered":"2024-09-11T00:15:11.994161+0000","last_unstale":"2024-09-11T00:15:13.042527+0000","last_undegraded":"2024-09-11T00:15:13.042527+0000","last_fullsized":"2024-09-11T00:15:13.042527+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:22:56.635297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:11.995476+0000","last_change":"2024-09-11T00:15:11.982721+0000","last_active":"2024-09-11T00:15:11.995476+0000","last_peered":"2024-09-11T00:15:11.995476+0000","last_clean":"2024-09-11T00:15:11.995476+0000","last_became_active":"2024-09-11T00:15:11.981979+0000","last_became_peered":"2024-09-11T00:15:11.981979+0000","last_unstale":"2024-09-11T00:15:11.995476+0000","last_undegraded":"2024-09-11T00:15:11.995476+0000","last_fullsized":"2024-09-11T00:15:11.995476+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:29:04.812424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:12.001333+0000","last_change":"2024-09-11T00:15:11.996951+0000","last_active":"2024-09-11T00:15:12.001333+0000","last_peered":"2024-09-11T00:15:12.001333+0000","last_clean":"2024-09-11T00:15:12.001333+0000","last_became_active":"2024-09-11T00:15:11.996664+0000","last_became_peered":"2024-09-11T00:15:11.996664+0000","last_unstale":"2024-09-11T00:15:12.001333+0000","last_undegraded":"2024-09-11T00:15:12.001333+0000","last_fullsized":"2024-09-11T00:15:12.001333+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:30:48.631902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:12.009565+0000","last_change":"2024-09-11T00:15:12.004148+0000","last_active":"2024-09-11T00:15:12.009565+0000","last_peered":"2024-09-11T00:15:12.009565+0000","last_clean":"2024-09-11T00:15:12.009565+0000","last_became_active":"2024-09-11T00:15:12.003829+0000","last_became_peered":"2024-09-11T00:15:12.003829+0000","last_unstale":"2024-09-11T00:15:12.009565+0000","last_undegraded":"2024-09-11T00:15:12.009565+0000","last_fullsized":"2024-09-11T00:15:12.009565+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:43:33.394237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-11T00:15:10.972983+0000","last_change":"2024-09-11T00:15:10.972983+0000","last_active":"2024-09-11T00:15:10.961693+0000","last_peered":"2024-09-11T00:15:10.961693+0000","last_clean":"2024-09-11T00:15:10.961693+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:15:10.972983+0000","last_undegraded":"2024-09-11T00:15:10.972983+0000","last_fullsized":"2024-09-11T00:15:10.972983+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T00:15:13.042679+0000","last_change":"2024-09-11T00:15:11.986296+0000","last_active":"2024-09-11T00:15:13.042679+0000","last_peered":"2024-09-11T00:15:13.042679+0000","last_clean":"2024-09-11T00:15:13.042679+0000","last_became_active":"2024-09-11T00:15:11.985641+0000","last_became_peered":"2024-09-11T00:15:11.985641+0000","last_unstale":"2024-09-11T00:15:13.042679+0000","last_undegraded":"2024-09-11T00:15:13.042679+0000","last_fullsized":"2024-09-11T00:15:13.042679+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:01:44.842185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:11.997420+0000","last_change":"2024-09-11T00:15:11.990612+0000","last_active":"2024-09-11T00:15:11.997420+0000","last_peered":"2024-09-11T00:15:11.997420+0000","last_clean":"2024-09-11T00:15:11.997420+0000","last_became_active":"2024-09-11T00:15:11.989737+0000","last_became_peered":"2024-09-11T00:15:11.989737+0000","last_unstale":"2024-09-11T00:15:11.997420+0000","last_undegraded":"2024-09-11T00:15:11.997420+0000","last_fullsized":"2024-09-11T00:15:11.997420+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:16:47.443195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T00:15:13.042602+0000","last_change":"2024-09-11T00:15:11.985470+0000","last_active":"2024-09-11T00:15:13.042602+0000","last_peered":"2024-09-11T00:15:13.042602+0000","last_clean":"2024-09-11T00:15:13.042602+0000","last_became_active":"2024-09-11T00:15:11.985048+0000","last_became_peered":"2024-09-11T00:15:11.985048+0000","last_unstale":"2024-09-11T00:15:13.042602+0000","last_undegraded":"2024-09-11T00:15:13.042602+0000","last_fullsized":"2024-09-11T00:15:13.042602+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:59:38.700143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:11.995375+0000","last_change":"2024-09-11T00:15:11.984503+0000","last_active":"2024-09-11T00:15:11.995375+0000","last_peered":"2024-09-11T00:15:11.995375+0000","last_clean":"2024-09-11T00:15:11.995375+0000","last_became_active":"2024-09-11T00:15:11.984226+0000","last_became_peered":"2024-09-11T00:15:11.984226+0000","last_unstale":"2024-09-11T00:15:11.995375+0000","last_undegraded":"2024-09-11T00:15:11.995375+0000","last_fullsized":"2024-09-11T00:15:11.995375+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:58:17.603588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T00:15:13.042522+0000","last_change":"2024-09-11T00:15:11.984682+0000","last_active":"2024-09-11T00:15:13.042522+0000","last_peered":"2024-09-11T00:15:13.042522+0000","last_clean":"2024-09-11T00:15:13.042522+0000","last_became_active":"2024-09-11T00:15:11.984415+0000","last_became_peered":"2024-09-11T00:15:11.984415+0000","last_unstale":"2024-09-11T00:15:13.042522+0000","last_undegraded":"2024-09-11T00:15:13.042522+0000","last_fullsized":"2024-09-11T00:15:13.042522+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:30:13.497076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T00:15:13.042463+0000","last_change":"2024-09-11T00:15:11.989539+0000","last_active":"2024-09-11T00:15:13.042463+0000","last_peered":"2024-09-11T00:15:13.042463+0000","last_clean":"2024-09-11T00:15:13.042463+0000","last_became_active":"2024-09-11T00:15:11.989289+0000","last_became_peered":"2024-09-11T00:15:11.989289+0000","last_unstale":"2024-09-11T00:15:13.042463+0000","last_undegraded":"2024-09-11T00:15:13.042463+0000","last_fullsized":"2024-09-11T00:15:13.042463+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:35:14.951961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:12.009620+0000","last_change":"2024-09-11T00:15:12.005579+0000","last_active":"2024-09-11T00:15:12.009620+0000","last_peered":"2024-09-11T00:15:12.009620+0000","last_clean":"2024-09-11T00:15:12.009620+0000","last_became_active":"2024-09-11T00:15:12.004267+0000","last_became_peered":"2024-09-11T00:15:12.004267+0000","last_unstale":"2024-09-11T00:15:12.009620+0000","last_undegraded":"2024-09-11T00:15:12.009620+0000","last_fullsized":"2024-09-11T00:15:12.009620+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:21:58.807270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:11.990529+0000","last_change":"2024-09-11T00:15:11.984826+0000","last_active":"2024-09-11T00:15:11.990529+0000","last_peered":"2024-09-11T00:15:11.990529+0000","last_clean":"2024-09-11T00:15:11.990529+0000","last_became_active":"2024-09-11T00:15:11.984307+0000","last_became_peered":"2024-09-11T00:15:11.984307+0000","last_unstale":"2024-09-11T00:15:11.990529+0000","last_undegraded":"2024-09-11T00:15:11.990529+0000","last_fullsized":"2024-09-11T00:15:11.990529+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:27:00.007857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:12.009626+0000","last_change":"2024-09-11T00:15:12.005723+0000","last_active":"2024-09-11T00:15:12.009626+0000","last_peered":"2024-09-11T00:15:12.009626+0000","last_clean":"2024-09-11T00:15:12.009626+0000","last_became_active":"2024-09-11T00:15:12.005398+0000","last_became_peered":"2024-09-11T00:15:12.005398+0000","last_unstale":"2024-09-11T00:15:12.009626+0000","last_undegraded":"2024-09-11T00:15:12.009626+0000","last_fullsized":"2024-09-11T00:15:12.009626+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:29:04.812424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"38'4","reported_seq":19,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T00:15:13.042565+0000","last_change":"2024-09-11T00:15:10.986669+0000","last_active":"2024-09-11T00:15:13.042565+0000","last_peered":"2024-09-11T00:15:13.042565+0000","last_clean":"2024-09-11T00:15:13.042565+0000","last_became_active":"2024-09-11T00:15:10.986409+0000","last_became_peered":"2024-09-11T00:15:10.986409+0000","last_unstale":"2024-09-11T00:15:13.042565+0000","last_undegraded":"2024-09-11T00:15:13.042565+0000","last_fullsized":"2024-09-11T00:15:13.042565+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_clean_scrub_stamp":"2024-09-11T00:15:09.955417+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:36:41.247206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:11.998169+0000","last_change":"2024-09-11T00:15:11.994104+0000","last_active":"2024-09-11T00:15:11.998169+0000","last_peered":"2024-09-11T00:15:11.998169+0000","last_clean":"2024-09-11T00:15:11.998169+0000","last_became_active":"2024-09-11T00:15:11.993787+0000","last_became_peered":"2024-09-11T00:15:11.993787+0000","last_unstale":"2024-09-11T00:15:11.998169+0000","last_undegraded":"2024-09-11T00:15:11.998169+0000","last_fullsized":"2024-09-11T00:15:11.998169+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:36:09.339619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"38'1","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:12.003434+0000","last_change":"2024-09-11T00:15:10.987651+0000","last_active":"2024-09-11T00:15:12.003434+0000","last_peered":"2024-09-11T00:15:12.003434+0000","last_clean":"2024-09-11T00:15:12.003434+0000","last_became_active":"2024-09-11T00:15:10.987365+0000","last_became_peered":"2024-09-11T00:15:10.987365+0000","last_unstale":"2024-09-11T00:15:12.003434+0000","last_undegraded":"2024-09-11T00:15:12.003434+0000","last_fullsized":"2024-09-11T00:15:12.003434+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_clean_scrub_stamp":"2024-09-11T00:15:09.955417+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:53:21.168815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:11.997253+0000","last_change":"2024-09-11T00:15:11.989911+0000","last_active":"2024-09-11T00:15:11.997253+0000","last_peered":"2024-09-11T00:15:11.997253+0000","last_clean":"2024-09-11T00:15:11.997253+0000","last_became_active":"2024-09-11T00:15:11.989434+0000","last_became_peered":"2024-09-11T00:15:11.989434+0000","last_unstale":"2024-09-11T00:15:11.997253+0000","last_undegraded":"2024-09-11T00:15:11.997253+0000","last_fullsized":"2024-09-11T00:15:11.997253+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:09:53.019331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"38'2","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:11.997740+0000","last_change":"2024-09-11T00:15:10.988735+0000","last_active":"2024-09-11T00:15:11.997740+0000","last_peered":"2024-09-11T00:15:11.997740+0000","last_clean":"2024-09-11T00:15:11.997740+0000","last_became_active":"2024-09-11T00:15:10.988449+0000","last_became_peered":"2024-09-11T00:15:10.988449+0000","last_unstale":"2024-09-11T00:15:11.997740+0000","last_undegraded":"2024-09-11T00:15:11.997740+0000","last_fullsized":"2024-09-11T00:15:11.997740+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_clean_scrub_stamp":"2024-09-11T00:15:09.955417+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:34:50.761829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:11.995258+0000","last_change":"2024-09-11T00:15:11.988181+0000","last_active":"2024-09-11T00:15:11.995258+0000","last_peered":"2024-09-11T00:15:11.995258+0000","last_clean":"2024-09-11T00:15:11.995258+0000","last_became_active":"2024-09-11T00:15:11.987724+0000","last_became_peered":"2024-09-11T00:15:11.987724+0000","last_unstale":"2024-09-11T00:15:11.995258+0000","last_undegraded":"2024-09-11T00:15:11.995258+0000","last_fullsized":"2024-09-11T00:15:11.995258+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:59:36.084840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"38'2","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:11.998938+0000","last_change":"2024-09-11T00:15:10.983607+0000","last_active":"2024-09-11T00:15:11.998938+0000","last_peered":"2024-09-11T00:15:11.998938+0000","last_clean":"2024-09-11T00:15:11.998938+0000","last_became_active":"2024-09-11T00:15:10.983327+0000","last_became_peered":"2024-09-11T00:15:10.983327+0000","last_unstale":"2024-09-11T00:15:11.998938+0000","last_undegraded":"2024-09-11T00:15:11.998938+0000","last_fullsized":"2024-09-11T00:15:11.998938+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_clean_scrub_stamp":"2024-09-11T00:15:09.955417+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:25:22.909623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:11.993330+0000","last_change":"2024-09-11T00:15:11.990149+0000","last_active":"2024-09-11T00:15:11.993330+0000","last_peered":"2024-09-11T00:15:11.993330+0000","last_clean":"2024-09-11T00:15:11.993330+0000","last_became_active":"2024-09-11T00:15:11.989909+0000","last_became_peered":"2024-09-11T00:15:11.989909+0000","last_unstale":"2024-09-11T00:15:11.993330+0000","last_undegraded":"2024-09-11T00:15:11.993330+0000","last_fullsized":"2024-09-11T00:15:11.993330+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:28:04.414078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"38'1","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:11.995511+0000","last_change":"2024-09-11T00:15:10.984669+0000","last_active":"2024-09-11T00:15:11.995511+0000","last_peered":"2024-09-11T00:15:11.995511+0000","last_clean":"2024-09-11T00:15:11.995511+0000","last_became_active":"2024-09-11T00:15:10.984215+0000","last_became_peered":"2024-09-11T00:15:10.984215+0000","last_unstale":"2024-09-11T00:15:11.995511+0000","last_undegraded":"2024-09-11T00:15:11.995511+0000","last_fullsized":"2024-09-11T00:15:11.995511+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_clean_scrub_stamp":"2024-09-11T00:15:09.955417+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:28:03.407802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:11.995599+0000","last_change":"2024-09-11T00:15:11.982642+0000","last_active":"2024-09-11T00:15:11.995599+0000","last_peered":"2024-09-11T00:15:11.995599+0000","last_clean":"2024-09-11T00:15:11.995599+0000","last_became_active":"2024-09-11T00:15:11.982021+0000","last_became_peered":"2024-09-11T00:15:11.982021+0000","last_unstale":"2024-09-11T00:15:11.995599+0000","last_undegraded":"2024-09-11T00:15:11.995599+0000","last_fullsized":"2024-09-11T00:15:11.995599+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:21:58.807270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"38'1","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:12.003994+0000","last_change":"2024-09-11T00:15:10.987655+0000","last_active":"2024-09-11T00:15:12.003994+0000","last_peered":"2024-09-11T00:15:12.003994+0000","last_clean":"2024-09-11T00:15:12.003994+0000","last_became_active":"2024-09-11T00:15:10.987373+0000","last_became_peered":"2024-09-11T00:15:10.987373+0000","last_unstale":"2024-09-11T00:15:12.003994+0000","last_undegraded":"2024-09-11T00:15:12.003994+0000","last_fullsized":"2024-09-11T00:15:12.003994+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_clean_scrub_stamp":"2024-09-11T00:15:09.955417+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:41:46.193502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:12.002915+0000","last_change":"2024-09-11T00:15:12.000133+0000","last_active":"2024-09-11T00:15:12.002915+0000","last_peered":"2024-09-11T00:15:12.002915+0000","last_clean":"2024-09-11T00:15:12.002915+0000","last_became_active":"2024-09-11T00:15:11.999840+0000","last_became_peered":"2024-09-11T00:15:11.999840+0000","last_unstale":"2024-09-11T00:15:12.002915+0000","last_undegraded":"2024-09-11T00:15:12.002915+0000","last_fullsized":"2024-09-11T00:15:12.002915+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:16:37.462915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:11.975235+0000","last_change":"2024-09-11T00:15:10.987183+0000","last_active":"2024-09-11T00:15:11.975235+0000","last_peered":"2024-09-11T00:15:11.975235+0000","last_clean":"2024-09-11T00:15:11.975235+0000","last_became_active":"2024-09-11T00:15:10.986886+0000","last_became_peered":"2024-09-11T00:15:10.986886+0000","last_unstale":"2024-09-11T00:15:11.975235+0000","last_undegraded":"2024-09-11T00:15:11.975235+0000","last_fullsized":"2024-09-11T00:15:11.975235+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_clean_scrub_stamp":"2024-09-11T00:15:09.955417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:57:48.764730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:12.008243+0000","last_change":"2024-09-11T00:15:12.002956+0000","last_active":"2024-09-11T00:15:12.008243+0000","last_peered":"2024-09-11T00:15:12.008243+0000","last_clean":"2024-09-11T00:15:12.008243+0000","last_became_active":"2024-09-11T00:15:12.002703+0000","last_became_peered":"2024-09-11T00:15:12.002703+0000","last_unstale":"2024-09-11T00:15:12.008243+0000","last_undegraded":"2024-09-11T00:15:12.008243+0000","last_fullsized":"2024-09-11T00:15:12.008243+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:10:10.614680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:11.982026+0000","last_change":"2024-09-11T00:15:10.977955+0000","last_active":"2024-09-11T00:15:11.982026+0000","last_peered":"2024-09-11T00:15:11.982026+0000","last_clean":"2024-09-11T00:15:11.982026+0000","last_became_active":"2024-09-11T00:15:10.977692+0000","last_became_peered":"2024-09-11T00:15:10.977692+0000","last_unstale":"2024-09-11T00:15:11.982026+0000","last_undegraded":"2024-09-11T00:15:11.982026+0000","last_fullsized":"2024-09-11T00:15:11.982026+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_clean_scrub_stamp":"2024-09-11T00:15:09.955417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:29:56.077160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-11T00:15:10.972569+0000","last_change":"2024-09-11T00:15:10.972569+0000","last_active":"2024-09-11T00:15:10.961693+0000","last_peered":"2024-09-11T00:15:10.961693+0000","last_clean":"2024-09-11T00:15:10.961693+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:15:10.972569+0000","last_undegraded":"2024-09-11T00:15:10.972569+0000","last_fullsized":"2024-09-11T00:15:10.972569+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:11.979505+0000","last_change":"2024-09-11T00:15:10.980706+0000","last_active":"2024-09-11T00:15:11.979505+0000","last_peered":"2024-09-11T00:15:11.979505+0000","last_clean":"2024-09-11T00:15:11.979505+0000","last_became_active":"2024-09-11T00:15:10.980429+0000","last_became_peered":"2024-09-11T00:15:10.980429+0000","last_unstale":"2024-09-11T00:15:11.979505+0000","last_undegraded":"2024-09-11T00:15:11.979505+0000","last_fullsized":"2024-09-11T00:15:11.979505+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_clean_scrub_stamp":"2024-09-11T00:15:09.955417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:21:57.800994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:12.003909+0000","last_change":"2024-09-11T00:15:12.001080+0000","last_active":"2024-09-11T00:15:12.003909+0000","last_peered":"2024-09-11T00:15:12.003909+0000","last_clean":"2024-09-11T00:15:12.003909+0000","last_became_active":"2024-09-11T00:15:11.998765+0000","last_became_peered":"2024-09-11T00:15:11.998765+0000","last_unstale":"2024-09-11T00:15:12.003909+0000","last_undegraded":"2024-09-11T00:15:12.003909+0000","last_fullsized":"2024-09-11T00:15:12.003909+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:27:00.007857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:11.975780+0000","last_change":"2024-09-11T00:15:10.987659+0000","last_active":"2024-09-11T00:15:11.975780+0000","last_peered":"2024-09-11T00:15:11.975780+0000","last_clean":"2024-09-11T00:15:11.975780+0000","last_became_active":"2024-09-11T00:15:10.987382+0000","last_became_peered":"2024-09-11T00:15:10.987382+0000","last_unstale":"2024-09-11T00:15:11.975780+0000","last_undegraded":"2024-09-11T00:15:11.975780+0000","last_fullsized":"2024-09-11T00:15:11.975780+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_clean_scrub_stamp":"2024-09-11T00:15:09.955417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:26:59.001581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:11.999601+0000","last_change":"2024-09-11T00:15:11.998770+0000","last_active":"2024-09-11T00:15:11.999601+0000","last_peered":"2024-09-11T00:15:11.999601+0000","last_clean":"2024-09-11T00:15:11.999601+0000","last_became_active":"2024-09-11T00:15:11.998477+0000","last_became_peered":"2024-09-11T00:15:11.998477+0000","last_unstale":"2024-09-11T00:15:11.999601+0000","last_undegraded":"2024-09-11T00:15:11.999601+0000","last_fullsized":"2024-09-11T00:15:11.999601+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:36:09.339619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"38'3","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:11.997971+0000","last_change":"2024-09-11T00:15:10.985997+0000","last_active":"2024-09-11T00:15:11.997971+0000","last_peered":"2024-09-11T00:15:11.997971+0000","last_clean":"2024-09-11T00:15:11.997971+0000","last_became_active":"2024-09-11T00:15:10.985724+0000","last_became_peered":"2024-09-11T00:15:10.985724+0000","last_unstale":"2024-09-11T00:15:11.997971+0000","last_undegraded":"2024-09-11T00:15:11.997971+0000","last_fullsized":"2024-09-11T00:15:11.997971+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_clean_scrub_stamp":"2024-09-11T00:15:09.955417+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:16:46.436919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:12.002091+0000","last_change":"2024-09-11T00:15:11.997734+0000","last_active":"2024-09-11T00:15:12.002091+0000","last_peered":"2024-09-11T00:15:12.002091+0000","last_clean":"2024-09-11T00:15:12.002091+0000","last_became_active":"2024-09-11T00:15:11.997379+0000","last_became_peered":"2024-09-11T00:15:11.997379+0000","last_unstale":"2024-09-11T00:15:12.002091+0000","last_undegraded":"2024-09-11T00:15:12.002091+0000","last_fullsized":"2024-09-11T00:15:12.002091+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:20:52.661018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"38'6","reported_seq":19,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:12.011940+0000","last_change":"2024-09-11T00:15:10.985361+0000","last_active":"2024-09-11T00:15:12.011940+0000","last_peered":"2024-09-11T00:15:12.011940+0000","last_clean":"2024-09-11T00:15:12.011940+0000","last_became_active":"2024-09-11T00:15:10.985070+0000","last_became_peered":"2024-09-11T00:15:10.985070+0000","last_unstale":"2024-09-11T00:15:12.011940+0000","last_undegraded":"2024-09-11T00:15:12.011940+0000","last_fullsized":"2024-09-11T00:15:12.011940+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_clean_scrub_stamp":"2024-09-11T00:15:09.955417+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:36:08.333344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:11.999375+0000","last_change":"2024-09-11T00:15:11.996031+0000","last_active":"2024-09-11T00:15:11.999375+0000","last_peered":"2024-09-11T00:15:11.999375+0000","last_clean":"2024-09-11T00:15:11.999375+0000","last_became_active":"2024-09-11T00:15:11.995734+0000","last_became_peered":"2024-09-11T00:15:11.995734+0000","last_unstale":"2024-09-11T00:15:11.999375+0000","last_undegraded":"2024-09-11T00:15:11.999375+0000","last_fullsized":"2024-09-11T00:15:11.999375+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:27:00.007857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"38'2","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:11.998091+0000","last_change":"2024-09-11T00:15:10.982086+0000","last_active":"2024-09-11T00:15:11.998091+0000","last_peered":"2024-09-11T00:15:11.998091+0000","last_clean":"2024-09-11T00:15:11.998091+0000","last_became_active":"2024-09-11T00:15:10.981821+0000","last_became_peered":"2024-09-11T00:15:10.981821+0000","last_unstale":"2024-09-11T00:15:11.998091+0000","last_undegraded":"2024-09-11T00:15:11.998091+0000","last_fullsized":"2024-09-11T00:15:11.998091+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_clean_scrub_stamp":"2024-09-11T00:15:09.955417+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:29:03.806148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:11.993534+0000","last_change":"2024-09-11T00:15:11.985531+0000","last_active":"2024-09-11T00:15:11.993534+0000","last_peered":"2024-09-11T00:15:11.993534+0000","last_clean":"2024-09-11T00:15:11.993534+0000","last_became_active":"2024-09-11T00:15:11.985177+0000","last_became_peered":"2024-09-11T00:15:11.985177+0000","last_unstale":"2024-09-11T00:15:11.993534+0000","last_undegraded":"2024-09-11T00:15:11.993534+0000","last_fullsized":"2024-09-11T00:15:11.993534+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:56:07.914915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:11.975224+0000","last_change":"2024-09-11T00:15:10.986902+0000","last_active":"2024-09-11T00:15:11.975224+0000","last_peered":"2024-09-11T00:15:11.975224+0000","last_clean":"2024-09-11T00:15:11.975224+0000","last_became_active":"2024-09-11T00:15:10.986618+0000","last_became_peered":"2024-09-11T00:15:10.986618+0000","last_unstale":"2024-09-11T00:15:11.975224+0000","last_undegraded":"2024-09-11T00:15:11.975224+0000","last_fullsized":"2024-09-11T00:15:11.975224+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_clean_scrub_stamp":"2024-09-11T00:15:09.955417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:05:08.232715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:12.004072+0000","last_change":"2024-09-11T00:15:12.001039+0000","last_active":"2024-09-11T00:15:12.004072+0000","last_peered":"2024-09-11T00:15:12.004072+0000","last_clean":"2024-09-11T00:15:12.004072+0000","last_became_active":"2024-09-11T00:15:11.998778+0000","last_became_peered":"2024-09-11T00:15:11.998778+0000","last_unstale":"2024-09-11T00:15:12.004072+0000","last_undegraded":"2024-09-11T00:15:12.004072+0000","last_fullsized":"2024-09-11T00:15:12.004072+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:36:09.339619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T00:15:13.042149+0000","last_change":"2024-09-11T00:15:10.979918+0000","last_active":"2024-09-11T00:15:13.042149+0000","last_peered":"2024-09-11T00:15:13.042149+0000","last_clean":"2024-09-11T00:15:13.042149+0000","last_became_active":"2024-09-11T00:15:10.979650+0000","last_became_peered":"2024-09-11T00:15:10.979650+0000","last_unstale":"2024-09-11T00:15:13.042149+0000","last_undegraded":"2024-09-11T00:15:13.042149+0000","last_fullsized":"2024-09-11T00:15:13.042149+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_clean_scrub_stamp":"2024-09-11T00:15:09.955417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:53:00.260194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:11.995274+0000","last_change":"2024-09-11T00:15:11.987485+0000","last_active":"2024-09-11T00:15:11.995274+0000","last_peered":"2024-09-11T00:15:11.995274+0000","last_clean":"2024-09-11T00:15:11.995274+0000","last_became_active":"2024-09-11T00:15:11.987231+0000","last_became_peered":"2024-09-11T00:15:11.987231+0000","last_unstale":"2024-09-11T00:15:11.995274+0000","last_undegraded":"2024-09-11T00:15:11.995274+0000","last_fullsized":"2024-09-11T00:15:11.995274+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:41:28.124141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"38'8","reported_seq":21,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:12.005409+0000","last_change":"2024-09-11T00:15:10.988757+0000","last_active":"2024-09-11T00:15:12.005409+0000","last_peered":"2024-09-11T00:15:12.005409+0000","last_clean":"2024-09-11T00:15:12.005409+0000","last_became_active":"2024-09-11T00:15:10.988326+0000","last_became_peered":"2024-09-11T00:15:10.988326+0000","last_unstale":"2024-09-11T00:15:12.005409+0000","last_undegraded":"2024-09-11T00:15:12.005409+0000","last_fullsized":"2024-09-11T00:15:12.005409+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_clean_scrub_stamp":"2024-09-11T00:15:09.955417+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:05:08.232715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:11.995083+0000","last_change":"2024-09-11T00:15:11.986504+0000","last_active":"2024-09-11T00:15:11.995083+0000","last_peered":"2024-09-11T00:15:11.995083+0000","last_clean":"2024-09-11T00:15:11.995083+0000","last_became_active":"2024-09-11T00:15:11.986188+0000","last_became_peered":"2024-09-11T00:15:11.986188+0000","last_unstale":"2024-09-11T00:15:11.995083+0000","last_undegraded":"2024-09-11T00:15:11.995083+0000","last_fullsized":"2024-09-11T00:15:11.995083+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:58:17.603588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"38'1","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:11.995689+0000","last_change":"2024-09-11T00:15:10.989224+0000","last_active":"2024-09-11T00:15:11.995689+0000","last_peered":"2024-09-11T00:15:11.995689+0000","last_clean":"2024-09-11T00:15:11.995689+0000","last_became_active":"2024-09-11T00:15:10.988925+0000","last_became_peered":"2024-09-11T00:15:10.988925+0000","last_unstale":"2024-09-11T00:15:11.995689+0000","last_undegraded":"2024-09-11T00:15:11.995689+0000","last_fullsized":"2024-09-11T00:15:11.995689+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_clean_scrub_stamp":"2024-09-11T00:15:09.955417+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:48:52.690670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:11.995628+0000","last_change":"2024-09-11T00:15:11.982787+0000","last_active":"2024-09-11T00:15:11.995628+0000","last_peered":"2024-09-11T00:15:11.995628+0000","last_clean":"2024-09-11T00:15:11.995628+0000","last_became_active":"2024-09-11T00:15:11.982326+0000","last_became_peered":"2024-09-11T00:15:11.982326+0000","last_unstale":"2024-09-11T00:15:11.995628+0000","last_undegraded":"2024-09-11T00:15:11.995628+0000","last_fullsized":"2024-09-11T00:15:11.995628+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:56:07.914915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"38'2","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:12.002918+0000","last_change":"2024-09-11T00:15:10.981474+0000","last_active":"2024-09-11T00:15:12.002918+0000","last_peered":"2024-09-11T00:15:12.002918+0000","last_clean":"2024-09-11T00:15:12.002918+0000","last_became_active":"2024-09-11T00:15:10.981200+0000","last_became_peered":"2024-09-11T00:15:10.981200+0000","last_unstale":"2024-09-11T00:15:12.002918+0000","last_undegraded":"2024-09-11T00:15:12.002918+0000","last_fullsized":"2024-09-11T00:15:12.002918+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_clean_scrub_stamp":"2024-09-11T00:15:09.955417+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:33:53.976909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:12.002128+0000","last_change":"2024-09-11T00:15:11.998394+0000","last_active":"2024-09-11T00:15:12.002128+0000","last_peered":"2024-09-11T00:15:12.002128+0000","last_clean":"2024-09-11T00:15:12.002128+0000","last_became_active":"2024-09-11T00:15:11.998135+0000","last_became_peered":"2024-09-11T00:15:11.998135+0000","last_unstale":"2024-09-11T00:15:12.002128+0000","last_undegraded":"2024-09-11T00:15:12.002128+0000","last_fullsized":"2024-09-11T00:15:12.002128+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:18:10.378079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":10,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-11T00:15:10.991230+0000","last_change":"2024-09-11T00:15:10.987926+0000","last_active":"2024-09-11T00:15:10.991230+0000","last_peered":"2024-09-11T00:15:10.991230+0000","last_clean":"2024-09-11T00:15:10.991230+0000","last_became_active":"2024-09-11T00:15:10.987658+0000","last_became_peered":"2024-09-11T00:15:10.987658+0000","last_unstale":"2024-09-11T00:15:10.991230+0000","last_undegraded":"2024-09-11T00:15:10.991230+0000","last_fullsized":"2024-09-11T00:15:10.991230+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_clean_scrub_stamp":"2024-09-11T00:15:09.955417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:50:53.177894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-11T00:15:10.972453+0000","last_change":"2024-09-11T00:15:10.972453+0000","last_active":"2024-09-11T00:15:10.961693+0000","last_peered":"2024-09-11T00:15:10.961693+0000","last_clean":"2024-09-11T00:15:10.961693+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:15:10.972453+0000","last_undegraded":"2024-09-11T00:15:10.972453+0000","last_fullsized":"2024-09-11T00:15:10.972453+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:11.975134+0000","last_change":"2024-09-11T00:15:10.982457+0000","last_active":"2024-09-11T00:15:11.975134+0000","last_peered":"2024-09-11T00:15:11.975134+0000","last_clean":"2024-09-11T00:15:11.975134+0000","last_became_active":"2024-09-11T00:15:10.982196+0000","last_became_peered":"2024-09-11T00:15:10.982196+0000","last_unstale":"2024-09-11T00:15:11.975134+0000","last_undegraded":"2024-09-11T00:15:11.975134+0000","last_fullsized":"2024-09-11T00:15:11.975134+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_clean_scrub_stamp":"2024-09-11T00:15:09.955417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:53:21.168815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:12.005206+0000","last_change":"2024-09-11T00:15:11.998392+0000","last_active":"2024-09-11T00:15:12.005206+0000","last_peered":"2024-09-11T00:15:12.005206+0000","last_clean":"2024-09-11T00:15:12.005206+0000","last_became_active":"2024-09-11T00:15:11.998147+0000","last_became_peered":"2024-09-11T00:15:11.998147+0000","last_unstale":"2024-09-11T00:15:12.005206+0000","last_undegraded":"2024-09-11T00:15:12.005206+0000","last_fullsized":"2024-09-11T00:15:12.005206+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:28:04.414078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":10,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-11T00:15:10.985035+0000","last_change":"2024-09-11T00:15:10.982090+0000","last_active":"2024-09-11T00:15:10.985035+0000","last_peered":"2024-09-11T00:15:10.985035+0000","last_clean":"2024-09-11T00:15:10.985035+0000","last_became_active":"2024-09-11T00:15:10.980995+0000","last_became_peered":"2024-09-11T00:15:10.980995+0000","last_unstale":"2024-09-11T00:15:10.985035+0000","last_undegraded":"2024-09-11T00:15:10.985035+0000","last_fullsized":"2024-09-11T00:15:10.985035+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_clean_scrub_stamp":"2024-09-11T00:15:09.955417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:54:46.111637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:12.006040+0000","last_change":"2024-09-11T00:15:12.004792+0000","last_active":"2024-09-11T00:15:12.006040+0000","last_peered":"2024-09-11T00:15:12.006040+0000","last_clean":"2024-09-11T00:15:12.006040+0000","last_became_active":"2024-09-11T00:15:12.004535+0000","last_became_peered":"2024-09-11T00:15:12.004535+0000","last_unstale":"2024-09-11T00:15:12.006040+0000","last_undegraded":"2024-09-11T00:15:12.006040+0000","last_fullsized":"2024-09-11T00:15:12.006040+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:43:33.394237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":10,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-11T00:15:10.985090+0000","last_change":"2024-09-11T00:15:10.982293+0000","last_active":"2024-09-11T00:15:10.985090+0000","last_peered":"2024-09-11T00:15:10.985090+0000","last_clean":"2024-09-11T00:15:10.985090+0000","last_became_active":"2024-09-11T00:15:10.981953+0000","last_became_peered":"2024-09-11T00:15:10.981953+0000","last_unstale":"2024-09-11T00:15:10.985090+0000","last_undegraded":"2024-09-11T00:15:10.985090+0000","last_fullsized":"2024-09-11T00:15:10.985090+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_clean_scrub_stamp":"2024-09-11T00:15:09.955417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:00:19.178831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:11.995204+0000","last_change":"2024-09-11T00:15:11.979526+0000","last_active":"2024-09-11T00:15:11.995204+0000","last_peered":"2024-09-11T00:15:11.995204+0000","last_clean":"2024-09-11T00:15:11.995204+0000","last_became_active":"2024-09-11T00:15:11.979276+0000","last_became_peered":"2024-09-11T00:15:11.979276+0000","last_unstale":"2024-09-11T00:15:11.995204+0000","last_undegraded":"2024-09-11T00:15:11.995204+0000","last_fullsized":"2024-09-11T00:15:11.995204+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:43:33.394237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:11.997752+0000","last_change":"2024-09-11T00:15:10.983758+0000","last_active":"2024-09-11T00:15:11.997752+0000","last_peered":"2024-09-11T00:15:11.997752+0000","last_clean":"2024-09-11T00:15:11.997752+0000","last_became_active":"2024-09-11T00:15:10.983483+0000","last_became_peered":"2024-09-11T00:15:10.983483+0000","last_unstale":"2024-09-11T00:15:11.997752+0000","last_undegraded":"2024-09-11T00:15:11.997752+0000","last_fullsized":"2024-09-11T00:15:11.997752+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_clean_scrub_stamp":"2024-09-11T00:15:09.955417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:58:30.377476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:12.008217+0000","last_change":"2024-09-11T00:15:12.002877+0000","last_active":"2024-09-11T00:15:12.008217+0000","last_peered":"2024-09-11T00:15:12.008217+0000","last_clean":"2024-09-11T00:15:12.008217+0000","last_became_active":"2024-09-11T00:15:12.002631+0000","last_became_peered":"2024-09-11T00:15:12.002631+0000","last_unstale":"2024-09-11T00:15:12.008217+0000","last_undegraded":"2024-09-11T00:15:12.008217+0000","last_fullsized":"2024-09-11T00:15:12.008217+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:54:49.591743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":10,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-11T00:15:10.984320+0000","last_change":"2024-09-11T00:15:10.981282+0000","last_active":"2024-09-11T00:15:10.984320+0000","last_peered":"2024-09-11T00:15:10.984320+0000","last_clean":"2024-09-11T00:15:10.984320+0000","last_became_active":"2024-09-11T00:15:10.981000+0000","last_became_peered":"2024-09-11T00:15:10.981000+0000","last_unstale":"2024-09-11T00:15:10.984320+0000","last_undegraded":"2024-09-11T00:15:10.984320+0000","last_fullsized":"2024-09-11T00:15:10.984320+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_clean_scrub_stamp":"2024-09-11T00:15:09.955417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:43:23.737238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:11.998112+0000","last_change":"2024-09-11T00:15:11.991223+0000","last_active":"2024-09-11T00:15:11.998112+0000","last_peered":"2024-09-11T00:15:11.998112+0000","last_clean":"2024-09-11T00:15:11.998112+0000","last_became_active":"2024-09-11T00:15:11.990994+0000","last_became_peered":"2024-09-11T00:15:11.990994+0000","last_unstale":"2024-09-11T00:15:11.998112+0000","last_undegraded":"2024-09-11T00:15:11.998112+0000","last_fullsized":"2024-09-11T00:15:11.998112+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:48:53.696945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"38'2","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:11.995540+0000","last_change":"2024-09-11T00:15:10.984511+0000","last_active":"2024-09-11T00:15:11.995540+0000","last_peered":"2024-09-11T00:15:11.995540+0000","last_clean":"2024-09-11T00:15:11.995540+0000","last_became_active":"2024-09-11T00:15:10.984234+0000","last_became_peered":"2024-09-11T00:15:10.984234+0000","last_unstale":"2024-09-11T00:15:11.995540+0000","last_undegraded":"2024-09-11T00:15:11.995540+0000","last_fullsized":"2024-09-11T00:15:11.995540+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_clean_scrub_stamp":"2024-09-11T00:15:09.955417+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:36:08.333344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:12.003942+0000","last_change":"2024-09-11T00:15:12.001691+0000","last_active":"2024-09-11T00:15:12.003942+0000","last_peered":"2024-09-11T00:15:12.003942+0000","last_clean":"2024-09-11T00:15:12.003942+0000","last_became_active":"2024-09-11T00:15:12.001180+0000","last_became_peered":"2024-09-11T00:15:12.001180+0000","last_unstale":"2024-09-11T00:15:12.003942+0000","last_undegraded":"2024-09-11T00:15:12.003942+0000","last_fullsized":"2024-09-11T00:15:12.003942+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:16:47.443195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":10,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-11T00:15:10.983339+0000","last_change":"2024-09-11T00:15:10.980366+0000","last_active":"2024-09-11T00:15:10.983339+0000","last_peered":"2024-09-11T00:15:10.983339+0000","last_clean":"2024-09-11T00:15:10.983339+0000","last_became_active":"2024-09-11T00:15:10.980077+0000","last_became_peered":"2024-09-11T00:15:10.980077+0000","last_unstale":"2024-09-11T00:15:10.983339+0000","last_undegraded":"2024-09-11T00:15:10.983339+0000","last_fullsized":"2024-09-11T00:15:10.983339+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_clean_scrub_stamp":"2024-09-11T00:15:09.955417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:15:22.628414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:11.997180+0000","last_change":"2024-09-11T00:15:11.994143+0000","last_active":"2024-09-11T00:15:11.997180+0000","last_peered":"2024-09-11T00:15:11.997180+0000","last_clean":"2024-09-11T00:15:11.997180+0000","last_became_active":"2024-09-11T00:15:11.993393+0000","last_became_peered":"2024-09-11T00:15:11.993393+0000","last_unstale":"2024-09-11T00:15:11.997180+0000","last_undegraded":"2024-09-11T00:15:11.997180+0000","last_fullsized":"2024-09-11T00:15:11.997180+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:49:11.620971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:11.977996+0000","last_change":"2024-09-11T00:15:10.984774+0000","last_active":"2024-09-11T00:15:11.977996+0000","last_peered":"2024-09-11T00:15:11.977996+0000","last_clean":"2024-09-11T00:15:11.977996+0000","last_became_active":"2024-09-11T00:15:10.983875+0000","last_became_peered":"2024-09-11T00:15:10.983875+0000","last_unstale":"2024-09-11T00:15:11.977996+0000","last_undegraded":"2024-09-11T00:15:11.977996+0000","last_fullsized":"2024-09-11T00:15:11.977996+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_clean_scrub_stamp":"2024-09-11T00:15:09.955417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:05:08.232715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:11.993302+0000","last_change":"2024-09-11T00:15:11.988649+0000","last_active":"2024-09-11T00:15:11.993302+0000","last_peered":"2024-09-11T00:15:11.993302+0000","last_clean":"2024-09-11T00:15:11.993302+0000","last_became_active":"2024-09-11T00:15:11.988254+0000","last_became_peered":"2024-09-11T00:15:11.988254+0000","last_unstale":"2024-09-11T00:15:11.993302+0000","last_undegraded":"2024-09-11T00:15:11.993302+0000","last_fullsized":"2024-09-11T00:15:11.993302+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:58:31.383752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:11.979262+0000","last_change":"2024-09-11T00:15:10.984350+0000","last_active":"2024-09-11T00:15:11.979262+0000","last_peered":"2024-09-11T00:15:11.979262+0000","last_clean":"2024-09-11T00:15:11.979262+0000","last_became_active":"2024-09-11T00:15:10.984092+0000","last_became_peered":"2024-09-11T00:15:10.984092+0000","last_unstale":"2024-09-11T00:15:11.979262+0000","last_undegraded":"2024-09-11T00:15:11.979262+0000","last_fullsized":"2024-09-11T00:15:11.979262+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_clean_scrub_stamp":"2024-09-11T00:15:09.955417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:41:46.193502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:11.987168+0000","last_change":"2024-09-11T00:15:11.981492+0000","last_active":"2024-09-11T00:15:11.987168+0000","last_peered":"2024-09-11T00:15:11.987168+0000","last_clean":"2024-09-11T00:15:11.987168+0000","last_became_active":"2024-09-11T00:15:11.981199+0000","last_became_peered":"2024-09-11T00:15:11.981199+0000","last_unstale":"2024-09-11T00:15:11.987168+0000","last_undegraded":"2024-09-11T00:15:11.987168+0000","last_fullsized":"2024-09-11T00:15:11.987168+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:58:31.383752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T00:15:13.042211+0000","last_change":"2024-09-11T00:15:10.993082+0000","last_active":"2024-09-11T00:15:13.042211+0000","last_peered":"2024-09-11T00:15:13.042211+0000","last_clean":"2024-09-11T00:15:13.042211+0000","last_became_active":"2024-09-11T00:15:10.992868+0000","last_became_peered":"2024-09-11T00:15:10.992868+0000","last_unstale":"2024-09-11T00:15:13.042211+0000","last_undegraded":"2024-09-11T00:15:13.042211+0000","last_fullsized":"2024-09-11T00:15:13.042211+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_clean_scrub_stamp":"2024-09-11T00:15:09.955417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:09:11.520405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:12.002886+0000","last_change":"2024-09-11T00:15:11.999345+0000","last_active":"2024-09-11T00:15:12.002886+0000","last_peered":"2024-09-11T00:15:12.002886+0000","last_clean":"2024-09-11T00:15:12.002886+0000","last_became_active":"2024-09-11T00:15:11.999031+0000","last_became_peered":"2024-09-11T00:15:11.999031+0000","last_unstale":"2024-09-11T00:15:12.002886+0000","last_undegraded":"2024-09-11T00:15:12.002886+0000","last_fullsized":"2024-09-11T00:15:12.002886+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:28:22.582823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:11.984760+0000","last_change":"2024-09-11T00:15:10.983535+0000","last_active":"2024-09-11T00:15:11.984760+0000","last_peered":"2024-09-11T00:15:11.984760+0000","last_clean":"2024-09-11T00:15:11.984760+0000","last_became_active":"2024-09-11T00:15:10.983265+0000","last_became_peered":"2024-09-11T00:15:10.983265+0000","last_unstale":"2024-09-11T00:15:11.984760+0000","last_undegraded":"2024-09-11T00:15:11.984760+0000","last_fullsized":"2024-09-11T00:15:11.984760+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_clean_scrub_stamp":"2024-09-11T00:15:09.955417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:46:54.895627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:12.004119+0000","last_change":"2024-09-11T00:15:12.001186+0000","last_active":"2024-09-11T00:15:12.004119+0000","last_peered":"2024-09-11T00:15:12.004119+0000","last_clean":"2024-09-11T00:15:12.004119+0000","last_became_active":"2024-09-11T00:15:11.998947+0000","last_became_peered":"2024-09-11T00:15:11.998947+0000","last_unstale":"2024-09-11T00:15:12.004119+0000","last_undegraded":"2024-09-11T00:15:12.004119+0000","last_fullsized":"2024-09-11T00:15:12.004119+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:48:53.696945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:11.976607+0000","last_change":"2024-09-11T00:15:10.980323+0000","last_active":"2024-09-11T00:15:11.976607+0000","last_peered":"2024-09-11T00:15:11.976607+0000","last_clean":"2024-09-11T00:15:11.976607+0000","last_became_active":"2024-09-11T00:15:10.980050+0000","last_became_peered":"2024-09-11T00:15:10.980050+0000","last_unstale":"2024-09-11T00:15:11.976607+0000","last_undegraded":"2024-09-11T00:15:11.976607+0000","last_fullsized":"2024-09-11T00:15:11.976607+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_clean_scrub_stamp":"2024-09-11T00:15:09.955417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:43:32.387961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:11.998138+0000","last_change":"2024-09-11T00:15:11.989310+0000","last_active":"2024-09-11T00:15:11.998138+0000","last_peered":"2024-09-11T00:15:11.998138+0000","last_clean":"2024-09-11T00:15:11.998138+0000","last_became_active":"2024-09-11T00:15:11.989042+0000","last_became_peered":"2024-09-11T00:15:11.989042+0000","last_unstale":"2024-09-11T00:15:11.998138+0000","last_undegraded":"2024-09-11T00:15:11.998138+0000","last_fullsized":"2024-09-11T00:15:11.998138+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:19:07.626300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:11.988408+0000","last_change":"2024-09-11T00:15:10.984732+0000","last_active":"2024-09-11T00:15:11.988408+0000","last_peered":"2024-09-11T00:15:11.988408+0000","last_clean":"2024-09-11T00:15:11.988408+0000","last_became_active":"2024-09-11T00:15:10.984375+0000","last_became_peered":"2024-09-11T00:15:10.984375+0000","last_unstale":"2024-09-11T00:15:11.988408+0000","last_undegraded":"2024-09-11T00:15:11.988408+0000","last_fullsized":"2024-09-11T00:15:11.988408+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_clean_scrub_stamp":"2024-09-11T00:15:09.955417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:34:50.761829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":143,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:15:11.985741+0000","last_change":"2024-09-11T00:14:08.221813+0000","last_active":"2024-09-11T00:15:11.985741+0000","last_peered":"2024-09-11T00:15:11.985741+0000","last_clean":"2024-09-11T00:15:11.985741+0000","last_became_active":"2024-09-11T00:14:08.220663+0000","last_became_peered":"2024-09-11T00:14:08.220663+0000","last_unstale":"2024-09-11T00:15:11.985741+0000","last_undegraded":"2024-09-11T00:15:11.985741+0000","last_fullsized":"2024-09-11T00:15:11.985741+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:06.563107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:06.563107+0000","last_clean_scrub_stamp":"2024-09-11T00:14:06.563107+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:44:49.322583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2340,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":4750,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":35,"ondisk_log_size":35,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509457,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28020,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343820,"statfs":{"total":96636764160,"available":96608071680,"internally_reserved":0,"allocated":1011712,"data_stored":768982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509457,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27460,"kb_used_data":428,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344380,"statfs":{"total":96636764160,"available":96608645120,"internally_reserved":0,"allocated":438272,"data_stored":185893,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509456,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27464,"kb_used_data":428,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344376,"statfs":{"total":96636764160,"available":96608641024,"internally_reserved":0,"allocated":438272,"data_stored":186385,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509456,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27436,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344404,"statfs":{"total":96636764160,"available":96608669696,"internally_reserved":0,"allocated":417792,"data_stored":178614,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509458,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27452,"kb_used_data":424,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344388,"statfs":{"total":96636764160,"available":96608653312,"internally_reserved":0,"allocated":434176,"data_stored":185871,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509457,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28040,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343800,"statfs":{"total":96636764160,"available":96608051200,"internally_reserved":0,"allocated":1028096,"data_stored":776183,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542161,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27424,"kb_used_data":396,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344416,"statfs":{"total":96636764160,"available":96608681984,"internally_reserved":0,"allocated":405504,"data_stored":171947,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574866,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27472,"kb_used_data":436,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344368,"statfs":{"total":96636764160,"available":96608632832,"internally_reserved":0,"allocated":446464,"data_stored":193055,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T00:15:19.349 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T00:15:19.460 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:19.458+0000 7feb5ab5d640 1 -- 172.21.15.92:0/4225803204 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7feb44003a30 msgr2=0x7feb44003e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:19.460 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:19.458+0000 7feb5ab5d640 1 --2- 172.21.15.92:0/4225803204 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7feb44003a30 0x7feb44003e50 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7feb48009b50 tx=0x7feb44005830 comp rx=0 tx=0).stop 2024-09-11T00:15:19.460 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:19.458+0000 7feb590fa640 1 -- 172.21.15.92:0/4225803204 reap_dead start 2024-09-11T00:15:19.460 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:19.458+0000 7feb5ab5d640 1 -- 172.21.15.92:0/4225803204 shutdown_connections 2024-09-11T00:15:19.461 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:19.458+0000 7feb5ab5d640 1 -- 172.21.15.92:0/4225803204 >> 172.21.15.92:0/4225803204 conn(0x7feb540d3f70 msgr2=0x7feb540d4350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:15:19.461 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:19.458+0000 7feb5ab5d640 1 -- 172.21.15.92:0/4225803204 shutdown_connections 2024-09-11T00:15:19.461 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:19.458+0000 7feb5ab5d640 1 -- 172.21.15.92:0/4225803204 wait complete. 2024-09-11T00:15:19.463 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:19.459+0000 7feb5ab5d640 1 Processor -- start 2024-09-11T00:15:19.463 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:19.459+0000 7feb5ab5d640 1 -- start start 2024-09-11T00:15:19.464 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:19.460+0000 7feb5ab5d640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7feb44003a30 0x7feb541f2040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:19.464 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:19.460+0000 7feb5ab5d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7feb540cd260 0x7feb540cd6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:19.464 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:19.460+0000 7feb5ab5d640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7feb540cb210 0x7feb540cb6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:19.464 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:19.460+0000 7feb5ab5d640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7feb540b6dc0 con 0x7feb540cd260 2024-09-11T00:15:19.464 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:19.460+0000 7feb5ab5d640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7feb540d2f70 con 0x7feb540cb210 2024-09-11T00:15:19.464 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:19.460+0000 7feb5ab5d640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7feb540b6f40 con 0x7feb44003a30 2024-09-11T00:15:19.464 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:19.460+0000 7feb53fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7feb540cd260 0x7feb540cd6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:19.464 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:19.460+0000 7feb53fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7feb540cd260 0x7feb540cd6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:54736/0 (socket says 172.21.15.92:54736) 2024-09-11T00:15:19.464 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:19.460+0000 7feb53fff640 1 -- 172.21.15.92:0/862297526 learned_addr learned my addr 172.21.15.92:0/862297526 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-11T00:15:19.464 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:19.460+0000 7feb590fa640 1 --2- 172.21.15.92:0/862297526 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7feb540cb210 0x7feb540cb6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:19.464 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:19.460+0000 7feb588f9640 1 --2- 172.21.15.92:0/862297526 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7feb44003a30 0x7feb541f2040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:19.464 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:19.461+0000 7feb53fff640 1 -- 172.21.15.92:0/862297526 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7feb44003a30 msgr2=0x7feb541f2040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:19.465 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:19.461+0000 7feb53fff640 1 --2- 172.21.15.92:0/862297526 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7feb44003a30 0x7feb541f2040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:19.465 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:19.461+0000 7feb53fff640 1 -- 172.21.15.92:0/862297526 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7feb540cb210 msgr2=0x7feb540cb6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:19.465 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:19.461+0000 7feb53fff640 1 --2- 172.21.15.92:0/862297526 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7feb540cb210 0x7feb540cb6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:19.465 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:19.461+0000 7feb53fff640 1 -- 172.21.15.92:0/862297526 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb540cdd40 con 0x7feb540cd260 2024-09-11T00:15:19.465 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:19.461+0000 7feb588f9640 1 --2- 172.21.15.92:0/862297526 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7feb44003a30 0x7feb541f2040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:15:19.465 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:19.461+0000 7feb53fff640 1 --2- 172.21.15.92:0/862297526 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7feb540cd260 0x7feb540cd6e0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7feb40004df0 tx=0x7feb40001630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:15:19.465 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:19.461+0000 7feb517fa640 1 -- 172.21.15.92:0/862297526 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb40015020 con 0x7feb540cd260 2024-09-11T00:15:19.465 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:19.461+0000 7feb517fa640 1 -- 172.21.15.92:0/862297526 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7feb40011960 con 0x7feb540cd260 2024-09-11T00:15:19.465 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:19.461+0000 7feb517fa640 1 -- 172.21.15.92:0/862297526 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb40001d40 con 0x7feb540cd260 2024-09-11T00:15:19.465 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:19.461+0000 7feb5ab5d640 1 -- 172.21.15.92:0/862297526 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb540ce020 con 0x7feb540cd260 2024-09-11T00:15:19.465 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:19.461+0000 7feb5ab5d640 1 -- 172.21.15.92:0/862297526 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb5415f530 con 0x7feb540cd260 2024-09-11T00:15:19.465 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:19.462+0000 7feb5ab5d640 1 -- 172.21.15.92:0/862297526 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feb540d24e0 con 0x7feb540cd260 2024-09-11T00:15:19.466 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:19.462+0000 7feb517fa640 1 -- 172.21.15.92:0/862297526 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7feb4001a400 con 0x7feb540cd260 2024-09-11T00:15:19.466 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:19.463+0000 7feb517fa640 1 --2- 172.21.15.92:0/862297526 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7feb38077f70 0x7feb3807a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:19.466 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:19.463+0000 7feb517fa640 1 -- 172.21.15.92:0/862297526 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7feb4009abc0 con 0x7feb540cd260 2024-09-11T00:15:19.467 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:19.463+0000 7feb588f9640 1 --2- 172.21.15.92:0/862297526 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7feb38077f70 0x7feb3807a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:19.467 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:19.464+0000 7feb588f9640 1 --2- 172.21.15.92:0/862297526 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7feb38077f70 0x7feb3807a430 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7feb48035000 tx=0x7feb4802d040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:15:19.468 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:19.467+0000 7feb517fa640 1 -- 172.21.15.92:0/862297526 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7feb4001f020 con 0x7feb540cd260 2024-09-11T00:15:19.638 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:19.637+0000 7feb5ab5d640 1 -- 172.21.15.92:0/862297526 --> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7feb540cbbe0 con 0x7feb38077f70 2024-09-11T00:15:19.642 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:19.641+0000 7feb517fa640 1 -- 172.21.15.92:0/862297526 <== mgr.4100 v2:172.21.15.145:6800/325490785 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251896 (secure 0 0 0) 0x7feb4802b7e0 con 0x7feb38077f70 2024-09-11T00:15:19.646 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:15:19.647 INFO:teuthology.orchestra.run.smithi092.stderr:dumped all 2024-09-11T00:15:19.648 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:19.644+0000 7feb5ab5d640 1 -- 172.21.15.92:0/862297526 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7feb38077f70 msgr2=0x7feb3807a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:19.649 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:19.644+0000 7feb5ab5d640 1 --2- 172.21.15.92:0/862297526 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7feb38077f70 0x7feb3807a430 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7feb48035000 tx=0x7feb4802d040 comp rx=0 tx=0).stop 2024-09-11T00:15:19.649 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:19.644+0000 7feb5ab5d640 1 -- 172.21.15.92:0/862297526 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7feb540cd260 msgr2=0x7feb540cd6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:19.649 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:19.644+0000 7feb5ab5d640 1 --2- 172.21.15.92:0/862297526 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7feb540cd260 0x7feb540cd6e0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7feb40004df0 tx=0x7feb40001630 comp rx=0 tx=0).stop 2024-09-11T00:15:19.649 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:19.644+0000 7feb5ab5d640 1 -- 172.21.15.92:0/862297526 shutdown_connections 2024-09-11T00:15:19.649 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:19.644+0000 7feb5ab5d640 1 --2- 172.21.15.92:0/862297526 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7feb38077f70 0x7feb3807a430 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:19.649 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:19.644+0000 7feb5ab5d640 1 --2- 172.21.15.92:0/862297526 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7feb540cb210 0x7feb540cb6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:19.649 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:19.644+0000 7feb5ab5d640 1 --2- 172.21.15.92:0/862297526 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7feb540cd260 0x7feb540cd6e0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:19.649 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:19.644+0000 7feb5ab5d640 1 --2- 172.21.15.92:0/862297526 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7feb44003a30 0x7feb541f2040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:19.649 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:19.644+0000 7feb5ab5d640 1 -- 172.21.15.92:0/862297526 >> 172.21.15.92:0/862297526 conn(0x7feb540d3f70 msgr2=0x7feb540688e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:15:19.649 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:19.644+0000 7feb5ab5d640 1 -- 172.21.15.92:0/862297526 shutdown_connections 2024-09-11T00:15:19.649 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:19.644+0000 7feb5ab5d640 1 -- 172.21.15.92:0/862297526 wait complete. 2024-09-11T00:15:19.657 INFO:teuthology.orchestra.run.smithi092.stdout:{"pg_ready":true,"pg_map":{"version":69,"stamp":"2024-09-11T00:15:18.287441+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220932,"kb_used_data":4680,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753788,"statfs":{"total":773094113280,"available":772867878912,"internally_reserved":0,"allocated":4792320,"data_stored":2725340,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.318817"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T00:15:12.989005+0000","last_change":"2024-09-11T00:15:11.990745+0000","last_active":"2024-09-11T00:15:12.989005+0000","last_peered":"2024-09-11T00:15:12.989005+0000","last_clean":"2024-09-11T00:15:12.989005+0000","last_became_active":"2024-09-11T00:15:11.990485+0000","last_became_peered":"2024-09-11T00:15:11.990485+0000","last_unstale":"2024-09-11T00:15:12.989005+0000","last_undegraded":"2024-09-11T00:15:12.989005+0000","last_fullsized":"2024-09-11T00:15:12.989005+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:25:24.460208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T00:15:12.988777+0000","last_change":"2024-09-11T00:15:11.989933+0000","last_active":"2024-09-11T00:15:12.988777+0000","last_peered":"2024-09-11T00:15:12.988777+0000","last_clean":"2024-09-11T00:15:12.988777+0000","last_became_active":"2024-09-11T00:15:11.989547+0000","last_became_peered":"2024-09-11T00:15:11.989547+0000","last_unstale":"2024-09-11T00:15:12.988777+0000","last_undegraded":"2024-09-11T00:15:12.988777+0000","last_fullsized":"2024-09-11T00:15:12.988777+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:18:21.580588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T00:15:13.802516+0000","last_change":"2024-09-11T00:15:11.996802+0000","last_active":"2024-09-11T00:15:13.802516+0000","last_peered":"2024-09-11T00:15:13.802516+0000","last_clean":"2024-09-11T00:15:13.802516+0000","last_became_active":"2024-09-11T00:15:11.996464+0000","last_became_peered":"2024-09-11T00:15:11.996464+0000","last_unstale":"2024-09-11T00:15:13.802516+0000","last_undegraded":"2024-09-11T00:15:13.802516+0000","last_fullsized":"2024-09-11T00:15:13.802516+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:56:07.914915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T00:15:13.803120+0000","last_change":"2024-09-11T00:15:11.993763+0000","last_active":"2024-09-11T00:15:13.803120+0000","last_peered":"2024-09-11T00:15:13.803120+0000","last_clean":"2024-09-11T00:15:13.803120+0000","last_became_active":"2024-09-11T00:15:11.993508+0000","last_became_peered":"2024-09-11T00:15:11.993508+0000","last_unstale":"2024-09-11T00:15:13.803120+0000","last_undegraded":"2024-09-11T00:15:13.803120+0000","last_fullsized":"2024-09-11T00:15:13.803120+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:57:03.389718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T00:15:13.802670+0000","last_change":"2024-09-11T00:15:11.993059+0000","last_active":"2024-09-11T00:15:13.802670+0000","last_peered":"2024-09-11T00:15:13.802670+0000","last_clean":"2024-09-11T00:15:13.802670+0000","last_became_active":"2024-09-11T00:15:11.992789+0000","last_became_peered":"2024-09-11T00:15:11.992789+0000","last_unstale":"2024-09-11T00:15:13.802670+0000","last_undegraded":"2024-09-11T00:15:13.802670+0000","last_fullsized":"2024-09-11T00:15:13.802670+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:53:01.266470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T00:15:13.029824+0000","last_change":"2024-09-11T00:15:11.981800+0000","last_active":"2024-09-11T00:15:13.029824+0000","last_peered":"2024-09-11T00:15:13.029824+0000","last_clean":"2024-09-11T00:15:13.029824+0000","last_became_active":"2024-09-11T00:15:11.981553+0000","last_became_peered":"2024-09-11T00:15:11.981553+0000","last_unstale":"2024-09-11T00:15:13.029824+0000","last_undegraded":"2024-09-11T00:15:13.029824+0000","last_fullsized":"2024-09-11T00:15:13.029824+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:56:00.596087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T00:15:12.991471+0000","last_change":"2024-09-11T00:15:11.985908+0000","last_active":"2024-09-11T00:15:12.991471+0000","last_peered":"2024-09-11T00:15:12.991471+0000","last_clean":"2024-09-11T00:15:12.991471+0000","last_became_active":"2024-09-11T00:15:11.983107+0000","last_became_peered":"2024-09-11T00:15:11.983107+0000","last_unstale":"2024-09-11T00:15:12.991471+0000","last_undegraded":"2024-09-11T00:15:12.991471+0000","last_fullsized":"2024-09-11T00:15:12.991471+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:10:10.614680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T00:15:12.988367+0000","last_change":"2024-09-11T00:15:11.991693+0000","last_active":"2024-09-11T00:15:12.988367+0000","last_peered":"2024-09-11T00:15:12.988367+0000","last_clean":"2024-09-11T00:15:12.988367+0000","last_became_active":"2024-09-11T00:15:11.991452+0000","last_became_peered":"2024-09-11T00:15:11.991452+0000","last_unstale":"2024-09-11T00:15:12.988367+0000","last_undegraded":"2024-09-11T00:15:12.988367+0000","last_fullsized":"2024-09-11T00:15:12.988367+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:13:00.658039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T00:15:13.802875+0000","last_change":"2024-09-11T00:15:11.996272+0000","last_active":"2024-09-11T00:15:13.802875+0000","last_peered":"2024-09-11T00:15:13.802875+0000","last_clean":"2024-09-11T00:15:13.802875+0000","last_became_active":"2024-09-11T00:15:11.996016+0000","last_became_peered":"2024-09-11T00:15:11.996016+0000","last_unstale":"2024-09-11T00:15:13.802875+0000","last_undegraded":"2024-09-11T00:15:13.802875+0000","last_fullsized":"2024-09-11T00:15:13.802875+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:59:36.084840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T00:15:12.991786+0000","last_change":"2024-09-11T00:15:12.000547+0000","last_active":"2024-09-11T00:15:12.991786+0000","last_peered":"2024-09-11T00:15:12.991786+0000","last_clean":"2024-09-11T00:15:12.991786+0000","last_became_active":"2024-09-11T00:15:12.000275+0000","last_became_peered":"2024-09-11T00:15:12.000275+0000","last_unstale":"2024-09-11T00:15:12.991786+0000","last_undegraded":"2024-09-11T00:15:12.991786+0000","last_fullsized":"2024-09-11T00:15:12.991786+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:07:50.305377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T00:15:12.991523+0000","last_change":"2024-09-11T00:15:11.991652+0000","last_active":"2024-09-11T00:15:12.991523+0000","last_peered":"2024-09-11T00:15:12.991523+0000","last_clean":"2024-09-11T00:15:12.991523+0000","last_became_active":"2024-09-11T00:15:11.990905+0000","last_became_peered":"2024-09-11T00:15:11.990905+0000","last_unstale":"2024-09-11T00:15:12.991523+0000","last_undegraded":"2024-09-11T00:15:12.991523+0000","last_fullsized":"2024-09-11T00:15:12.991523+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:13:00.658039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T00:15:13.802491+0000","last_change":"2024-09-11T00:15:11.984051+0000","last_active":"2024-09-11T00:15:13.802491+0000","last_peered":"2024-09-11T00:15:13.802491+0000","last_clean":"2024-09-11T00:15:13.802491+0000","last_became_active":"2024-09-11T00:15:11.983773+0000","last_became_peered":"2024-09-11T00:15:11.983773+0000","last_unstale":"2024-09-11T00:15:13.802491+0000","last_undegraded":"2024-09-11T00:15:13.802491+0000","last_fullsized":"2024-09-11T00:15:13.802491+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:29:04.812424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T00:15:12.991441+0000","last_change":"2024-09-11T00:15:12.000158+0000","last_active":"2024-09-11T00:15:12.991441+0000","last_peered":"2024-09-11T00:15:12.991441+0000","last_clean":"2024-09-11T00:15:12.991441+0000","last_became_active":"2024-09-11T00:15:11.999876+0000","last_became_peered":"2024-09-11T00:15:11.999876+0000","last_unstale":"2024-09-11T00:15:12.991441+0000","last_undegraded":"2024-09-11T00:15:12.991441+0000","last_fullsized":"2024-09-11T00:15:12.991441+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:54:49.591743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T00:15:12.991238+0000","last_change":"2024-09-11T00:15:11.990614+0000","last_active":"2024-09-11T00:15:12.991238+0000","last_peered":"2024-09-11T00:15:12.991238+0000","last_clean":"2024-09-11T00:15:12.991238+0000","last_became_active":"2024-09-11T00:15:11.990346+0000","last_became_peered":"2024-09-11T00:15:11.990346+0000","last_unstale":"2024-09-11T00:15:12.991238+0000","last_undegraded":"2024-09-11T00:15:12.991238+0000","last_fullsized":"2024-09-11T00:15:12.991238+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:45:58.124525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T00:15:12.991719+0000","last_change":"2024-09-11T00:15:11.986763+0000","last_active":"2024-09-11T00:15:12.991719+0000","last_peered":"2024-09-11T00:15:12.991719+0000","last_clean":"2024-09-11T00:15:12.991719+0000","last_became_active":"2024-09-11T00:15:11.986468+0000","last_became_peered":"2024-09-11T00:15:11.986468+0000","last_unstale":"2024-09-11T00:15:12.991719+0000","last_undegraded":"2024-09-11T00:15:12.991719+0000","last_fullsized":"2024-09-11T00:15:12.991719+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:42:09.028068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T00:15:13.802049+0000","last_change":"2024-09-11T00:15:12.005753+0000","last_active":"2024-09-11T00:15:13.802049+0000","last_peered":"2024-09-11T00:15:13.802049+0000","last_clean":"2024-09-11T00:15:13.802049+0000","last_became_active":"2024-09-11T00:15:12.005460+0000","last_became_peered":"2024-09-11T00:15:12.005460+0000","last_unstale":"2024-09-11T00:15:13.802049+0000","last_undegraded":"2024-09-11T00:15:13.802049+0000","last_fullsized":"2024-09-11T00:15:13.802049+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:41:28.124141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T00:15:13.802679+0000","last_change":"2024-09-11T00:15:12.005879+0000","last_active":"2024-09-11T00:15:13.802679+0000","last_peered":"2024-09-11T00:15:13.802679+0000","last_clean":"2024-09-11T00:15:13.802679+0000","last_became_active":"2024-09-11T00:15:12.005591+0000","last_became_peered":"2024-09-11T00:15:12.005591+0000","last_unstale":"2024-09-11T00:15:13.802679+0000","last_undegraded":"2024-09-11T00:15:13.802679+0000","last_fullsized":"2024-09-11T00:15:13.802679+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:22:44.487422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T00:15:13.042586+0000","last_change":"2024-09-11T00:15:11.993586+0000","last_active":"2024-09-11T00:15:13.042586+0000","last_peered":"2024-09-11T00:15:13.042586+0000","last_clean":"2024-09-11T00:15:13.042586+0000","last_became_active":"2024-09-11T00:15:11.993208+0000","last_became_peered":"2024-09-11T00:15:11.993208+0000","last_unstale":"2024-09-11T00:15:13.042586+0000","last_undegraded":"2024-09-11T00:15:13.042586+0000","last_fullsized":"2024-09-11T00:15:13.042586+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:20:35.158910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T00:15:13.802879+0000","last_change":"2024-09-11T00:15:11.983885+0000","last_active":"2024-09-11T00:15:13.802879+0000","last_peered":"2024-09-11T00:15:13.802879+0000","last_clean":"2024-09-11T00:15:13.802879+0000","last_became_active":"2024-09-11T00:15:11.983628+0000","last_became_peered":"2024-09-11T00:15:11.983628+0000","last_unstale":"2024-09-11T00:15:13.802879+0000","last_undegraded":"2024-09-11T00:15:13.802879+0000","last_fullsized":"2024-09-11T00:15:13.802879+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:09:12.526681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T00:15:13.042527+0000","last_change":"2024-09-11T00:15:11.994474+0000","last_active":"2024-09-11T00:15:13.042527+0000","last_peered":"2024-09-11T00:15:13.042527+0000","last_clean":"2024-09-11T00:15:13.042527+0000","last_became_active":"2024-09-11T00:15:11.994161+0000","last_became_peered":"2024-09-11T00:15:11.994161+0000","last_unstale":"2024-09-11T00:15:13.042527+0000","last_undegraded":"2024-09-11T00:15:13.042527+0000","last_fullsized":"2024-09-11T00:15:13.042527+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:22:56.635297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T00:15:12.991927+0000","last_change":"2024-09-11T00:15:11.982721+0000","last_active":"2024-09-11T00:15:12.991927+0000","last_peered":"2024-09-11T00:15:12.991927+0000","last_clean":"2024-09-11T00:15:12.991927+0000","last_became_active":"2024-09-11T00:15:11.981979+0000","last_became_peered":"2024-09-11T00:15:11.981979+0000","last_unstale":"2024-09-11T00:15:12.991927+0000","last_undegraded":"2024-09-11T00:15:12.991927+0000","last_fullsized":"2024-09-11T00:15:12.991927+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:18:21.580588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T00:15:12.992077+0000","last_change":"2024-09-11T00:15:11.996951+0000","last_active":"2024-09-11T00:15:12.992077+0000","last_peered":"2024-09-11T00:15:12.992077+0000","last_clean":"2024-09-11T00:15:12.992077+0000","last_became_active":"2024-09-11T00:15:11.996664+0000","last_became_peered":"2024-09-11T00:15:11.996664+0000","last_unstale":"2024-09-11T00:15:12.992077+0000","last_undegraded":"2024-09-11T00:15:12.992077+0000","last_fullsized":"2024-09-11T00:15:12.992077+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:59:59.893676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T00:15:13.802124+0000","last_change":"2024-09-11T00:15:12.004148+0000","last_active":"2024-09-11T00:15:13.802124+0000","last_peered":"2024-09-11T00:15:13.802124+0000","last_clean":"2024-09-11T00:15:13.802124+0000","last_became_active":"2024-09-11T00:15:12.003829+0000","last_became_peered":"2024-09-11T00:15:12.003829+0000","last_unstale":"2024-09-11T00:15:13.802124+0000","last_undegraded":"2024-09-11T00:15:13.802124+0000","last_fullsized":"2024-09-11T00:15:13.802124+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:19:07.626300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T00:15:13.802491+0000","last_change":"2024-09-11T00:15:11.999179+0000","last_active":"2024-09-11T00:15:13.802491+0000","last_peered":"2024-09-11T00:15:13.802491+0000","last_clean":"2024-09-11T00:15:13.802491+0000","last_became_active":"2024-09-11T00:15:11.998956+0000","last_became_peered":"2024-09-11T00:15:11.998956+0000","last_unstale":"2024-09-11T00:15:13.802491+0000","last_undegraded":"2024-09-11T00:15:13.802491+0000","last_fullsized":"2024-09-11T00:15:13.802491+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:18:41.956047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T00:15:13.042679+0000","last_change":"2024-09-11T00:15:11.986296+0000","last_active":"2024-09-11T00:15:13.042679+0000","last_peered":"2024-09-11T00:15:13.042679+0000","last_clean":"2024-09-11T00:15:13.042679+0000","last_became_active":"2024-09-11T00:15:11.985641+0000","last_became_peered":"2024-09-11T00:15:11.985641+0000","last_unstale":"2024-09-11T00:15:13.042679+0000","last_undegraded":"2024-09-11T00:15:13.042679+0000","last_fullsized":"2024-09-11T00:15:13.042679+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:01:44.842185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T00:15:13.030020+0000","last_change":"2024-09-11T00:15:11.990612+0000","last_active":"2024-09-11T00:15:13.030020+0000","last_peered":"2024-09-11T00:15:13.030020+0000","last_clean":"2024-09-11T00:15:13.030020+0000","last_became_active":"2024-09-11T00:15:11.989737+0000","last_became_peered":"2024-09-11T00:15:11.989737+0000","last_unstale":"2024-09-11T00:15:13.030020+0000","last_undegraded":"2024-09-11T00:15:13.030020+0000","last_fullsized":"2024-09-11T00:15:13.030020+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:29:46.072304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T00:15:13.042602+0000","last_change":"2024-09-11T00:15:11.985470+0000","last_active":"2024-09-11T00:15:13.042602+0000","last_peered":"2024-09-11T00:15:13.042602+0000","last_clean":"2024-09-11T00:15:13.042602+0000","last_became_active":"2024-09-11T00:15:11.985048+0000","last_became_peered":"2024-09-11T00:15:11.985048+0000","last_unstale":"2024-09-11T00:15:13.042602+0000","last_undegraded":"2024-09-11T00:15:13.042602+0000","last_fullsized":"2024-09-11T00:15:13.042602+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:59:38.700143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T00:15:12.991620+0000","last_change":"2024-09-11T00:15:11.984503+0000","last_active":"2024-09-11T00:15:12.991620+0000","last_peered":"2024-09-11T00:15:12.991620+0000","last_clean":"2024-09-11T00:15:12.991620+0000","last_became_active":"2024-09-11T00:15:11.984226+0000","last_became_peered":"2024-09-11T00:15:11.984226+0000","last_unstale":"2024-09-11T00:15:12.991620+0000","last_undegraded":"2024-09-11T00:15:12.991620+0000","last_fullsized":"2024-09-11T00:15:12.991620+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:22:44.487422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T00:15:13.042522+0000","last_change":"2024-09-11T00:15:11.984682+0000","last_active":"2024-09-11T00:15:13.042522+0000","last_peered":"2024-09-11T00:15:13.042522+0000","last_clean":"2024-09-11T00:15:13.042522+0000","last_became_active":"2024-09-11T00:15:11.984415+0000","last_became_peered":"2024-09-11T00:15:11.984415+0000","last_unstale":"2024-09-11T00:15:13.042522+0000","last_undegraded":"2024-09-11T00:15:13.042522+0000","last_fullsized":"2024-09-11T00:15:13.042522+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:30:13.497076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T00:15:13.042463+0000","last_change":"2024-09-11T00:15:11.989539+0000","last_active":"2024-09-11T00:15:13.042463+0000","last_peered":"2024-09-11T00:15:13.042463+0000","last_clean":"2024-09-11T00:15:13.042463+0000","last_became_active":"2024-09-11T00:15:11.989289+0000","last_became_peered":"2024-09-11T00:15:11.989289+0000","last_unstale":"2024-09-11T00:15:13.042463+0000","last_undegraded":"2024-09-11T00:15:13.042463+0000","last_fullsized":"2024-09-11T00:15:13.042463+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:35:14.951961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T00:15:13.802424+0000","last_change":"2024-09-11T00:15:12.005579+0000","last_active":"2024-09-11T00:15:13.802424+0000","last_peered":"2024-09-11T00:15:13.802424+0000","last_clean":"2024-09-11T00:15:13.802424+0000","last_became_active":"2024-09-11T00:15:12.004267+0000","last_became_peered":"2024-09-11T00:15:12.004267+0000","last_unstale":"2024-09-11T00:15:13.802424+0000","last_undegraded":"2024-09-11T00:15:13.802424+0000","last_fullsized":"2024-09-11T00:15:13.802424+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:49:11.620971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T00:15:13.029788+0000","last_change":"2024-09-11T00:15:11.984826+0000","last_active":"2024-09-11T00:15:13.029788+0000","last_peered":"2024-09-11T00:15:13.029788+0000","last_clean":"2024-09-11T00:15:13.029788+0000","last_became_active":"2024-09-11T00:15:11.984307+0000","last_became_peered":"2024-09-11T00:15:11.984307+0000","last_unstale":"2024-09-11T00:15:13.029788+0000","last_undegraded":"2024-09-11T00:15:13.029788+0000","last_fullsized":"2024-09-11T00:15:13.029788+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:55:34.822419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T00:15:13.802418+0000","last_change":"2024-09-11T00:15:12.005723+0000","last_active":"2024-09-11T00:15:13.802418+0000","last_peered":"2024-09-11T00:15:13.802418+0000","last_clean":"2024-09-11T00:15:13.802418+0000","last_became_active":"2024-09-11T00:15:12.005398+0000","last_became_peered":"2024-09-11T00:15:12.005398+0000","last_unstale":"2024-09-11T00:15:13.802418+0000","last_undegraded":"2024-09-11T00:15:13.802418+0000","last_fullsized":"2024-09-11T00:15:13.802418+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:51:23.369565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"38'4","reported_seq":19,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T00:15:13.042565+0000","last_change":"2024-09-11T00:15:10.986669+0000","last_active":"2024-09-11T00:15:13.042565+0000","last_peered":"2024-09-11T00:15:13.042565+0000","last_clean":"2024-09-11T00:15:13.042565+0000","last_became_active":"2024-09-11T00:15:10.986409+0000","last_became_peered":"2024-09-11T00:15:10.986409+0000","last_unstale":"2024-09-11T00:15:13.042565+0000","last_undegraded":"2024-09-11T00:15:13.042565+0000","last_fullsized":"2024-09-11T00:15:13.042565+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_clean_scrub_stamp":"2024-09-11T00:15:09.955417+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:36:41.247206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T00:15:13.030077+0000","last_change":"2024-09-11T00:15:11.994104+0000","last_active":"2024-09-11T00:15:13.030077+0000","last_peered":"2024-09-11T00:15:13.030077+0000","last_clean":"2024-09-11T00:15:13.030077+0000","last_became_active":"2024-09-11T00:15:11.993787+0000","last_became_peered":"2024-09-11T00:15:11.993787+0000","last_unstale":"2024-09-11T00:15:13.030077+0000","last_undegraded":"2024-09-11T00:15:13.030077+0000","last_fullsized":"2024-09-11T00:15:13.030077+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:10:07.759508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"38'1","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T00:15:13.802786+0000","last_change":"2024-09-11T00:15:10.987651+0000","last_active":"2024-09-11T00:15:13.802786+0000","last_peered":"2024-09-11T00:15:13.802786+0000","last_clean":"2024-09-11T00:15:13.802786+0000","last_became_active":"2024-09-11T00:15:10.987365+0000","last_became_peered":"2024-09-11T00:15:10.987365+0000","last_unstale":"2024-09-11T00:15:13.802786+0000","last_undegraded":"2024-09-11T00:15:13.802786+0000","last_fullsized":"2024-09-11T00:15:13.802786+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_clean_scrub_stamp":"2024-09-11T00:15:09.955417+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:53:21.168815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T00:15:12.992470+0000","last_change":"2024-09-11T00:15:11.989911+0000","last_active":"2024-09-11T00:15:12.992470+0000","last_peered":"2024-09-11T00:15:12.992470+0000","last_clean":"2024-09-11T00:15:12.992470+0000","last_became_active":"2024-09-11T00:15:11.989434+0000","last_became_peered":"2024-09-11T00:15:11.989434+0000","last_unstale":"2024-09-11T00:15:12.992470+0000","last_undegraded":"2024-09-11T00:15:12.992470+0000","last_fullsized":"2024-09-11T00:15:12.992470+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:26:59.990245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"38'2","reported_seq":17,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T00:15:13.030125+0000","last_change":"2024-09-11T00:15:10.988735+0000","last_active":"2024-09-11T00:15:13.030125+0000","last_peered":"2024-09-11T00:15:13.030125+0000","last_clean":"2024-09-11T00:15:13.030125+0000","last_became_active":"2024-09-11T00:15:10.988449+0000","last_became_peered":"2024-09-11T00:15:10.988449+0000","last_unstale":"2024-09-11T00:15:13.030125+0000","last_undegraded":"2024-09-11T00:15:13.030125+0000","last_fullsized":"2024-09-11T00:15:13.030125+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_clean_scrub_stamp":"2024-09-11T00:15:09.955417+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:34:50.761829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T00:15:12.988905+0000","last_change":"2024-09-11T00:15:11.988181+0000","last_active":"2024-09-11T00:15:12.988905+0000","last_peered":"2024-09-11T00:15:12.988905+0000","last_clean":"2024-09-11T00:15:12.988905+0000","last_became_active":"2024-09-11T00:15:11.987724+0000","last_became_peered":"2024-09-11T00:15:11.987724+0000","last_unstale":"2024-09-11T00:15:12.988905+0000","last_undegraded":"2024-09-11T00:15:12.988905+0000","last_fullsized":"2024-09-11T00:15:12.988905+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:07:50.305377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"38'2","reported_seq":17,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T00:15:12.992234+0000","last_change":"2024-09-11T00:15:10.983607+0000","last_active":"2024-09-11T00:15:12.992234+0000","last_peered":"2024-09-11T00:15:12.992234+0000","last_clean":"2024-09-11T00:15:12.992234+0000","last_became_active":"2024-09-11T00:15:10.983327+0000","last_became_peered":"2024-09-11T00:15:10.983327+0000","last_unstale":"2024-09-11T00:15:12.992234+0000","last_undegraded":"2024-09-11T00:15:12.992234+0000","last_fullsized":"2024-09-11T00:15:12.992234+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_clean_scrub_stamp":"2024-09-11T00:15:09.955417+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:25:22.909623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T00:15:13.802411+0000","last_change":"2024-09-11T00:15:11.990149+0000","last_active":"2024-09-11T00:15:13.802411+0000","last_peered":"2024-09-11T00:15:13.802411+0000","last_clean":"2024-09-11T00:15:13.802411+0000","last_became_active":"2024-09-11T00:15:11.989909+0000","last_became_peered":"2024-09-11T00:15:11.989909+0000","last_unstale":"2024-09-11T00:15:13.802411+0000","last_undegraded":"2024-09-11T00:15:13.802411+0000","last_fullsized":"2024-09-11T00:15:13.802411+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:41:28.124141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"38'1","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T00:15:12.992076+0000","last_change":"2024-09-11T00:15:10.984669+0000","last_active":"2024-09-11T00:15:12.992076+0000","last_peered":"2024-09-11T00:15:12.992076+0000","last_clean":"2024-09-11T00:15:12.992076+0000","last_became_active":"2024-09-11T00:15:10.984215+0000","last_became_peered":"2024-09-11T00:15:10.984215+0000","last_unstale":"2024-09-11T00:15:12.992076+0000","last_undegraded":"2024-09-11T00:15:12.992076+0000","last_fullsized":"2024-09-11T00:15:12.992076+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_clean_scrub_stamp":"2024-09-11T00:15:09.955417+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:28:03.407802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T00:15:12.991981+0000","last_change":"2024-09-11T00:15:11.982642+0000","last_active":"2024-09-11T00:15:12.991981+0000","last_peered":"2024-09-11T00:15:12.991981+0000","last_clean":"2024-09-11T00:15:12.991981+0000","last_became_active":"2024-09-11T00:15:11.982021+0000","last_became_peered":"2024-09-11T00:15:11.982021+0000","last_unstale":"2024-09-11T00:15:12.991981+0000","last_undegraded":"2024-09-11T00:15:12.991981+0000","last_fullsized":"2024-09-11T00:15:12.991981+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:22:46.077777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"38'1","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T00:15:13.802159+0000","last_change":"2024-09-11T00:15:10.987655+0000","last_active":"2024-09-11T00:15:13.802159+0000","last_peered":"2024-09-11T00:15:13.802159+0000","last_clean":"2024-09-11T00:15:13.802159+0000","last_became_active":"2024-09-11T00:15:10.987373+0000","last_became_peered":"2024-09-11T00:15:10.987373+0000","last_unstale":"2024-09-11T00:15:13.802159+0000","last_undegraded":"2024-09-11T00:15:13.802159+0000","last_fullsized":"2024-09-11T00:15:13.802159+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_clean_scrub_stamp":"2024-09-11T00:15:09.955417+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:41:46.193502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T00:15:12.992605+0000","last_change":"2024-09-11T00:15:12.000133+0000","last_active":"2024-09-11T00:15:12.992605+0000","last_peered":"2024-09-11T00:15:12.992605+0000","last_clean":"2024-09-11T00:15:12.992605+0000","last_became_active":"2024-09-11T00:15:11.999840+0000","last_became_peered":"2024-09-11T00:15:11.999840+0000","last_unstale":"2024-09-11T00:15:12.992605+0000","last_undegraded":"2024-09-11T00:15:12.992605+0000","last_fullsized":"2024-09-11T00:15:12.992605+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:19:40.641084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T00:15:13.029805+0000","last_change":"2024-09-11T00:15:10.987183+0000","last_active":"2024-09-11T00:15:13.029805+0000","last_peered":"2024-09-11T00:15:13.029805+0000","last_clean":"2024-09-11T00:15:13.029805+0000","last_became_active":"2024-09-11T00:15:10.986886+0000","last_became_peered":"2024-09-11T00:15:10.986886+0000","last_unstale":"2024-09-11T00:15:13.029805+0000","last_undegraded":"2024-09-11T00:15:13.029805+0000","last_fullsized":"2024-09-11T00:15:13.029805+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_clean_scrub_stamp":"2024-09-11T00:15:09.955417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:57:48.764730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T00:15:12.988602+0000","last_change":"2024-09-11T00:15:12.002956+0000","last_active":"2024-09-11T00:15:12.988602+0000","last_peered":"2024-09-11T00:15:12.988602+0000","last_clean":"2024-09-11T00:15:12.988602+0000","last_became_active":"2024-09-11T00:15:12.002703+0000","last_became_peered":"2024-09-11T00:15:12.002703+0000","last_unstale":"2024-09-11T00:15:12.988602+0000","last_undegraded":"2024-09-11T00:15:12.988602+0000","last_fullsized":"2024-09-11T00:15:12.988602+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:42:09.028068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T00:15:12.991031+0000","last_change":"2024-09-11T00:15:10.977955+0000","last_active":"2024-09-11T00:15:12.991031+0000","last_peered":"2024-09-11T00:15:12.991031+0000","last_clean":"2024-09-11T00:15:12.991031+0000","last_became_active":"2024-09-11T00:15:10.977692+0000","last_became_peered":"2024-09-11T00:15:10.977692+0000","last_unstale":"2024-09-11T00:15:12.991031+0000","last_undegraded":"2024-09-11T00:15:12.991031+0000","last_fullsized":"2024-09-11T00:15:12.991031+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_clean_scrub_stamp":"2024-09-11T00:15:09.955417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:29:56.077160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T00:15:13.803196+0000","last_change":"2024-09-11T00:15:11.993072+0000","last_active":"2024-09-11T00:15:13.803196+0000","last_peered":"2024-09-11T00:15:13.803196+0000","last_clean":"2024-09-11T00:15:13.803196+0000","last_became_active":"2024-09-11T00:15:11.992777+0000","last_became_peered":"2024-09-11T00:15:11.992777+0000","last_unstale":"2024-09-11T00:15:13.803196+0000","last_undegraded":"2024-09-11T00:15:13.803196+0000","last_fullsized":"2024-09-11T00:15:13.803196+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:09:32.670055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T00:15:12.989043+0000","last_change":"2024-09-11T00:15:10.980706+0000","last_active":"2024-09-11T00:15:12.989043+0000","last_peered":"2024-09-11T00:15:12.989043+0000","last_clean":"2024-09-11T00:15:12.989043+0000","last_became_active":"2024-09-11T00:15:10.980429+0000","last_became_peered":"2024-09-11T00:15:10.980429+0000","last_unstale":"2024-09-11T00:15:12.989043+0000","last_undegraded":"2024-09-11T00:15:12.989043+0000","last_fullsized":"2024-09-11T00:15:12.989043+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_clean_scrub_stamp":"2024-09-11T00:15:09.955417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:21:57.800994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T00:15:13.802553+0000","last_change":"2024-09-11T00:15:12.001080+0000","last_active":"2024-09-11T00:15:13.802553+0000","last_peered":"2024-09-11T00:15:13.802553+0000","last_clean":"2024-09-11T00:15:13.802553+0000","last_became_active":"2024-09-11T00:15:11.998765+0000","last_became_peered":"2024-09-11T00:15:11.998765+0000","last_unstale":"2024-09-11T00:15:13.802553+0000","last_undegraded":"2024-09-11T00:15:13.802553+0000","last_fullsized":"2024-09-11T00:15:13.802553+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:13:00.658039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T00:15:12.992405+0000","last_change":"2024-09-11T00:15:10.987659+0000","last_active":"2024-09-11T00:15:12.992405+0000","last_peered":"2024-09-11T00:15:12.992405+0000","last_clean":"2024-09-11T00:15:12.992405+0000","last_became_active":"2024-09-11T00:15:10.987382+0000","last_became_peered":"2024-09-11T00:15:10.987382+0000","last_unstale":"2024-09-11T00:15:12.992405+0000","last_undegraded":"2024-09-11T00:15:12.992405+0000","last_fullsized":"2024-09-11T00:15:12.992405+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_clean_scrub_stamp":"2024-09-11T00:15:09.955417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:26:59.001581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T00:15:13.803110+0000","last_change":"2024-09-11T00:15:11.998770+0000","last_active":"2024-09-11T00:15:13.803110+0000","last_peered":"2024-09-11T00:15:13.803110+0000","last_clean":"2024-09-11T00:15:13.803110+0000","last_became_active":"2024-09-11T00:15:11.998477+0000","last_became_peered":"2024-09-11T00:15:11.998477+0000","last_unstale":"2024-09-11T00:15:13.803110+0000","last_undegraded":"2024-09-11T00:15:13.803110+0000","last_fullsized":"2024-09-11T00:15:13.803110+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:14:44.693719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"38'3","reported_seq":18,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T00:15:12.991917+0000","last_change":"2024-09-11T00:15:10.985997+0000","last_active":"2024-09-11T00:15:12.991917+0000","last_peered":"2024-09-11T00:15:12.991917+0000","last_clean":"2024-09-11T00:15:12.991917+0000","last_became_active":"2024-09-11T00:15:10.985724+0000","last_became_peered":"2024-09-11T00:15:10.985724+0000","last_unstale":"2024-09-11T00:15:12.991917+0000","last_undegraded":"2024-09-11T00:15:12.991917+0000","last_fullsized":"2024-09-11T00:15:12.991917+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_clean_scrub_stamp":"2024-09-11T00:15:09.955417+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:16:46.436919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T00:15:12.991835+0000","last_change":"2024-09-11T00:15:11.997734+0000","last_active":"2024-09-11T00:15:12.991835+0000","last_peered":"2024-09-11T00:15:12.991835+0000","last_clean":"2024-09-11T00:15:12.991835+0000","last_became_active":"2024-09-11T00:15:11.997379+0000","last_became_peered":"2024-09-11T00:15:11.997379+0000","last_unstale":"2024-09-11T00:15:12.991835+0000","last_undegraded":"2024-09-11T00:15:12.991835+0000","last_fullsized":"2024-09-11T00:15:12.991835+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:16:39.778863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"38'6","reported_seq":21,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T00:15:12.988694+0000","last_change":"2024-09-11T00:15:10.985361+0000","last_active":"2024-09-11T00:15:12.988694+0000","last_peered":"2024-09-11T00:15:12.988694+0000","last_clean":"2024-09-11T00:15:12.988694+0000","last_became_active":"2024-09-11T00:15:10.985070+0000","last_became_peered":"2024-09-11T00:15:10.985070+0000","last_unstale":"2024-09-11T00:15:12.988694+0000","last_undegraded":"2024-09-11T00:15:12.988694+0000","last_fullsized":"2024-09-11T00:15:12.988694+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_clean_scrub_stamp":"2024-09-11T00:15:09.955417+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:36:08.333344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T00:15:13.802411+0000","last_change":"2024-09-11T00:15:11.996031+0000","last_active":"2024-09-11T00:15:13.802411+0000","last_peered":"2024-09-11T00:15:13.802411+0000","last_clean":"2024-09-11T00:15:13.802411+0000","last_became_active":"2024-09-11T00:15:11.995734+0000","last_became_peered":"2024-09-11T00:15:11.995734+0000","last_unstale":"2024-09-11T00:15:13.802411+0000","last_undegraded":"2024-09-11T00:15:13.802411+0000","last_fullsized":"2024-09-11T00:15:13.802411+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:21:58.807270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"38'2","reported_seq":17,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T00:15:12.988844+0000","last_change":"2024-09-11T00:15:10.982086+0000","last_active":"2024-09-11T00:15:12.988844+0000","last_peered":"2024-09-11T00:15:12.988844+0000","last_clean":"2024-09-11T00:15:12.988844+0000","last_became_active":"2024-09-11T00:15:10.981821+0000","last_became_peered":"2024-09-11T00:15:10.981821+0000","last_unstale":"2024-09-11T00:15:12.988844+0000","last_undegraded":"2024-09-11T00:15:12.988844+0000","last_fullsized":"2024-09-11T00:15:12.988844+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_clean_scrub_stamp":"2024-09-11T00:15:09.955417+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:29:03.806148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T00:15:12.988413+0000","last_change":"2024-09-11T00:15:11.985531+0000","last_active":"2024-09-11T00:15:12.988413+0000","last_peered":"2024-09-11T00:15:12.988413+0000","last_clean":"2024-09-11T00:15:12.988413+0000","last_became_active":"2024-09-11T00:15:11.985177+0000","last_became_peered":"2024-09-11T00:15:11.985177+0000","last_unstale":"2024-09-11T00:15:12.988413+0000","last_undegraded":"2024-09-11T00:15:12.988413+0000","last_fullsized":"2024-09-11T00:15:12.988413+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:22:44.487422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T00:15:13.029983+0000","last_change":"2024-09-11T00:15:10.986902+0000","last_active":"2024-09-11T00:15:13.029983+0000","last_peered":"2024-09-11T00:15:13.029983+0000","last_clean":"2024-09-11T00:15:13.029983+0000","last_became_active":"2024-09-11T00:15:10.986618+0000","last_became_peered":"2024-09-11T00:15:10.986618+0000","last_unstale":"2024-09-11T00:15:13.029983+0000","last_undegraded":"2024-09-11T00:15:13.029983+0000","last_fullsized":"2024-09-11T00:15:13.029983+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_clean_scrub_stamp":"2024-09-11T00:15:09.955417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:05:08.232715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T00:15:13.802167+0000","last_change":"2024-09-11T00:15:12.001039+0000","last_active":"2024-09-11T00:15:13.802167+0000","last_peered":"2024-09-11T00:15:13.802167+0000","last_clean":"2024-09-11T00:15:13.802167+0000","last_became_active":"2024-09-11T00:15:11.998778+0000","last_became_peered":"2024-09-11T00:15:11.998778+0000","last_unstale":"2024-09-11T00:15:13.802167+0000","last_undegraded":"2024-09-11T00:15:13.802167+0000","last_fullsized":"2024-09-11T00:15:13.802167+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:59:36.084840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T00:15:13.042149+0000","last_change":"2024-09-11T00:15:10.979918+0000","last_active":"2024-09-11T00:15:13.042149+0000","last_peered":"2024-09-11T00:15:13.042149+0000","last_clean":"2024-09-11T00:15:13.042149+0000","last_became_active":"2024-09-11T00:15:10.979650+0000","last_became_peered":"2024-09-11T00:15:10.979650+0000","last_unstale":"2024-09-11T00:15:13.042149+0000","last_undegraded":"2024-09-11T00:15:13.042149+0000","last_fullsized":"2024-09-11T00:15:13.042149+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_clean_scrub_stamp":"2024-09-11T00:15:09.955417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:53:00.260194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T00:15:12.988602+0000","last_change":"2024-09-11T00:15:11.987485+0000","last_active":"2024-09-11T00:15:12.988602+0000","last_peered":"2024-09-11T00:15:12.988602+0000","last_clean":"2024-09-11T00:15:12.988602+0000","last_became_active":"2024-09-11T00:15:11.987231+0000","last_became_peered":"2024-09-11T00:15:11.987231+0000","last_unstale":"2024-09-11T00:15:12.988602+0000","last_undegraded":"2024-09-11T00:15:12.988602+0000","last_fullsized":"2024-09-11T00:15:12.988602+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:14:22.896672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"38'8","reported_seq":23,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T00:15:13.802061+0000","last_change":"2024-09-11T00:15:10.988757+0000","last_active":"2024-09-11T00:15:13.802061+0000","last_peered":"2024-09-11T00:15:13.802061+0000","last_clean":"2024-09-11T00:15:13.802061+0000","last_became_active":"2024-09-11T00:15:10.988326+0000","last_became_peered":"2024-09-11T00:15:10.988326+0000","last_unstale":"2024-09-11T00:15:13.802061+0000","last_undegraded":"2024-09-11T00:15:13.802061+0000","last_fullsized":"2024-09-11T00:15:13.802061+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_clean_scrub_stamp":"2024-09-11T00:15:09.955417+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:05:08.232715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T00:15:12.988749+0000","last_change":"2024-09-11T00:15:11.986504+0000","last_active":"2024-09-11T00:15:12.988749+0000","last_peered":"2024-09-11T00:15:12.988749+0000","last_clean":"2024-09-11T00:15:12.988749+0000","last_became_active":"2024-09-11T00:15:11.986188+0000","last_became_peered":"2024-09-11T00:15:11.986188+0000","last_unstale":"2024-09-11T00:15:12.988749+0000","last_undegraded":"2024-09-11T00:15:12.988749+0000","last_fullsized":"2024-09-11T00:15:12.988749+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:31:56.554340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"38'1","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T00:15:12.992409+0000","last_change":"2024-09-11T00:15:10.989224+0000","last_active":"2024-09-11T00:15:12.992409+0000","last_peered":"2024-09-11T00:15:12.992409+0000","last_clean":"2024-09-11T00:15:12.992409+0000","last_became_active":"2024-09-11T00:15:10.988925+0000","last_became_peered":"2024-09-11T00:15:10.988925+0000","last_unstale":"2024-09-11T00:15:12.992409+0000","last_undegraded":"2024-09-11T00:15:12.992409+0000","last_fullsized":"2024-09-11T00:15:12.992409+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_clean_scrub_stamp":"2024-09-11T00:15:09.955417+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:48:52.690670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T00:15:12.991751+0000","last_change":"2024-09-11T00:15:11.982787+0000","last_active":"2024-09-11T00:15:12.991751+0000","last_peered":"2024-09-11T00:15:12.991751+0000","last_clean":"2024-09-11T00:15:12.991751+0000","last_became_active":"2024-09-11T00:15:11.982326+0000","last_became_peered":"2024-09-11T00:15:11.982326+0000","last_unstale":"2024-09-11T00:15:12.991751+0000","last_undegraded":"2024-09-11T00:15:12.991751+0000","last_fullsized":"2024-09-11T00:15:12.991751+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:14:22.896672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"38'2","reported_seq":17,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T00:15:12.992600+0000","last_change":"2024-09-11T00:15:10.981474+0000","last_active":"2024-09-11T00:15:12.992600+0000","last_peered":"2024-09-11T00:15:12.992600+0000","last_clean":"2024-09-11T00:15:12.992600+0000","last_became_active":"2024-09-11T00:15:10.981200+0000","last_became_peered":"2024-09-11T00:15:10.981200+0000","last_unstale":"2024-09-11T00:15:12.992600+0000","last_undegraded":"2024-09-11T00:15:12.992600+0000","last_fullsized":"2024-09-11T00:15:12.992600+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_clean_scrub_stamp":"2024-09-11T00:15:09.955417+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:33:53.976909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T00:15:12.992448+0000","last_change":"2024-09-11T00:15:11.998394+0000","last_active":"2024-09-11T00:15:12.992448+0000","last_peered":"2024-09-11T00:15:12.992448+0000","last_clean":"2024-09-11T00:15:12.992448+0000","last_became_active":"2024-09-11T00:15:11.998135+0000","last_became_peered":"2024-09-11T00:15:11.998135+0000","last_unstale":"2024-09-11T00:15:12.992448+0000","last_undegraded":"2024-09-11T00:15:12.992448+0000","last_fullsized":"2024-09-11T00:15:12.992448+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:31:41.464092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"38'1","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T00:15:13.803166+0000","last_change":"2024-09-11T00:15:10.987926+0000","last_active":"2024-09-11T00:15:13.803166+0000","last_peered":"2024-09-11T00:15:13.803166+0000","last_clean":"2024-09-11T00:15:13.803166+0000","last_became_active":"2024-09-11T00:15:10.987658+0000","last_became_peered":"2024-09-11T00:15:10.987658+0000","last_unstale":"2024-09-11T00:15:13.803166+0000","last_undegraded":"2024-09-11T00:15:13.803166+0000","last_fullsized":"2024-09-11T00:15:13.803166+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_clean_scrub_stamp":"2024-09-11T00:15:09.955417+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:40:35.912290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T00:15:13.802835+0000","last_change":"2024-09-11T00:15:11.987932+0000","last_active":"2024-09-11T00:15:13.802835+0000","last_peered":"2024-09-11T00:15:13.802835+0000","last_clean":"2024-09-11T00:15:13.802835+0000","last_became_active":"2024-09-11T00:15:11.987642+0000","last_became_peered":"2024-09-11T00:15:11.987642+0000","last_unstale":"2024-09-11T00:15:13.802835+0000","last_undegraded":"2024-09-11T00:15:13.802835+0000","last_fullsized":"2024-09-11T00:15:13.802835+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:36:42.253482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T00:15:13.030132+0000","last_change":"2024-09-11T00:15:10.982457+0000","last_active":"2024-09-11T00:15:13.030132+0000","last_peered":"2024-09-11T00:15:13.030132+0000","last_clean":"2024-09-11T00:15:13.030132+0000","last_became_active":"2024-09-11T00:15:10.982196+0000","last_became_peered":"2024-09-11T00:15:10.982196+0000","last_unstale":"2024-09-11T00:15:13.030132+0000","last_undegraded":"2024-09-11T00:15:13.030132+0000","last_fullsized":"2024-09-11T00:15:13.030132+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_clean_scrub_stamp":"2024-09-11T00:15:09.955417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:53:21.168815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T00:15:13.802364+0000","last_change":"2024-09-11T00:15:11.998392+0000","last_active":"2024-09-11T00:15:13.802364+0000","last_peered":"2024-09-11T00:15:13.802364+0000","last_clean":"2024-09-11T00:15:13.802364+0000","last_became_active":"2024-09-11T00:15:11.998147+0000","last_became_peered":"2024-09-11T00:15:11.998147+0000","last_unstale":"2024-09-11T00:15:13.802364+0000","last_undegraded":"2024-09-11T00:15:13.802364+0000","last_fullsized":"2024-09-11T00:15:13.802364+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:04:16.821949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"38'2","reported_seq":17,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T00:15:13.802811+0000","last_change":"2024-09-11T00:15:10.982090+0000","last_active":"2024-09-11T00:15:13.802811+0000","last_peered":"2024-09-11T00:15:13.802811+0000","last_clean":"2024-09-11T00:15:13.802811+0000","last_became_active":"2024-09-11T00:15:10.980995+0000","last_became_peered":"2024-09-11T00:15:10.980995+0000","last_unstale":"2024-09-11T00:15:13.802811+0000","last_undegraded":"2024-09-11T00:15:13.802811+0000","last_fullsized":"2024-09-11T00:15:13.802811+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_clean_scrub_stamp":"2024-09-11T00:15:09.955417+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:13:04.238800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T00:15:13.802612+0000","last_change":"2024-09-11T00:15:12.004792+0000","last_active":"2024-09-11T00:15:13.802612+0000","last_peered":"2024-09-11T00:15:13.802612+0000","last_clean":"2024-09-11T00:15:13.802612+0000","last_became_active":"2024-09-11T00:15:12.004535+0000","last_became_peered":"2024-09-11T00:15:12.004535+0000","last_unstale":"2024-09-11T00:15:13.802612+0000","last_undegraded":"2024-09-11T00:15:13.802612+0000","last_fullsized":"2024-09-11T00:15:13.802612+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:58:17.603588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T00:15:13.802835+0000","last_change":"2024-09-11T00:15:10.982293+0000","last_active":"2024-09-11T00:15:13.802835+0000","last_peered":"2024-09-11T00:15:13.802835+0000","last_clean":"2024-09-11T00:15:13.802835+0000","last_became_active":"2024-09-11T00:15:10.981953+0000","last_became_peered":"2024-09-11T00:15:10.981953+0000","last_unstale":"2024-09-11T00:15:13.802835+0000","last_undegraded":"2024-09-11T00:15:13.802835+0000","last_fullsized":"2024-09-11T00:15:13.802835+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_clean_scrub_stamp":"2024-09-11T00:15:09.955417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:46:34.805499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T00:15:12.992116+0000","last_change":"2024-09-11T00:15:11.979526+0000","last_active":"2024-09-11T00:15:12.992116+0000","last_peered":"2024-09-11T00:15:12.992116+0000","last_clean":"2024-09-11T00:15:12.992116+0000","last_became_active":"2024-09-11T00:15:11.979276+0000","last_became_peered":"2024-09-11T00:15:11.979276+0000","last_unstale":"2024-09-11T00:15:12.992116+0000","last_undegraded":"2024-09-11T00:15:12.992116+0000","last_fullsized":"2024-09-11T00:15:12.992116+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:42:51.858034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T00:15:13.802511+0000","last_change":"2024-09-11T00:15:10.983758+0000","last_active":"2024-09-11T00:15:13.802511+0000","last_peered":"2024-09-11T00:15:13.802511+0000","last_clean":"2024-09-11T00:15:13.802511+0000","last_became_active":"2024-09-11T00:15:10.983483+0000","last_became_peered":"2024-09-11T00:15:10.983483+0000","last_unstale":"2024-09-11T00:15:13.802511+0000","last_undegraded":"2024-09-11T00:15:13.802511+0000","last_fullsized":"2024-09-11T00:15:13.802511+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_clean_scrub_stamp":"2024-09-11T00:15:09.955417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:58:30.377476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T00:15:12.988873+0000","last_change":"2024-09-11T00:15:12.002877+0000","last_active":"2024-09-11T00:15:12.988873+0000","last_peered":"2024-09-11T00:15:12.988873+0000","last_clean":"2024-09-11T00:15:12.988873+0000","last_became_active":"2024-09-11T00:15:12.002631+0000","last_became_peered":"2024-09-11T00:15:12.002631+0000","last_unstale":"2024-09-11T00:15:12.988873+0000","last_undegraded":"2024-09-11T00:15:12.988873+0000","last_fullsized":"2024-09-11T00:15:12.988873+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:42:51.858034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T00:15:13.802573+0000","last_change":"2024-09-11T00:15:10.981282+0000","last_active":"2024-09-11T00:15:13.802573+0000","last_peered":"2024-09-11T00:15:13.802573+0000","last_clean":"2024-09-11T00:15:13.802573+0000","last_became_active":"2024-09-11T00:15:10.981000+0000","last_became_peered":"2024-09-11T00:15:10.981000+0000","last_unstale":"2024-09-11T00:15:13.802573+0000","last_undegraded":"2024-09-11T00:15:13.802573+0000","last_fullsized":"2024-09-11T00:15:13.802573+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_clean_scrub_stamp":"2024-09-11T00:15:09.955417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:21:17.784117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T00:15:13.030192+0000","last_change":"2024-09-11T00:15:11.991223+0000","last_active":"2024-09-11T00:15:13.030192+0000","last_peered":"2024-09-11T00:15:13.030192+0000","last_clean":"2024-09-11T00:15:13.030192+0000","last_became_active":"2024-09-11T00:15:11.990994+0000","last_became_peered":"2024-09-11T00:15:11.990994+0000","last_unstale":"2024-09-11T00:15:13.030192+0000","last_undegraded":"2024-09-11T00:15:13.030192+0000","last_fullsized":"2024-09-11T00:15:13.030192+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:36:28.817007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"38'2","reported_seq":17,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T00:15:12.992619+0000","last_change":"2024-09-11T00:15:10.984511+0000","last_active":"2024-09-11T00:15:12.992619+0000","last_peered":"2024-09-11T00:15:12.992619+0000","last_clean":"2024-09-11T00:15:12.992619+0000","last_became_active":"2024-09-11T00:15:10.984234+0000","last_became_peered":"2024-09-11T00:15:10.984234+0000","last_unstale":"2024-09-11T00:15:12.992619+0000","last_undegraded":"2024-09-11T00:15:12.992619+0000","last_fullsized":"2024-09-11T00:15:12.992619+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_clean_scrub_stamp":"2024-09-11T00:15:09.955417+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:36:08.333344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T00:15:13.802499+0000","last_change":"2024-09-11T00:15:12.001691+0000","last_active":"2024-09-11T00:15:13.802499+0000","last_peered":"2024-09-11T00:15:13.802499+0000","last_clean":"2024-09-11T00:15:13.802499+0000","last_became_active":"2024-09-11T00:15:12.001180+0000","last_became_peered":"2024-09-11T00:15:12.001180+0000","last_unstale":"2024-09-11T00:15:13.802499+0000","last_undegraded":"2024-09-11T00:15:13.802499+0000","last_fullsized":"2024-09-11T00:15:13.802499+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:10:10.614680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"39'1","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T00:15:13.803001+0000","last_change":"2024-09-11T00:15:10.980366+0000","last_active":"2024-09-11T00:15:13.803001+0000","last_peered":"2024-09-11T00:15:13.803001+0000","last_clean":"2024-09-11T00:15:13.803001+0000","last_became_active":"2024-09-11T00:15:10.980077+0000","last_became_peered":"2024-09-11T00:15:10.980077+0000","last_unstale":"2024-09-11T00:15:13.803001+0000","last_undegraded":"2024-09-11T00:15:13.803001+0000","last_fullsized":"2024-09-11T00:15:13.803001+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_clean_scrub_stamp":"2024-09-11T00:15:09.955417+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:45:01.513192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T00:15:12.988983+0000","last_change":"2024-09-11T00:15:11.994143+0000","last_active":"2024-09-11T00:15:12.988983+0000","last_peered":"2024-09-11T00:15:12.988983+0000","last_clean":"2024-09-11T00:15:12.988983+0000","last_became_active":"2024-09-11T00:15:11.993393+0000","last_became_peered":"2024-09-11T00:15:11.993393+0000","last_unstale":"2024-09-11T00:15:12.988983+0000","last_undegraded":"2024-09-11T00:15:12.988983+0000","last_fullsized":"2024-09-11T00:15:12.988983+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:22:46.077777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T00:15:13.802549+0000","last_change":"2024-09-11T00:15:10.984774+0000","last_active":"2024-09-11T00:15:13.802549+0000","last_peered":"2024-09-11T00:15:13.802549+0000","last_clean":"2024-09-11T00:15:13.802549+0000","last_became_active":"2024-09-11T00:15:10.983875+0000","last_became_peered":"2024-09-11T00:15:10.983875+0000","last_unstale":"2024-09-11T00:15:13.802549+0000","last_undegraded":"2024-09-11T00:15:13.802549+0000","last_fullsized":"2024-09-11T00:15:13.802549+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_clean_scrub_stamp":"2024-09-11T00:15:09.955417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:05:08.232715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T00:15:13.802884+0000","last_change":"2024-09-11T00:15:11.988649+0000","last_active":"2024-09-11T00:15:13.802884+0000","last_peered":"2024-09-11T00:15:13.802884+0000","last_clean":"2024-09-11T00:15:13.802884+0000","last_became_active":"2024-09-11T00:15:11.988254+0000","last_became_peered":"2024-09-11T00:15:11.988254+0000","last_unstale":"2024-09-11T00:15:13.802884+0000","last_undegraded":"2024-09-11T00:15:13.802884+0000","last_fullsized":"2024-09-11T00:15:13.802884+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:31:26.401439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T00:15:13.803159+0000","last_change":"2024-09-11T00:15:10.984350+0000","last_active":"2024-09-11T00:15:13.803159+0000","last_peered":"2024-09-11T00:15:13.803159+0000","last_clean":"2024-09-11T00:15:13.803159+0000","last_became_active":"2024-09-11T00:15:10.984092+0000","last_became_peered":"2024-09-11T00:15:10.984092+0000","last_unstale":"2024-09-11T00:15:13.803159+0000","last_undegraded":"2024-09-11T00:15:13.803159+0000","last_fullsized":"2024-09-11T00:15:13.803159+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_clean_scrub_stamp":"2024-09-11T00:15:09.955417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:41:46.193502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T00:15:13.029816+0000","last_change":"2024-09-11T00:15:11.981492+0000","last_active":"2024-09-11T00:15:13.029816+0000","last_peered":"2024-09-11T00:15:13.029816+0000","last_clean":"2024-09-11T00:15:13.029816+0000","last_became_active":"2024-09-11T00:15:11.981199+0000","last_became_peered":"2024-09-11T00:15:11.981199+0000","last_unstale":"2024-09-11T00:15:13.029816+0000","last_undegraded":"2024-09-11T00:15:13.029816+0000","last_fullsized":"2024-09-11T00:15:13.029816+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:44:35.668656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T00:15:13.042211+0000","last_change":"2024-09-11T00:15:10.993082+0000","last_active":"2024-09-11T00:15:13.042211+0000","last_peered":"2024-09-11T00:15:13.042211+0000","last_clean":"2024-09-11T00:15:13.042211+0000","last_became_active":"2024-09-11T00:15:10.992868+0000","last_became_peered":"2024-09-11T00:15:10.992868+0000","last_unstale":"2024-09-11T00:15:13.042211+0000","last_undegraded":"2024-09-11T00:15:13.042211+0000","last_fullsized":"2024-09-11T00:15:13.042211+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_clean_scrub_stamp":"2024-09-11T00:15:09.955417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:09:11.520405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T00:15:12.991487+0000","last_change":"2024-09-11T00:15:11.999345+0000","last_active":"2024-09-11T00:15:12.991487+0000","last_peered":"2024-09-11T00:15:12.991487+0000","last_clean":"2024-09-11T00:15:12.991487+0000","last_became_active":"2024-09-11T00:15:11.999031+0000","last_became_peered":"2024-09-11T00:15:11.999031+0000","last_unstale":"2024-09-11T00:15:12.991487+0000","last_undegraded":"2024-09-11T00:15:12.991487+0000","last_fullsized":"2024-09-11T00:15:12.991487+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:39:21.748577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T00:15:12.991143+0000","last_change":"2024-09-11T00:15:10.983535+0000","last_active":"2024-09-11T00:15:12.991143+0000","last_peered":"2024-09-11T00:15:12.991143+0000","last_clean":"2024-09-11T00:15:12.991143+0000","last_became_active":"2024-09-11T00:15:10.983265+0000","last_became_peered":"2024-09-11T00:15:10.983265+0000","last_unstale":"2024-09-11T00:15:12.991143+0000","last_undegraded":"2024-09-11T00:15:12.991143+0000","last_fullsized":"2024-09-11T00:15:12.991143+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_clean_scrub_stamp":"2024-09-11T00:15:09.955417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:46:54.895627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T00:15:13.802399+0000","last_change":"2024-09-11T00:15:12.001186+0000","last_active":"2024-09-11T00:15:13.802399+0000","last_peered":"2024-09-11T00:15:13.802399+0000","last_clean":"2024-09-11T00:15:13.802399+0000","last_became_active":"2024-09-11T00:15:11.998947+0000","last_became_peered":"2024-09-11T00:15:11.998947+0000","last_unstale":"2024-09-11T00:15:13.802399+0000","last_undegraded":"2024-09-11T00:15:13.802399+0000","last_fullsized":"2024-09-11T00:15:13.802399+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:14:44.693719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T00:15:12.988384+0000","last_change":"2024-09-11T00:15:10.980323+0000","last_active":"2024-09-11T00:15:12.988384+0000","last_peered":"2024-09-11T00:15:12.988384+0000","last_clean":"2024-09-11T00:15:12.988384+0000","last_became_active":"2024-09-11T00:15:10.980050+0000","last_became_peered":"2024-09-11T00:15:10.980050+0000","last_unstale":"2024-09-11T00:15:12.988384+0000","last_undegraded":"2024-09-11T00:15:12.988384+0000","last_fullsized":"2024-09-11T00:15:12.988384+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_clean_scrub_stamp":"2024-09-11T00:15:09.955417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:43:32.387961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T00:15:12.991900+0000","last_change":"2024-09-11T00:15:11.989310+0000","last_active":"2024-09-11T00:15:12.991900+0000","last_peered":"2024-09-11T00:15:12.991900+0000","last_clean":"2024-09-11T00:15:12.991900+0000","last_became_active":"2024-09-11T00:15:11.989042+0000","last_became_peered":"2024-09-11T00:15:11.989042+0000","last_unstale":"2024-09-11T00:15:12.991900+0000","last_undegraded":"2024-09-11T00:15:12.991900+0000","last_fullsized":"2024-09-11T00:15:12.991900+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:10.961693+0000","last_clean_scrub_stamp":"2024-09-11T00:15:10.961693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:31:56.554340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T00:15:13.802473+0000","last_change":"2024-09-11T00:15:10.984732+0000","last_active":"2024-09-11T00:15:13.802473+0000","last_peered":"2024-09-11T00:15:13.802473+0000","last_clean":"2024-09-11T00:15:13.802473+0000","last_became_active":"2024-09-11T00:15:10.984375+0000","last_became_peered":"2024-09-11T00:15:10.984375+0000","last_unstale":"2024-09-11T00:15:13.802473+0000","last_undegraded":"2024-09-11T00:15:13.802473+0000","last_fullsized":"2024-09-11T00:15:13.802473+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:15:09.955417+0000","last_clean_scrub_stamp":"2024-09-11T00:15:09.955417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:34:50.761829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":145,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T00:15:13.802332+0000","last_change":"2024-09-11T00:14:08.221813+0000","last_active":"2024-09-11T00:15:13.802332+0000","last_peered":"2024-09-11T00:15:13.802332+0000","last_clean":"2024-09-11T00:15:13.802332+0000","last_became_active":"2024-09-11T00:14:08.220663+0000","last_became_peered":"2024-09-11T00:14:08.220663+0000","last_unstale":"2024-09-11T00:15:13.802332+0000","last_undegraded":"2024-09-11T00:15:13.802332+0000","last_fullsized":"2024-09-11T00:15:13.802332+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:06.563107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:06.563107+0000","last_clean_scrub_stamp":"2024-09-11T00:14:06.563107+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:44:49.322583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509458,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28056,"kb_used_data":1028,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343784,"statfs":{"total":96636764160,"available":96608034816,"internally_reserved":0,"allocated":1052672,"data_stored":784523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509458,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27476,"kb_used_data":440,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344364,"statfs":{"total":96636764160,"available":96608628736,"internally_reserved":0,"allocated":450560,"data_stored":192585,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509457,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27468,"kb_used_data":440,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344372,"statfs":{"total":96636764160,"available":96608636928,"internally_reserved":0,"allocated":450560,"data_stored":193077,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509457,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27484,"kb_used_data":448,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344356,"statfs":{"total":96636764160,"available":96608620544,"internally_reserved":0,"allocated":458752,"data_stored":194119,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509459,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27468,"kb_used_data":436,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344372,"statfs":{"total":96636764160,"available":96608636928,"internally_reserved":0,"allocated":446464,"data_stored":192563,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509458,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28044,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343796,"statfs":{"total":96636764160,"available":96608047104,"internally_reserved":0,"allocated":1040384,"data_stored":782875,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542162,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27464,"kb_used_data":436,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344376,"statfs":{"total":96636764160,"available":96608641024,"internally_reserved":0,"allocated":446464,"data_stored":192543,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574866,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27472,"kb_used_data":436,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344368,"statfs":{"total":96636764160,"available":96608632832,"internally_reserved":0,"allocated":446464,"data_stored":193055,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T00:15:19.661 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-11T00:15:19.661 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-11T00:15:19.809 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:19.804+0000 7f74fd52c640 1 -- 172.21.15.92:0/2117119352 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f74f8144780 msgr2=0x7f74f80b3da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:19.810 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:19.804+0000 7f74fd52c640 1 --2- 172.21.15.92:0/2117119352 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f74f8144780 0x7f74f80b3da0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f74f0009830 tx=0x7f74f002a480 comp rx=0 tx=0).stop 2024-09-11T00:15:19.810 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:19.804+0000 7f74fd52c640 1 -- 172.21.15.92:0/2117119352 shutdown_connections 2024-09-11T00:15:19.810 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:19.804+0000 7f74fd52c640 1 --2- 172.21.15.92:0/2117119352 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f74f8072680 0x7f74f8072aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:19.810 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:19.804+0000 7f74fd52c640 1 --2- 172.21.15.92:0/2117119352 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f74f8144780 0x7f74f80b3da0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:19.810 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:19.804+0000 7f74fd52c640 1 -- 172.21.15.92:0/2117119352 >> 172.21.15.92:0/2117119352 conn(0x7f74f80b1760 msgr2=0x7f74f80b1b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:15:19.810 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:19.804+0000 7f74fd52c640 1 -- 172.21.15.92:0/2117119352 shutdown_connections 2024-09-11T00:15:19.810 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:19.804+0000 7f74fd52c640 1 -- 172.21.15.92:0/2117119352 wait complete. 2024-09-11T00:15:19.810 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:19.805+0000 7f74fd52c640 1 Processor -- start 2024-09-11T00:15:19.810 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:19.806+0000 7f74fd52c640 1 -- start start 2024-09-11T00:15:19.810 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:19.806+0000 7f74fd52c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f74f8072680 0x7f74f815a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:19.810 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:19.806+0000 7f74fd52c640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f74f80ceb00 0x7f74f81432c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:19.811 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:19.806+0000 7f74fd52c640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f74f8144780 0x7f74f8162690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:19.811 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:19.806+0000 7f74fd52c640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f74f815cff0 con 0x7f74f8072680 2024-09-11T00:15:19.811 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:19.806+0000 7f74fd52c640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f74f815ce70 con 0x7f74f80ceb00 2024-09-11T00:15:19.811 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:19.806+0000 7f74fd52c640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f74f80cef10 con 0x7f74f8144780 2024-09-11T00:15:19.811 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:19.806+0000 7f74f6ffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f74f8072680 0x7f74f815a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:19.811 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:19.806+0000 7f74f6ffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f74f8072680 0x7f74f815a4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:54742/0 (socket says 172.21.15.92:54742) 2024-09-11T00:15:19.811 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:19.806+0000 7f74f6ffd640 1 -- 172.21.15.92:0/1774860875 learned_addr learned my addr 172.21.15.92:0/1774860875 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-11T00:15:19.811 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:19.807+0000 7f74f67fc640 1 --2- 172.21.15.92:0/1774860875 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f74f80ceb00 0x7f74f81432c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:19.811 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:19.807+0000 7f74f77fe640 1 --2- 172.21.15.92:0/1774860875 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f74f8144780 0x7f74f8162690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:19.811 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:19.807+0000 7f74f6ffd640 1 -- 172.21.15.92:0/1774860875 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f74f8144780 msgr2=0x7f74f8162690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:19.811 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:19.807+0000 7f74f6ffd640 1 --2- 172.21.15.92:0/1774860875 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f74f8144780 0x7f74f8162690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:19.811 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:19.807+0000 7f74f6ffd640 1 -- 172.21.15.92:0/1774860875 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f74f80ceb00 msgr2=0x7f74f81432c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:19.811 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:19.807+0000 7f74f6ffd640 1 --2- 172.21.15.92:0/1774860875 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f74f80ceb00 0x7f74f81432c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:19.811 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:19.807+0000 7f74f6ffd640 1 -- 172.21.15.92:0/1774860875 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74f8164780 con 0x7f74f8072680 2024-09-11T00:15:19.812 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:19.807+0000 7f74f6ffd640 1 --2- 172.21.15.92:0/1774860875 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f74f8072680 0x7f74f815a4a0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f74f0009950 tx=0x7f74f0033c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:15:19.812 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:19.807+0000 7f74ef7fe640 1 -- 172.21.15.92:0/1774860875 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74f0005c90 con 0x7f74f8072680 2024-09-11T00:15:19.812 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:19.807+0000 7f74ef7fe640 1 -- 172.21.15.92:0/1774860875 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f74f0031e50 con 0x7f74f8072680 2024-09-11T00:15:19.812 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:19.807+0000 7f74fd52c640 1 -- 172.21.15.92:0/1774860875 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f74f8143f80 con 0x7f74f8072680 2024-09-11T00:15:19.812 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:19.807+0000 7f74ef7fe640 1 -- 172.21.15.92:0/1774860875 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74f0005260 con 0x7f74f8072680 2024-09-11T00:15:19.812 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:19.807+0000 7f74fd52c640 1 -- 172.21.15.92:0/1774860875 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74f8164ce0 con 0x7f74f8072680 2024-09-11T00:15:19.812 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:19.808+0000 7f74fd52c640 1 -- 172.21.15.92:0/1774860875 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f74f80b3da0 con 0x7f74f8072680 2024-09-11T00:15:19.813 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:19.809+0000 7f74ef7fe640 1 -- 172.21.15.92:0/1774860875 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f74f0005400 con 0x7f74f8072680 2024-09-11T00:15:19.813 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:19.809+0000 7f74ef7fe640 1 --2- 172.21.15.92:0/1774860875 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f74d8077f70 0x7f74d807a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:19.813 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:19.809+0000 7f74ef7fe640 1 -- 172.21.15.92:0/1774860875 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7f74f00bae60 con 0x7f74f8072680 2024-09-11T00:15:19.813 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:19.810+0000 7f74f67fc640 1 --2- 172.21.15.92:0/1774860875 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f74d8077f70 0x7f74d807a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:19.813 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:19.810+0000 7f74f67fc640 1 --2- 172.21.15.92:0/1774860875 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f74d8077f70 0x7f74d807a430 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f74f81f7f00 tx=0x7f74e0005f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:15:19.814 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:19.813+0000 7f74ef7fe640 1 -- 172.21.15.92:0/1774860875 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f74f8164780 con 0x7f74f8072680 2024-09-11T00:15:20.060 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:20.058+0000 7f74fd52c640 1 -- 172.21.15.92:0/1774860875 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f74f80b0030 con 0x7f74f8072680 2024-09-11T00:15:20.062 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:20.060+0000 7f74ef7fe640 1 -- 172.21.15.92:0/1774860875 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v11) ==== 190+0+147 (secure 0 0 0) 0x7f74f003f030 con 0x7f74f8072680 2024-09-11T00:15:20.064 INFO:teuthology.orchestra.run.smithi092.stdout:[client.0] 2024-09-11T00:15:20.064 INFO:teuthology.orchestra.run.smithi092.stdout: key = AQCe4OBmiRAJLhAATruvtg1BGyubuDnFLT3rug== 2024-09-11T00:15:20.064 INFO:teuthology.orchestra.run.smithi092.stdout: caps mds = "allow" 2024-09-11T00:15:20.064 INFO:teuthology.orchestra.run.smithi092.stdout: caps mon = "allow r" 2024-09-11T00:15:20.064 INFO:teuthology.orchestra.run.smithi092.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-11T00:15:20.065 INFO:teuthology.orchestra.run.smithi092.stderr:updated caps for client.0 2024-09-11T00:15:20.065 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:20.063+0000 7f74fd52c640 1 -- 172.21.15.92:0/1774860875 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f74d8077f70 msgr2=0x7f74d807a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:20.065 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:20.063+0000 7f74fd52c640 1 --2- 172.21.15.92:0/1774860875 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f74d8077f70 0x7f74d807a430 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f74f81f7f00 tx=0x7f74e0005f90 comp rx=0 tx=0).stop 2024-09-11T00:15:20.065 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:20.063+0000 7f74fd52c640 1 -- 172.21.15.92:0/1774860875 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f74f8072680 msgr2=0x7f74f815a4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:20.065 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:20.063+0000 7f74fd52c640 1 --2- 172.21.15.92:0/1774860875 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f74f8072680 0x7f74f815a4a0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f74f0009950 tx=0x7f74f0033c20 comp rx=0 tx=0).stop 2024-09-11T00:15:20.065 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:20.063+0000 7f74fd52c640 1 -- 172.21.15.92:0/1774860875 shutdown_connections 2024-09-11T00:15:20.065 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:20.063+0000 7f74fd52c640 1 --2- 172.21.15.92:0/1774860875 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f74d8077f70 0x7f74d807a430 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:20.065 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:20.063+0000 7f74fd52c640 1 --2- 172.21.15.92:0/1774860875 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f74f8144780 0x7f74f8162690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:20.065 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:20.063+0000 7f74fd52c640 1 --2- 172.21.15.92:0/1774860875 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f74f80ceb00 0x7f74f81432c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:20.066 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:20.063+0000 7f74fd52c640 1 --2- 172.21.15.92:0/1774860875 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f74f8072680 0x7f74f815a4a0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:20.066 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:20.063+0000 7f74fd52c640 1 -- 172.21.15.92:0/1774860875 >> 172.21.15.92:0/1774860875 conn(0x7f74f80b1760 msgr2=0x7f74f80cfa80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:15:20.066 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:20.063+0000 7f74fd52c640 1 -- 172.21.15.92:0/1774860875 shutdown_connections 2024-09-11T00:15:20.066 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:20.063+0000 7f74fd52c640 1 -- 172.21.15.92:0/1774860875 wait complete. 2024-09-11T00:15:20.075 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T00:15:20.176 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:20.174+0000 7f484a4ef640 1 -- 172.21.15.92:0/2919680089 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f484406e2e0 msgr2=0x7f484415e530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:20.176 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:20.174+0000 7f484a4ef640 1 --2- 172.21.15.92:0/2919680089 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f484406e2e0 0x7f484415e530 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f4838009830 tx=0x7f483802a510 comp rx=0 tx=0).stop 2024-09-11T00:15:20.177 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:20.174+0000 7f484a4ef640 1 -- 172.21.15.92:0/2919680089 shutdown_connections 2024-09-11T00:15:20.177 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:20.174+0000 7f484a4ef640 1 --2- 172.21.15.92:0/2919680089 >> v2:172.21.15.145:3300/0 conn(0x7f48440cf110 0x7f48440b47b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:20.177 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:20.174+0000 7f484a4ef640 1 --2- 172.21.15.92:0/2919680089 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f484406e2e0 0x7f484415e530 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:20.177 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:20.174+0000 7f484a4ef640 1 -- 172.21.15.92:0/2919680089 >> 172.21.15.92:0/2919680089 conn(0x7f48440b1760 msgr2=0x7f48440b1b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:15:20.177 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:20.174+0000 7f484a4ef640 1 -- 172.21.15.92:0/2919680089 shutdown_connections 2024-09-11T00:15:20.177 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:20.174+0000 7f484a4ef640 1 -- 172.21.15.92:0/2919680089 wait complete. 2024-09-11T00:15:20.179 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:20.175+0000 7f484a4ef640 1 Processor -- start 2024-09-11T00:15:20.179 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:20.176+0000 7f484a4ef640 1 -- start start 2024-09-11T00:15:20.179 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:20.176+0000 7f484a4ef640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f484406e2e0 0x7f4844145be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:20.179 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:20.176+0000 7f484a4ef640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f48440cf110 0x7f4844145340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:20.179 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:20.176+0000 7f484a4ef640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f484415e150 0x7f484414ec70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:20.179 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:20.176+0000 7f484a4ef640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f48440cc570 con 0x7f484406e2e0 2024-09-11T00:15:20.180 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:20.176+0000 7f484a4ef640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f48440729d0 con 0x7f484415e150 2024-09-11T00:15:20.180 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:20.176+0000 7f484a4ef640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f48440cc6f0 con 0x7f48440cf110 2024-09-11T00:15:20.180 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:20.176+0000 7f4843fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f484406e2e0 0x7f4844145be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:20.180 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:20.177+0000 7f4843fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f484406e2e0 0x7f4844145be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:54756/0 (socket says 172.21.15.92:54756) 2024-09-11T00:15:20.180 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:20.177+0000 7f4843fff640 1 -- 172.21.15.92:0/2192985519 learned_addr learned my addr 172.21.15.92:0/2192985519 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-11T00:15:20.180 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:20.177+0000 7f48437fe640 1 --2- 172.21.15.92:0/2192985519 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f48440cf110 0x7f4844145340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:20.180 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:20.177+0000 7f4848a8c640 1 --2- 172.21.15.92:0/2192985519 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f484415e150 0x7f484414ec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:20.180 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:20.177+0000 7f4843fff640 1 -- 172.21.15.92:0/2192985519 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f48440cf110 msgr2=0x7f4844145340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:20.180 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:20.177+0000 7f4843fff640 1 --2- 172.21.15.92:0/2192985519 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f48440cf110 0x7f4844145340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:20.180 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:20.177+0000 7f4843fff640 1 -- 172.21.15.92:0/2192985519 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f484415e150 msgr2=0x7f484414ec70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:20.180 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:20.177+0000 7f4843fff640 1 --2- 172.21.15.92:0/2192985519 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f484415e150 0x7f484414ec70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:20.180 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:20.177+0000 7f4843fff640 1 -- 172.21.15.92:0/2192985519 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f484414c910 con 0x7f484406e2e0 2024-09-11T00:15:20.180 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:20.177+0000 7f4843fff640 1 --2- 172.21.15.92:0/2192985519 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f484406e2e0 0x7f4844145be0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f483400e710 tx=0x7f483400ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:15:20.181 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:20.177+0000 7f4840ff9640 1 -- 172.21.15.92:0/2192985519 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48340052d0 con 0x7f484406e2e0 2024-09-11T00:15:20.181 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:20.177+0000 7f4840ff9640 1 -- 172.21.15.92:0/2192985519 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f483400ee20 con 0x7f484406e2e0 2024-09-11T00:15:20.181 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:20.177+0000 7f484a4ef640 1 -- 172.21.15.92:0/2192985519 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f484414e4e0 con 0x7f484406e2e0 2024-09-11T00:15:20.181 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:20.177+0000 7f4840ff9640 1 -- 172.21.15.92:0/2192985519 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4834001ad0 con 0x7f484406e2e0 2024-09-11T00:15:20.181 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:20.177+0000 7f484a4ef640 1 -- 172.21.15.92:0/2192985519 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f484414c350 con 0x7f484406e2e0 2024-09-11T00:15:20.182 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:20.178+0000 7f484a4ef640 1 -- 172.21.15.92:0/2192985519 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f48440ccba0 con 0x7f484406e2e0 2024-09-11T00:15:20.182 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:20.179+0000 7f4840ff9640 1 -- 172.21.15.92:0/2192985519 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f483400f040 con 0x7f484406e2e0 2024-09-11T00:15:20.182 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:20.179+0000 7f4840ff9640 1 --2- 172.21.15.92:0/2192985519 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f4830077f70 0x7f483007a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:20.182 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:20.179+0000 7f4840ff9640 1 -- 172.21.15.92:0/2192985519 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7f483409be20 con 0x7f484406e2e0 2024-09-11T00:15:20.182 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:20.180+0000 7f48437fe640 1 --2- 172.21.15.92:0/2192985519 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f4830077f70 0x7f483007a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:20.182 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:20.180+0000 7f48437fe640 1 --2- 172.21.15.92:0/2192985519 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f4830077f70 0x7f483007a430 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f4838034000 tx=0x7f4838004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:15:20.185 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:20.183+0000 7f4840ff9640 1 -- 172.21.15.92:0/2192985519 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f4834016020 con 0x7f484406e2e0 2024-09-11T00:15:20.393 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:20.391+0000 7f484a4ef640 1 -- 172.21.15.92:0/2192985519 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f48440b1b40 con 0x7f484406e2e0 2024-09-11T00:15:20.394 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:20.392+0000 7f4840ff9640 1 -- 172.21.15.92:0/2192985519 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) ==== 94+0+5223 (secure 0 0 0) 0x7f4844073ef0 con 0x7f484406e2e0 2024-09-11T00:15:20.394 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:15:20.394 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":15,"btime":"2024-09-11T00:15:13:987293+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4628,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6836/315952476","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6834","nonce":315952476},{"type":"v1","addr":"172.21.15.145:6836","nonce":315952476}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4631,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6837/549929116","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6835","nonce":549929116},{"type":"v1","addr":"172.21.15.145:6837","nonce":549929116}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4998,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6834/2553881541","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":2553881541},{"type":"v1","addr":"172.21.15.92:6834","nonce":2553881541}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T00:15:11.325320+0000","modified":"2024-09-11T00:15:13.320995+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5001},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5001":{"gid":5001,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.92:6835/2081230425","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6833","nonce":2081230425},{"type":"v1","addr":"172.21.15.92:6835","nonce":2081230425}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5001,"qdb_cluster":[5001]},"id":2}]} 2024-09-11T00:15:20.395 INFO:teuthology.orchestra.run.smithi092.stderr:dumped fsmap epoch 15 2024-09-11T00:15:20.396 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:20.394+0000 7f484a4ef640 1 -- 172.21.15.92:0/2192985519 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f4830077f70 msgr2=0x7f483007a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:20.396 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:20.394+0000 7f484a4ef640 1 --2- 172.21.15.92:0/2192985519 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f4830077f70 0x7f483007a430 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f4838034000 tx=0x7f4838004730 comp rx=0 tx=0).stop 2024-09-11T00:15:20.396 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:20.394+0000 7f484a4ef640 1 -- 172.21.15.92:0/2192985519 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f484406e2e0 msgr2=0x7f4844145be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:20.396 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:20.394+0000 7f484a4ef640 1 --2- 172.21.15.92:0/2192985519 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f484406e2e0 0x7f4844145be0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f483400e710 tx=0x7f483400ebd0 comp rx=0 tx=0).stop 2024-09-11T00:15:20.396 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:20.394+0000 7f484a4ef640 1 -- 172.21.15.92:0/2192985519 shutdown_connections 2024-09-11T00:15:20.396 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:20.394+0000 7f484a4ef640 1 --2- 172.21.15.92:0/2192985519 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f4830077f70 0x7f483007a430 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:20.396 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:20.394+0000 7f484a4ef640 1 --2- 172.21.15.92:0/2192985519 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f484415e150 0x7f484414ec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:20.396 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:20.394+0000 7f484a4ef640 1 --2- 172.21.15.92:0/2192985519 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f48440cf110 0x7f4844145340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:20.396 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:20.394+0000 7f484a4ef640 1 --2- 172.21.15.92:0/2192985519 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f484406e2e0 0x7f4844145be0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:20.396 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:20.394+0000 7f484a4ef640 1 -- 172.21.15.92:0/2192985519 >> 172.21.15.92:0/2192985519 conn(0x7f48440b1760 msgr2=0x7f484406e6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:15:20.397 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:20.394+0000 7f484a4ef640 1 -- 172.21.15.92:0/2192985519 shutdown_connections 2024-09-11T00:15:20.397 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:20.394+0000 7f484a4ef640 1 -- 172.21.15.92:0/2192985519 wait complete. 2024-09-11T00:15:20.810 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 15, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-11T00:15:11.325320+0000', 'modified': '2024-09-11T00:15:13.320995+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5001}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5001': {'gid': 5001, 'name': 'a', 'rank': 0, 'incarnation': 13, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.92:6835/2081230425', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.92:6833', 'nonce': 2081230425}, {'type': 'v1', 'addr': '172.21.15.92:6835', 'nonce': 2081230425}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [6], 'metadata_pool': 5, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 5001, 'qdb_cluster': [5001]} 2024-09-11T00:15:20.810 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-11T00:15:20.810 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-09-11T00:15:20.915 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:20.913+0000 7fac9b332640 1 -- 172.21.15.92:0/3512449294 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fac940d2a20 msgr2=0x7fac940cea40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:20.916 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:20.913+0000 7fac9b332640 1 --2- 172.21.15.92:0/3512449294 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fac940d2a20 0x7fac940cea40 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fac8c009830 tx=0x7fac8c02a510 comp rx=0 tx=0).stop 2024-09-11T00:15:20.916 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:20.913+0000 7fac9b332640 1 -- 172.21.15.92:0/3512449294 shutdown_connections 2024-09-11T00:15:20.916 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:20.913+0000 7fac9b332640 1 --2- 172.21.15.92:0/3512449294 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fac940d2a20 0x7fac940cea40 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:20.916 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:20.913+0000 7fac9b332640 1 --2- 172.21.15.92:0/3512449294 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fac940d4af0 0x7fac940d24e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:20.916 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:20.913+0000 7fac9b332640 1 -- 172.21.15.92:0/3512449294 >> 172.21.15.92:0/3512449294 conn(0x7fac940d3f70 msgr2=0x7fac940d4350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:15:20.916 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:20.914+0000 7fac9b332640 1 -- 172.21.15.92:0/3512449294 shutdown_connections 2024-09-11T00:15:20.916 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:20.914+0000 7fac9b332640 1 -- 172.21.15.92:0/3512449294 wait complete. 2024-09-11T00:15:20.918 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:20.915+0000 7fac9b332640 1 Processor -- start 2024-09-11T00:15:20.918 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:20.915+0000 7fac9b332640 1 -- start start 2024-09-11T00:15:20.918 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:20.915+0000 7fac9b332640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fac940d2a20 0x7fac941f4b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:20.918 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:20.915+0000 7fac9b332640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fac940d4af0 0x7fac940c8370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:20.918 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:20.915+0000 7fac9b332640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fac9415e060 0x7fac940b8ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:20.919 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:20.915+0000 7fac9b332640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fac940cf100 con 0x7fac9415e060 2024-09-11T00:15:20.919 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:20.915+0000 7fac9b332640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fac940cef80 con 0x7fac940d2a20 2024-09-11T00:15:20.919 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:20.915+0000 7fac9b332640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7fac940cf280 con 0x7fac940d4af0 2024-09-11T00:15:20.919 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:20.916+0000 7fac998cf640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fac9415e060 0x7fac940b8ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:20.919 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:20.916+0000 7fac998cf640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fac9415e060 0x7fac940b8ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:54764/0 (socket says 172.21.15.92:54764) 2024-09-11T00:15:20.919 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:20.916+0000 7fac998cf640 1 -- 172.21.15.92:0/900489555 learned_addr learned my addr 172.21.15.92:0/900489555 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-11T00:15:20.919 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:20.916+0000 7fac990ce640 1 --2- 172.21.15.92:0/900489555 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fac940d2a20 0x7fac941f4b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:20.919 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:20.916+0000 7fac988cd640 1 --2- 172.21.15.92:0/900489555 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fac940d4af0 0x7fac940c8370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:20.919 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:20.916+0000 7fac998cf640 1 -- 172.21.15.92:0/900489555 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fac940d4af0 msgr2=0x7fac940c8370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:20.919 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:20.916+0000 7fac998cf640 1 --2- 172.21.15.92:0/900489555 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fac940d4af0 0x7fac940c8370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:20.919 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:20.916+0000 7fac998cf640 1 -- 172.21.15.92:0/900489555 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fac940d2a20 msgr2=0x7fac941f4b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:20.919 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:20.916+0000 7fac998cf640 1 --2- 172.21.15.92:0/900489555 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fac940d2a20 0x7fac941f4b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:20.919 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:20.916+0000 7fac998cf640 1 -- 172.21.15.92:0/900489555 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac941f5550 con 0x7fac9415e060 2024-09-11T00:15:20.920 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:20.916+0000 7fac990ce640 1 --2- 172.21.15.92:0/900489555 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fac940d2a20 0x7fac941f4b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:15:20.920 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:20.916+0000 7fac998cf640 1 --2- 172.21.15.92:0/900489555 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fac9415e060 0x7fac940b8ac0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fac8c02ab00 tx=0x7fac8c032c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:15:20.920 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:20.916+0000 7fac91ffb640 1 -- 172.21.15.92:0/900489555 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac8c040070 con 0x7fac9415e060 2024-09-11T00:15:20.920 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:20.916+0000 7fac91ffb640 1 -- 172.21.15.92:0/900489555 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fac8c0038e0 con 0x7fac9415e060 2024-09-11T00:15:20.920 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:20.916+0000 7fac9b332640 1 -- 172.21.15.92:0/900489555 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac941f5830 con 0x7fac9415e060 2024-09-11T00:15:20.920 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:20.916+0000 7fac91ffb640 1 -- 172.21.15.92:0/900489555 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac8c005c90 con 0x7fac9415e060 2024-09-11T00:15:20.920 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:20.917+0000 7fac9b332640 1 -- 172.21.15.92:0/900489555 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac940c7e50 con 0x7fac9415e060 2024-09-11T00:15:20.921 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:20.918+0000 7fac91ffb640 1 -- 172.21.15.92:0/900489555 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fac8c003d10 con 0x7fac9415e060 2024-09-11T00:15:20.921 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:20.919+0000 7fac91ffb640 1 --2- 172.21.15.92:0/900489555 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7fac80077f70 0x7fac8007a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:20.921 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:20.919+0000 7fac91ffb640 1 -- 172.21.15.92:0/900489555 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7fac8c0bb560 con 0x7fac9415e060 2024-09-11T00:15:20.921 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:20.919+0000 7fac990ce640 1 --2- 172.21.15.92:0/900489555 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7fac80077f70 0x7fac8007a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:20.921 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:20.919+0000 7fac990ce640 1 --2- 172.21.15.92:0/900489555 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7fac80077f70 0x7fac8007a430 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fac8400d4f0 tx=0x7fac840019f0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:15:20.921 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:20.919+0000 7fac9e1dc740 1 Processor -- start 2024-09-11T00:15:20.921 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:20.920+0000 7fac9e1dc740 1 -- start start 2024-09-11T00:15:20.928 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:20.920+0000 7fac9e1dc740 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x556e058dc1b0 0x556e058b3b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:20.928 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:20.920+0000 7fac9e1dc740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556e058fbdf0 0x556e058fc1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:20.928 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:20.920+0000 7fac9e1dc740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x556e058b15f0 0x556e058b1a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:20.928 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:20.920+0000 7fac9e1dc740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x556e05828820 con 0x556e058fbdf0 2024-09-11T00:15:20.929 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:20.920+0000 7fac9e1dc740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x556e05817c50 con 0x556e058b15f0 2024-09-11T00:15:20.929 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:20.920+0000 7fac9e1dc740 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x556e0581ba60 con 0x556e058dc1b0 2024-09-11T00:15:20.929 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:20.920+0000 7fac988cd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556e058fbdf0 0x556e058fc1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:20.929 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:20.920+0000 7fac988cd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556e058fbdf0 0x556e058fc1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:54776/0 (socket says 172.21.15.92:54776) 2024-09-11T00:15:20.929 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:20.920+0000 7fac988cd640 1 -- 172.21.15.92:0/3623866847 learned_addr learned my addr 172.21.15.92:0/3623866847 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-11T00:15:20.929 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:20.920+0000 7fac990ce640 1 --2- 172.21.15.92:0/3623866847 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x556e058dc1b0 0x556e058b3b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:20.929 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:20.920+0000 7fac998cf640 1 --2- 172.21.15.92:0/3623866847 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x556e058b15f0 0x556e058b1a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:20.929 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:20.921+0000 7fac988cd640 1 -- 172.21.15.92:0/3623866847 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x556e058dc1b0 msgr2=0x556e058b3b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:15:20.929 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:20.921+0000 7fac988cd640 1 --2- 172.21.15.92:0/3623866847 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x556e058dc1b0 0x556e058b3b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:20.929 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:20.921+0000 7fac988cd640 1 -- 172.21.15.92:0/3623866847 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x556e058b15f0 msgr2=0x556e058b1a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:15:20.929 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:20.921+0000 7fac988cd640 1 --2- 172.21.15.92:0/3623866847 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x556e058b15f0 0x556e058b1a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:20.929 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:20.921+0000 7fac988cd640 1 -- 172.21.15.92:0/3623866847 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556e05579850 con 0x556e058fbdf0 2024-09-11T00:15:20.929 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:20.921+0000 7fac988cd640 1 --2- 172.21.15.92:0/3623866847 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556e058fbdf0 0x556e058fc1f0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fac88009c60 tx=0x7fac88011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e968e51825a91bd server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:15:20.929 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:20.921+0000 7fac7affd640 1 -- 172.21.15.92:0/3623866847 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac88004230 con 0x556e058fbdf0 2024-09-11T00:15:20.930 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:20.921+0000 7fac7affd640 1 -- 172.21.15.92:0/3623866847 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fac880043d0 con 0x556e058fbdf0 2024-09-11T00:15:20.930 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:20.921+0000 7fac7affd640 1 -- 172.21.15.92:0/3623866847 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac88005280 con 0x556e058fbdf0 2024-09-11T00:15:20.930 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:20.922+0000 7fac9e1dc740 1 -- 172.21.15.92:0/3623866847 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556e058fbdf0 msgr2=0x556e058fc1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:20.930 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:20.922+0000 7fac9e1dc740 1 --2- 172.21.15.92:0/3623866847 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556e058fbdf0 0x556e058fc1f0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fac88009c60 tx=0x7fac88011810 comp rx=0 tx=0).stop 2024-09-11T00:15:20.930 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:20.922+0000 7fac9e1dc740 1 -- 172.21.15.92:0/3623866847 shutdown_connections 2024-09-11T00:15:20.930 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:20.922+0000 7fac9e1dc740 1 --2- 172.21.15.92:0/3623866847 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x556e058b15f0 0x556e058b1a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:20.930 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:20.922+0000 7fac9e1dc740 1 --2- 172.21.15.92:0/3623866847 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556e058fbdf0 0x556e058fc1f0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:20.930 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:20.922+0000 7fac9e1dc740 1 --2- 172.21.15.92:0/3623866847 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x556e058dc1b0 0x556e058b3b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:20.930 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:20.922+0000 7fac9e1dc740 1 -- 172.21.15.92:0/3623866847 >> 172.21.15.92:0/3623866847 conn(0x556e058b26a0 msgr2=0x556e058b60c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:15:20.930 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:20.922+0000 7fac9e1dc740 1 -- 172.21.15.92:0/3623866847 shutdown_connections 2024-09-11T00:15:20.930 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:20.922+0000 7fac9e1dc740 1 -- 172.21.15.92:0/3623866847 wait complete. 2024-09-11T00:15:20.930 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:20.922+0000 7fac9e1dc740 1 -- start start 2024-09-11T00:15:20.931 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:20.922+0000 7fac9e1dc740 1 Processor -- start 2024-09-11T00:15:20.931 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:20.923+0000 7fac9e1dc740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556e058dc1b0 0x556e0590b290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:20.931 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:20.923+0000 7fac9e1dc740 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x556e058fbdf0 0x556e058f9f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:20.931 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:20.923+0000 7fac9e1dc740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x556e058f4530 0x556e058fa4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:20.931 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:20.923+0000 7fac9e1dc740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x556e05588620 con 0x556e058dc1b0 2024-09-11T00:15:20.931 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:20.923+0000 7fac9e1dc740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x556e057bd5f0 con 0x556e058f4530 2024-09-11T00:15:20.931 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:20.923+0000 7fac9e1dc740 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x556e058b0b30 con 0x556e058fbdf0 2024-09-11T00:15:20.931 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:20.923+0000 7fac9e1dc740 10 client.0 _ll_register_callbacks cb 0x556e057c10a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:15:20.931 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:20.923+0000 7fac990ce640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556e058dc1b0 0x556e0590b290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:20.931 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:20.923+0000 7fac990ce640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556e058dc1b0 0x556e0590b290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:54778/0 (socket says 172.21.15.92:54778) 2024-09-11T00:15:20.931 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:20.923+0000 7fac990ce640 1 -- 172.21.15.92:0/2593463681 learned_addr learned my addr 172.21.15.92:0/2593463681 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-11T00:15:20.931 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:20.923+0000 7fac998cf640 1 --2- 172.21.15.92:0/2593463681 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x556e058f4530 0x556e058fa4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:20.932 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:20.923+0000 7fac988cd640 1 --2- 172.21.15.92:0/2593463681 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x556e058fbdf0 0x556e058f9f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:20.932 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:20.924+0000 7fac990ce640 1 -- 172.21.15.92:0/2593463681 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x556e058fbdf0 msgr2=0x556e058f9f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:15:20.932 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:20.924+0000 7fac990ce640 1 --2- 172.21.15.92:0/2593463681 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x556e058fbdf0 0x556e058f9f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:20.932 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:20.924+0000 7fac990ce640 1 -- 172.21.15.92:0/2593463681 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x556e058f4530 msgr2=0x556e058fa4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:15:20.932 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:20.924+0000 7fac990ce640 1 --2- 172.21.15.92:0/2593463681 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x556e058f4530 0x556e058fa4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:20.932 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:20.924+0000 7fac990ce640 1 -- 172.21.15.92:0/2593463681 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556e055f06b0 con 0x556e058dc1b0 2024-09-11T00:15:20.932 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:20.924+0000 7fac990ce640 1 --2- 172.21.15.92:0/2593463681 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556e058dc1b0 0x556e0590b290 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fac840154e0 tx=0x7fac84001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7762c1130b5a4b32 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:15:20.932 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:20.924+0000 7fac73fff640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-11T00:15:20.933 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:20.924+0000 7fac73fff640 1 -- 172.21.15.92:0/2593463681 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac84025070 con 0x556e058dc1b0 2024-09-11T00:15:20.933 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:20.924+0000 7fac73fff640 1 -- 172.21.15.92:0/2593463681 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7fac84021600 con 0x556e058dc1b0 2024-09-11T00:15:20.933 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:20.924+0000 7fac9e1dc740 1 -- 172.21.15.92:0/2593463681 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fac880043d0 con 0x556e058dc1b0 2024-09-11T00:15:20.933 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:20.924+0000 7fac73fff640 1 -- 172.21.15.92:0/2593463681 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) ==== 24+0+0 (secure 0 0 0) 0x7fac84030050 con 0x556e058dc1b0 2024-09-11T00:15:20.933 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:20.924+0000 7fac9e1dc740 10 client.5187 fetch_fsmap learned FSMap version 15 2024-09-11T00:15:20.933 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:20.924+0000 7fac9e1dc740 1 -- 172.21.15.92:0/2593463681 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) -- 0x556e058f58c0 con 0x556e058dc1b0 2024-09-11T00:15:20.933 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:20.924+0000 7fac73fff640 1 -- 172.21.15.92:0/2593463681 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fac880043d0 con 0x556e058dc1b0 2024-09-11T00:15:20.933 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:20.924+0000 7fac73fff640 1 -- 172.21.15.92:0/2593463681 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 15) ==== 3502+0+0 (secure 0 0 0) 0x7fac84033020 con 0x556e058dc1b0 2024-09-11T00:15:20.933 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:20.924+0000 7fac9e1dc740 10 client.5187 fetch_fsmap finished waiting for FSMap version 15 2024-09-11T00:15:20.934 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:20.924+0000 7fac9e1dc740 10 client.5187 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-11T00:15:20.934 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:20.924+0000 7fac9e1dc740 20 client.5187 populate_metadata read hostname 'smithi092' 2024-09-11T00:15:20.934 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:20.924+0000 7fac9e1dc740 1 --2- 172.21.15.92:0/2593463681 >> [v2:172.21.15.92:6833/2081230425,v1:172.21.15.92:6835/2081230425] conn(0x556e058f60c0 0x556e058c5ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:20.934 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:20.924+0000 7fac9e1dc740 4 client.5187 mds_command: new command op to 5001 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T00:15:20.934 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:20.924+0000 7fac9e1dc740 1 -- 172.21.15.92:0/2593463681 --> [v2:172.21.15.92:6833/2081230425,v1:172.21.15.92:6835/2081230425] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556e0582a770 con 0x556e058f60c0 2024-09-11T00:15:20.934 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:20.925+0000 7fac988cd640 1 --2- 172.21.15.92:0/2593463681 >> [v2:172.21.15.92:6833/2081230425,v1:172.21.15.92:6835/2081230425] conn(0x556e058f60c0 0x556e058c5ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:20.934 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:20.925+0000 7fac73fff640 10 client.5187 ms_handle_connect on v2:172.21.15.92:6833/2081230425 2024-09-11T00:15:20.934 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:20.925+0000 7fac988cd640 1 --2- 172.21.15.92:0/2593463681 >> [v2:172.21.15.92:6833/2081230425,v1:172.21.15.92:6835/2081230425] conn(0x556e058f60c0 0x556e058c5ce0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=36dab087438d193c server_cookie=852d58c23389423a in_seq=0 out_seq=0 2024-09-11T00:15:20.934 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:20.925+0000 7fac73fff640 1 -- 172.21.15.92:0/2593463681 <== mds.0 v2:172.21.15.92:6833/2081230425 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x556e0582a770 con 0x556e058f60c0 2024-09-11T00:15:20.935 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:20.925+0000 7fac73fff640 10 client.5187 handle_command_reply: tid=0 2024-09-11T00:15:20.935 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:20.925+0000 7fac9e1dc740 1 client.5187 shutdown 2024-09-11T00:15:20.935 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:20.926+0000 7fac9e1dc740 1 -- 172.21.15.92:0/2593463681 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556e058dc1b0 msgr2=0x556e0590b290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:20.935 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:20.926+0000 7fac9e1dc740 1 --2- 172.21.15.92:0/2593463681 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556e058dc1b0 0x556e0590b290 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fac840154e0 tx=0x7fac84001250 comp rx=0 tx=0).stop 2024-09-11T00:15:20.935 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:20.926+0000 7fac9e1dc740 1 -- 172.21.15.92:0/2593463681 shutdown_connections 2024-09-11T00:15:20.935 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:20.926+0000 7fac9e1dc740 1 --2- 172.21.15.92:0/2593463681 >> [v2:172.21.15.92:6833/2081230425,v1:172.21.15.92:6835/2081230425] conn(0x556e058f60c0 0x556e058c5ce0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:20.935 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:20.926+0000 7fac9e1dc740 1 --2- 172.21.15.92:0/2593463681 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x556e058f4530 0x556e058fa4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:20.935 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:20.926+0000 7fac73fff640 0 client.5187 ms_handle_reset on v2:172.21.15.92:6833/2081230425 2024-09-11T00:15:20.935 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:20.926+0000 7fac9e1dc740 1 --2- 172.21.15.92:0/2593463681 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x556e058fbdf0 0x556e058f9f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:20.935 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:20.926+0000 7fac9e1dc740 1 --2- 172.21.15.92:0/2593463681 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556e058dc1b0 0x556e0590b290 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:20.935 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:20.926+0000 7fac9e1dc740 1 -- 172.21.15.92:0/2593463681 >> 172.21.15.92:0/2593463681 conn(0x556e058b15f0 msgr2=0x556e058afc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:15:20.935 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:20.926+0000 7fac9e1dc740 1 -- 172.21.15.92:0/2593463681 shutdown_connections 2024-09-11T00:15:20.935 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:20.926+0000 7fac9e1dc740 1 -- 172.21.15.92:0/2593463681 wait complete. 2024-09-11T00:15:20.935 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:20.926+0000 7fac9e1dc740 20 client.5187 trim_cache size 0 max 16384 2024-09-11T00:15:20.945 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:20.944+0000 7fac9e1dc740 1 Processor -- start 2024-09-11T00:15:20.946 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:20.944+0000 7fac9e1dc740 1 -- start start 2024-09-11T00:15:20.948 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:20.944+0000 7fac9e1dc740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556e058b15f0 0x556e058af670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:20.948 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:20.944+0000 7fac9e1dc740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x556e058dc1b0 0x556e058afbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:20.948 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:20.945+0000 7fac9e1dc740 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x556e058f4530 0x556e058db280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:20.948 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:20.945+0000 7fac9e1dc740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fac94200800 con 0x556e058b15f0 2024-09-11T00:15:20.949 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:20.945+0000 7fac9e1dc740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fac941f8f20 con 0x556e058dc1b0 2024-09-11T00:15:20.949 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:20.945+0000 7fac9e1dc740 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7fac940c99f0 con 0x556e058f4530 2024-09-11T00:15:20.949 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:20.945+0000 7fac990ce640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556e058b15f0 0x556e058af670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:20.949 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:20.945+0000 7fac990ce640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556e058b15f0 0x556e058af670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:54782/0 (socket says 172.21.15.92:54782) 2024-09-11T00:15:20.949 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:20.945+0000 7fac990ce640 1 -- 172.21.15.92:0/1657666748 learned_addr learned my addr 172.21.15.92:0/1657666748 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-11T00:15:20.949 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:20.945+0000 7fac990ce640 1 -- 172.21.15.92:0/1657666748 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x556e058f4530 msgr2=0x556e058db280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:15:20.949 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:20.945+0000 7fac990ce640 1 --2- 172.21.15.92:0/1657666748 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x556e058f4530 0x556e058db280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:20.949 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:20.945+0000 7fac990ce640 1 -- 172.21.15.92:0/1657666748 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x556e058dc1b0 msgr2=0x556e058afbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:15:20.949 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:20.945+0000 7fac990ce640 1 --2- 172.21.15.92:0/1657666748 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x556e058dc1b0 0x556e058afbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:20.950 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:20.945+0000 7fac990ce640 1 -- 172.21.15.92:0/1657666748 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556e058b0510 con 0x556e058b15f0 2024-09-11T00:15:20.950 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:20.945+0000 7fac990ce640 1 --2- 172.21.15.92:0/1657666748 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556e058b15f0 0x556e058af670 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fac84001340 tx=0x7fac84001370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=983826b3bc0bb3b7 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:15:20.950 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:20.945+0000 7fac7a7fc640 1 -- 172.21.15.92:0/1657666748 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac84025070 con 0x556e058b15f0 2024-09-11T00:15:20.950 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:20.945+0000 7fac7a7fc640 1 -- 172.21.15.92:0/1657666748 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fac8401c040 con 0x556e058b15f0 2024-09-11T00:15:20.950 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:20.945+0000 7fac7a7fc640 1 -- 172.21.15.92:0/1657666748 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac8401b040 con 0x556e058b15f0 2024-09-11T00:15:20.950 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:20.946+0000 7fac9e1dc740 1 -- 172.21.15.92:0/1657666748 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556e058b15f0 msgr2=0x556e058af670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:20.950 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:20.946+0000 7fac9e1dc740 1 --2- 172.21.15.92:0/1657666748 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556e058b15f0 0x556e058af670 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fac84001340 tx=0x7fac84001370 comp rx=0 tx=0).stop 2024-09-11T00:15:20.950 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:20.946+0000 7fac9e1dc740 1 -- 172.21.15.92:0/1657666748 shutdown_connections 2024-09-11T00:15:20.952 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:20.946+0000 7fac9e1dc740 1 --2- 172.21.15.92:0/1657666748 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x556e058f4530 0x556e058db280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:20.952 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:20.946+0000 7fac9e1dc740 1 --2- 172.21.15.92:0/1657666748 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x556e058dc1b0 0x556e058afbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:20.953 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:20.946+0000 7fac9e1dc740 1 --2- 172.21.15.92:0/1657666748 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556e058b15f0 0x556e058af670 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:20.953 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:20.946+0000 7fac9e1dc740 1 -- 172.21.15.92:0/1657666748 >> 172.21.15.92:0/1657666748 conn(0x556e058dd1a0 msgr2=0x556e058b67e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:15:20.953 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:20.946+0000 7fac9e1dc740 1 -- 172.21.15.92:0/1657666748 shutdown_connections 2024-09-11T00:15:20.953 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:20.946+0000 7fac9e1dc740 1 -- 172.21.15.92:0/1657666748 wait complete. 2024-09-11T00:15:20.953 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:20.946+0000 7fac9e1dc740 1 -- start start 2024-09-11T00:15:20.953 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:20.946+0000 7fac9e1dc740 1 Processor -- start 2024-09-11T00:15:20.957 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:20.947+0000 7fac9e1dc740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x556e058b15f0 0x556e058da270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:20.957 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:20.947+0000 7fac9e1dc740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556e058dc1b0 0x556e05979300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:20.957 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:20.947+0000 7fac9e1dc740 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x556e058f4530 0x556e0591db00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:20.957 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:20.947+0000 7fac9e1dc740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x556e0590c580 con 0x556e058dc1b0 2024-09-11T00:15:20.957 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:20.947+0000 7fac9e1dc740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x556e058f5bf0 con 0x556e058b15f0 2024-09-11T00:15:20.957 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:20.947+0000 7fac9e1dc740 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x556e058f64e0 con 0x556e058f4530 2024-09-11T00:15:20.957 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:20.947+0000 7fac9e1dc740 10 client.0 _ll_register_callbacks cb 0x7fac84014450 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:15:20.957 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:20.947+0000 7fac988cd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556e058dc1b0 0x556e05979300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:20.957 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:20.947+0000 7fac988cd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556e058dc1b0 0x556e05979300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:54792/0 (socket says 172.21.15.92:54792) 2024-09-11T00:15:20.957 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:20.947+0000 7fac988cd640 1 -- 172.21.15.92:0/1378390253 learned_addr learned my addr 172.21.15.92:0/1378390253 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-11T00:15:20.957 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:20.947+0000 7fac990ce640 1 --2- 172.21.15.92:0/1378390253 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x556e058b15f0 0x556e058da270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:20.957 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:20.948+0000 7fac998cf640 1 --2- 172.21.15.92:0/1378390253 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x556e058f4530 0x556e0591db00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:20.957 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:20.948+0000 7fac988cd640 1 -- 172.21.15.92:0/1378390253 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x556e058f4530 msgr2=0x556e0591db00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:15:20.958 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:20.948+0000 7fac988cd640 1 --2- 172.21.15.92:0/1378390253 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x556e058f4530 0x556e0591db00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:20.958 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:20.948+0000 7fac988cd640 1 -- 172.21.15.92:0/1378390253 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x556e058b15f0 msgr2=0x556e058da270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:15:20.958 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:20.948+0000 7fac988cd640 1 --2- 172.21.15.92:0/1378390253 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x556e058b15f0 0x556e058da270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:20.958 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:20.948+0000 7fac988cd640 1 -- 172.21.15.92:0/1378390253 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556e058fa830 con 0x556e058dc1b0 2024-09-11T00:15:20.958 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:20.948+0000 7fac998cf640 1 --2- 172.21.15.92:0/1378390253 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x556e058f4530 0x556e0591db00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:15:20.958 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:20.948+0000 7fac988cd640 1 --2- 172.21.15.92:0/1378390253 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556e058dc1b0 0x556e05979300 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fac88000c00 tx=0x7fac88005c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7263ee4133cfdf5e server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:15:20.958 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:20.948+0000 7fac73fff640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-11T00:15:20.958 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:20.948+0000 7fac73fff640 1 -- 172.21.15.92:0/1378390253 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac88004030 con 0x556e058dc1b0 2024-09-11T00:15:20.958 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:20.948+0000 7fac73fff640 1 -- 172.21.15.92:0/1378390253 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7fac880041d0 con 0x556e058dc1b0 2024-09-11T00:15:20.958 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:20.948+0000 7fac9e1dc740 1 -- 172.21.15.92:0/1378390253 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fac8401c040 con 0x556e058dc1b0 2024-09-11T00:15:20.958 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:20.948+0000 7fac73fff640 1 -- 172.21.15.92:0/1378390253 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) ==== 24+0+0 (secure 0 0 0) 0x7fac880043d0 con 0x556e058dc1b0 2024-09-11T00:15:20.958 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:20.948+0000 7fac9e1dc740 10 client.5193 fetch_fsmap learned FSMap version 15 2024-09-11T00:15:20.958 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:20.948+0000 7fac9e1dc740 1 -- 172.21.15.92:0/1378390253 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) -- 0x556e058b3bc0 con 0x556e058dc1b0 2024-09-11T00:15:20.958 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:20.948+0000 7fac73fff640 1 -- 172.21.15.92:0/1378390253 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fac8401c040 con 0x556e058dc1b0 2024-09-11T00:15:20.959 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:20.948+0000 7fac73fff640 1 -- 172.21.15.92:0/1378390253 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 15) ==== 3502+0+0 (secure 0 0 0) 0x7fac88018070 con 0x556e058dc1b0 2024-09-11T00:15:20.959 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:20.948+0000 7fac9e1dc740 10 client.5193 fetch_fsmap finished waiting for FSMap version 15 2024-09-11T00:15:20.959 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:20.948+0000 7fac9e1dc740 10 client.5193 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-11T00:15:20.959 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:20.948+0000 7fac9e1dc740 20 client.5193 populate_metadata read hostname 'smithi092' 2024-09-11T00:15:20.959 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:20.948+0000 7fac9e1dc740 1 --2- 172.21.15.92:0/1378390253 >> [v2:172.21.15.92:6833/2081230425,v1:172.21.15.92:6835/2081230425] conn(0x556e058fbdf0 0x556e058b4510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:20.959 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:20.948+0000 7fac9e1dc740 4 client.5193 mds_command: new command op to 5001 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-11T00:15:20.959 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:20.948+0000 7fac9e1dc740 1 -- 172.21.15.92:0/1378390253 --> [v2:172.21.15.92:6833/2081230425,v1:172.21.15.92:6835/2081230425] -- command(tid 0: {"prefix": "status"}) -- 0x556e05826220 con 0x556e058fbdf0 2024-09-11T00:15:20.959 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:20.948+0000 7fac990ce640 1 --2- 172.21.15.92:0/1378390253 >> [v2:172.21.15.92:6833/2081230425,v1:172.21.15.92:6835/2081230425] conn(0x556e058fbdf0 0x556e058b4510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:20.959 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:20.949+0000 7fac73fff640 10 client.5193 ms_handle_connect on v2:172.21.15.92:6833/2081230425 2024-09-11T00:15:20.959 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:20.949+0000 7fac990ce640 1 --2- 172.21.15.92:0/1378390253 >> [v2:172.21.15.92:6833/2081230425,v1:172.21.15.92:6835/2081230425] conn(0x556e058fbdf0 0x556e058b4510 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f1cd26635ff5cd6d server_cookie=4e48ea9df12402a in_seq=0 out_seq=0 2024-09-11T00:15:20.959 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:20.949+0000 7fac73fff640 1 -- 172.21.15.92:0/1378390253 <== mds.0 v2:172.21.15.92:6833/2081230425 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x556e05826220 con 0x556e058fbdf0 2024-09-11T00:15:20.959 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:20.949+0000 7fac73fff640 10 client.5193 handle_command_reply: tid=0 2024-09-11T00:15:20.959 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:20.949+0000 7fac9e1dc740 1 client.5193 shutdown 2024-09-11T00:15:20.959 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:20.949+0000 7fac9e1dc740 1 -- 172.21.15.92:0/1378390253 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556e058dc1b0 msgr2=0x556e05979300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:20.959 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:20.949+0000 7fac9e1dc740 1 --2- 172.21.15.92:0/1378390253 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556e058dc1b0 0x556e05979300 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fac88000c00 tx=0x7fac88005c90 comp rx=0 tx=0).stop 2024-09-11T00:15:20.959 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:20.949+0000 7fac9e1dc740 1 -- 172.21.15.92:0/1378390253 shutdown_connections 2024-09-11T00:15:20.960 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:20.949+0000 7fac9e1dc740 1 --2- 172.21.15.92:0/1378390253 >> [v2:172.21.15.92:6833/2081230425,v1:172.21.15.92:6835/2081230425] conn(0x556e058fbdf0 0x556e058b4510 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:20.960 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:20.949+0000 7fac9e1dc740 1 --2- 172.21.15.92:0/1378390253 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x556e058f4530 0x556e0591db00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:20.960 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:20.949+0000 7fac73fff640 0 client.5193 ms_handle_reset on v2:172.21.15.92:6833/2081230425 2024-09-11T00:15:20.960 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:20.949+0000 7fac9e1dc740 1 --2- 172.21.15.92:0/1378390253 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556e058dc1b0 0x556e05979300 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:20.960 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:20.949+0000 7fac9e1dc740 1 --2- 172.21.15.92:0/1378390253 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x556e058b15f0 0x556e058da270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:20.960 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:20.949+0000 7fac9e1dc740 1 -- 172.21.15.92:0/1378390253 >> 172.21.15.92:0/1378390253 conn(0x556e058dd1a0 msgr2=0x556e058af610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:15:20.960 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:20.949+0000 7fac9e1dc740 1 -- 172.21.15.92:0/1378390253 shutdown_connections 2024-09-11T00:15:20.960 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:20.949+0000 7fac9e1dc740 1 -- 172.21.15.92:0/1378390253 wait complete. 2024-09-11T00:15:20.960 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:20.949+0000 7fac9e1dc740 20 client.5193 trim_cache size 0 max 16384 2024-09-11T00:15:20.960 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2024-09-11T00:15:20.960 INFO:teuthology.orchestra.run.smithi092.stdout: "cluster_fsid": "47039cb3-5d2a-46bf-9066-8055b5dfc583", 2024-09-11T00:15:20.961 INFO:teuthology.orchestra.run.smithi092.stdout: "whoami": 0, 2024-09-11T00:15:20.961 INFO:teuthology.orchestra.run.smithi092.stdout: "id": 5001, 2024-09-11T00:15:20.961 INFO:teuthology.orchestra.run.smithi092.stdout: "want_state": "up:active", 2024-09-11T00:15:20.961 INFO:teuthology.orchestra.run.smithi092.stdout: "state": "up:active", 2024-09-11T00:15:20.961 INFO:teuthology.orchestra.run.smithi092.stdout: "fs_name": "cephfs", 2024-09-11T00:15:20.961 INFO:teuthology.orchestra.run.smithi092.stdout: "rank_uptime": 8.9808497430000003, 2024-09-11T00:15:20.961 INFO:teuthology.orchestra.run.smithi092.stdout: "mdsmap_epoch": 15, 2024-09-11T00:15:20.961 INFO:teuthology.orchestra.run.smithi092.stdout: "osdmap_epoch": 39, 2024-09-11T00:15:20.961 INFO:teuthology.orchestra.run.smithi092.stdout: "osdmap_epoch_barrier": 39, 2024-09-11T00:15:20.962 INFO:teuthology.orchestra.run.smithi092.stdout: "uptime": 15.864851075000001 2024-09-11T00:15:20.962 INFO:teuthology.orchestra.run.smithi092.stdout:} 2024-09-11T00:15:20.964 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:20.950+0000 7fac9b332640 1 -- 172.21.15.92:0/900489555 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7fac80077f70 msgr2=0x7fac8007a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:20.964 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:20.950+0000 7fac9b332640 1 --2- 172.21.15.92:0/900489555 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7fac80077f70 0x7fac8007a430 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fac8400d4f0 tx=0x7fac840019f0 comp rx=0 tx=0).stop 2024-09-11T00:15:20.964 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:20.950+0000 7fac9b332640 1 -- 172.21.15.92:0/900489555 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fac9415e060 msgr2=0x7fac940b8ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:20.965 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:20.950+0000 7fac9b332640 1 --2- 172.21.15.92:0/900489555 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fac9415e060 0x7fac940b8ac0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fac8c02ab00 tx=0x7fac8c032c10 comp rx=0 tx=0).stop 2024-09-11T00:15:20.965 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:20.950+0000 7fac9b332640 1 -- 172.21.15.92:0/900489555 shutdown_connections 2024-09-11T00:15:20.965 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:20.950+0000 7fac9b332640 1 --2- 172.21.15.92:0/900489555 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7fac80077f70 0x7fac8007a430 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:20.965 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:20.950+0000 7fac9b332640 1 --2- 172.21.15.92:0/900489555 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fac9415e060 0x7fac940b8ac0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:20.965 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:20.950+0000 7fac9b332640 1 --2- 172.21.15.92:0/900489555 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fac940d4af0 0x7fac940c8370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:20.965 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:20.950+0000 7fac9b332640 1 --2- 172.21.15.92:0/900489555 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fac940d2a20 0x7fac941f4b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:20.965 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:20.950+0000 7fac9b332640 1 -- 172.21.15.92:0/900489555 >> 172.21.15.92:0/900489555 conn(0x7fac940d3f70 msgr2=0x7fac94162280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:15:20.965 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:20.950+0000 7fac9b332640 1 -- 172.21.15.92:0/900489555 shutdown_connections 2024-09-11T00:15:20.965 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:20.950+0000 7fac9b332640 1 -- 172.21.15.92:0/900489555 wait complete. 2024-09-11T00:15:20.966 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-11T00:15:21.068 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:21.066+0000 7fc1a58be640 1 -- 172.21.15.92:0/2255667470 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc188004d40 msgr2=0x7fc1880051a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:21.068 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:21.066+0000 7fc1a58be640 1 --2- 172.21.15.92:0/2255667470 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc188004d40 0x7fc1880051a0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fc198009ed0 tx=0x7fc188005830 comp rx=0 tx=0).stop 2024-09-11T00:15:21.068 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:21.066+0000 7fc19f7fe640 1 -- 172.21.15.92:0/2255667470 reap_dead start 2024-09-11T00:15:21.068 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:21.066+0000 7fc1a58be640 1 -- 172.21.15.92:0/2255667470 shutdown_connections 2024-09-11T00:15:21.068 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:21.066+0000 7fc1a58be640 1 -- 172.21.15.92:0/2255667470 >> 172.21.15.92:0/2255667470 conn(0x7fc1a00d3f70 msgr2=0x7fc1a00d4350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:15:21.068 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:21.066+0000 7fc1a58be640 1 -- 172.21.15.92:0/2255667470 shutdown_connections 2024-09-11T00:15:21.069 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:21.066+0000 7fc1a58be640 1 -- 172.21.15.92:0/2255667470 wait complete. 2024-09-11T00:15:21.071 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:21.067+0000 7fc1a58be640 1 Processor -- start 2024-09-11T00:15:21.071 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:21.067+0000 7fc1a58be640 1 -- start start 2024-09-11T00:15:21.071 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:21.068+0000 7fc1a58be640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc188004d40 0x7fc1a01f4ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:21.071 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:21.068+0000 7fc1a58be640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc1a00cc090 0x7fc1a015f0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:21.071 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:21.068+0000 7fc1a58be640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc1a015e440 0x7fc1a015ced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:21.071 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:21.068+0000 7fc1a58be640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fc1a0166f70 con 0x7fc1a00cc090 2024-09-11T00:15:21.072 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:21.068+0000 7fc1a58be640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fc1a0166df0 con 0x7fc188004d40 2024-09-11T00:15:21.072 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:21.068+0000 7fc1a58be640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7fc1a01670f0 con 0x7fc1a015e440 2024-09-11T00:15:21.072 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:21.068+0000 7fc19e7fc640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc1a00cc090 0x7fc1a015f0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:21.072 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:21.068+0000 7fc19e7fc640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc1a00cc090 0x7fc1a015f0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:54800/0 (socket says 172.21.15.92:54800) 2024-09-11T00:15:21.072 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:21.068+0000 7fc19e7fc640 1 -- 172.21.15.92:0/3266083263 learned_addr learned my addr 172.21.15.92:0/3266083263 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-11T00:15:21.072 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:21.068+0000 7fc19f7fe640 1 --2- 172.21.15.92:0/3266083263 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc1a015e440 0x7fc1a015ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:21.072 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:21.068+0000 7fc19effd640 1 --2- 172.21.15.92:0/3266083263 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc188004d40 0x7fc1a01f4ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:21.072 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:21.068+0000 7fc19e7fc640 1 -- 172.21.15.92:0/3266083263 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc1a015e440 msgr2=0x7fc1a015ced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:21.072 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:21.068+0000 7fc19e7fc640 1 --2- 172.21.15.92:0/3266083263 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc1a015e440 0x7fc1a015ced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:21.072 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:21.068+0000 7fc19e7fc640 1 -- 172.21.15.92:0/3266083263 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc188004d40 msgr2=0x7fc1a01f4ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:21.072 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:21.068+0000 7fc19e7fc640 1 --2- 172.21.15.92:0/3266083263 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc188004d40 0x7fc1a01f4ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:21.073 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:21.068+0000 7fc19e7fc640 1 -- 172.21.15.92:0/3266083263 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1a00cc8c0 con 0x7fc1a00cc090 2024-09-11T00:15:21.073 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:21.068+0000 7fc19e7fc640 1 --2- 172.21.15.92:0/3266083263 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc1a00cc090 0x7fc1a015f0e0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fc194004e80 tx=0x7fc194001630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:15:21.073 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:21.069+0000 7fc187fff640 1 -- 172.21.15.92:0/3266083263 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc194015020 con 0x7fc1a00cc090 2024-09-11T00:15:21.073 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:21.069+0000 7fc187fff640 1 -- 172.21.15.92:0/3266083263 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc194011980 con 0x7fc1a00cc090 2024-09-11T00:15:21.073 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:21.069+0000 7fc1a58be640 1 -- 172.21.15.92:0/3266083263 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc1a00ccba0 con 0x7fc1a00cc090 2024-09-11T00:15:21.073 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:21.069+0000 7fc187fff640 1 -- 172.21.15.92:0/3266083263 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc194011dd0 con 0x7fc1a00cc090 2024-09-11T00:15:21.073 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:21.069+0000 7fc1a58be640 1 -- 172.21.15.92:0/3266083263 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1a015ff50 con 0x7fc1a00cc090 2024-09-11T00:15:21.073 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:21.070+0000 7fc1a58be640 1 -- 172.21.15.92:0/3266083263 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc1a00d24e0 con 0x7fc1a00cc090 2024-09-11T00:15:21.074 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:21.070+0000 7fc187fff640 1 -- 172.21.15.92:0/3266083263 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fc1940103c0 con 0x7fc1a00cc090 2024-09-11T00:15:21.074 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:21.071+0000 7fc187fff640 1 --2- 172.21.15.92:0/3266083263 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7fc18c077f70 0x7fc18c07a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:21.074 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:21.071+0000 7fc187fff640 1 -- 172.21.15.92:0/3266083263 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7fc19409a7c0 con 0x7fc1a00cc090 2024-09-11T00:15:21.074 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:21.071+0000 7fc19effd640 1 --2- 172.21.15.92:0/3266083263 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7fc18c077f70 0x7fc18c07a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:21.074 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:21.072+0000 7fc19effd640 1 --2- 172.21.15.92:0/3266083263 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7fc18c077f70 0x7fc18c07a430 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fc190000fb0 tx=0x7fc190006040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:15:21.076 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:21.075+0000 7fc187fff640 1 -- 172.21.15.92:0/3266083263 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fc19401f030 con 0x7fc1a00cc090 2024-09-11T00:15:21.289 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:21.287+0000 7fc1a58be640 1 -- 172.21.15.92:0/3266083263 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fc1a00cfe00 con 0x7fc1a00cc090 2024-09-11T00:15:21.289 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:21.287+0000 7fc187fff640 1 -- 172.21.15.92:0/3266083263 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v15) ==== 53+0+73 (secure 0 0 0) 0x7fc194062b70 con 0x7fc1a00cc090 2024-09-11T00:15:21.289 INFO:teuthology.orchestra.run.smithi092.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-11T00:15:21.291 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:21.289+0000 7fc1a58be640 1 -- 172.21.15.92:0/3266083263 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7fc18c077f70 msgr2=0x7fc18c07a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:21.291 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:21.289+0000 7fc1a58be640 1 --2- 172.21.15.92:0/3266083263 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7fc18c077f70 0x7fc18c07a430 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fc190000fb0 tx=0x7fc190006040 comp rx=0 tx=0).stop 2024-09-11T00:15:21.291 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:21.289+0000 7fc1a58be640 1 -- 172.21.15.92:0/3266083263 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc1a00cc090 msgr2=0x7fc1a015f0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:21.292 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:21.289+0000 7fc1a58be640 1 --2- 172.21.15.92:0/3266083263 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc1a00cc090 0x7fc1a015f0e0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fc194004e80 tx=0x7fc194001630 comp rx=0 tx=0).stop 2024-09-11T00:15:21.292 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:21.289+0000 7fc1a58be640 1 -- 172.21.15.92:0/3266083263 shutdown_connections 2024-09-11T00:15:21.292 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:21.289+0000 7fc1a58be640 1 --2- 172.21.15.92:0/3266083263 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7fc18c077f70 0x7fc18c07a430 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:21.292 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:21.289+0000 7fc1a58be640 1 --2- 172.21.15.92:0/3266083263 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc1a015e440 0x7fc1a015ced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:21.292 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:21.289+0000 7fc1a58be640 1 --2- 172.21.15.92:0/3266083263 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc1a00cc090 0x7fc1a015f0e0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:21.292 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:21.289+0000 7fc1a58be640 1 --2- 172.21.15.92:0/3266083263 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc188004d40 0x7fc1a01f4ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:21.292 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:21.289+0000 7fc1a58be640 1 -- 172.21.15.92:0/3266083263 >> 172.21.15.92:0/3266083263 conn(0x7fc1a00d3f70 msgr2=0x7fc1a006ecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:15:21.292 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:21.290+0000 7fc1a58be640 1 -- 172.21.15.92:0/3266083263 shutdown_connections 2024-09-11T00:15:21.292 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:21.290+0000 7fc1a58be640 1 -- 172.21.15.92:0/3266083263 wait complete. 2024-09-11T00:15:21.302 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-11T00:15:21.302 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-11T00:15:21.302 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi092.front.sepia.ceph.com 2024-09-11T00:15:21.302 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-11T00:15:21.302 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-11T00:15:21.302 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-11T00:15:21.302 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-11T00:15:21.302 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-11T00:15:21.302 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-11T00:15:21.302 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T00:15:21.303 DEBUG:teuthology.orchestra.run.smithi092:> ip addr 2024-09-11T00:15:21.318 INFO:teuthology.orchestra.run.smithi092.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-11T00:15:21.318 INFO:teuthology.orchestra.run.smithi092.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-11T00:15:21.318 INFO:teuthology.orchestra.run.smithi092.stdout: inet 127.0.0.1/8 scope host lo 2024-09-11T00:15:21.318 INFO:teuthology.orchestra.run.smithi092.stdout: valid_lft forever preferred_lft forever 2024-09-11T00:15:21.319 INFO:teuthology.orchestra.run.smithi092.stdout: inet6 ::1/128 scope host 2024-09-11T00:15:21.319 INFO:teuthology.orchestra.run.smithi092.stdout: valid_lft forever preferred_lft forever 2024-09-11T00:15:21.319 INFO:teuthology.orchestra.run.smithi092.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-11T00:15:21.319 INFO:teuthology.orchestra.run.smithi092.stdout: link/ether 0c:c4:7a:d8:a1:b2 brd ff:ff:ff:ff:ff:ff 2024-09-11T00:15:21.319 INFO:teuthology.orchestra.run.smithi092.stdout: altname enp7s0f0 2024-09-11T00:15:21.319 INFO:teuthology.orchestra.run.smithi092.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-11T00:15:21.319 INFO:teuthology.orchestra.run.smithi092.stdout: link/ether 0c:c4:7a:d8:a1:b3 brd ff:ff:ff:ff:ff:ff 2024-09-11T00:15:21.319 INFO:teuthology.orchestra.run.smithi092.stdout: altname enp7s0f1 2024-09-11T00:15:21.319 INFO:teuthology.orchestra.run.smithi092.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-11T00:15:21.319 INFO:teuthology.orchestra.run.smithi092.stdout: link/ether 0c:c4:7a:8f:cd:44 brd ff:ff:ff:ff:ff:ff 2024-09-11T00:15:21.319 INFO:teuthology.orchestra.run.smithi092.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-11T00:15:21.319 INFO:teuthology.orchestra.run.smithi092.stdout: link/ether 0c:c4:7a:8f:cd:45 brd ff:ff:ff:ff:ff:ff 2024-09-11T00:15:21.320 INFO:teuthology.orchestra.run.smithi092.stdout: inet 172.21.15.92/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-11T00:15:21.320 INFO:teuthology.orchestra.run.smithi092.stdout: valid_lft 42727sec preferred_lft 42727sec 2024-09-11T00:15:21.320 INFO:teuthology.orchestra.run.smithi092.stdout: inet6 fe80::ec4:7aff:fe8f:cd45/64 scope link noprefixroute 2024-09-11T00:15:21.320 INFO:teuthology.orchestra.run.smithi092.stdout: valid_lft forever preferred_lft forever 2024-09-11T00:15:21.320 INFO:teuthology.orchestra.run.smithi092.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-11T00:15:21.320 INFO:teuthology.orchestra.run.smithi092.stdout: link/ether 1e:fb:97:d7:e2:31 brd ff:ff:ff:ff:ff:ff 2024-09-11T00:15:21.320 INFO:teuthology.orchestra.run.smithi092.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-11T00:15:21.320 INFO:teuthology.orchestra.run.smithi092.stdout: valid_lft forever preferred_lft forever 2024-09-11T00:15:21.320 INFO:teuthology.orchestra.run.smithi092.stdout: inet6 fe80::60ba:93ff:fe0a:84b6/64 scope link 2024-09-11T00:15:21.320 INFO:teuthology.orchestra.run.smithi092.stdout: valid_lft forever preferred_lft forever 2024-09-11T00:15:21.320 INFO:teuthology.orchestra.run.smithi092.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-11T00:15:21.320 INFO:teuthology.orchestra.run.smithi092.stdout: link/ether a2:91:29:a1:39:9a brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-11T00:15:21.320 INFO:teuthology.orchestra.run.smithi092.stdout: inet6 fe80::a091:29ff:fea1:399a/64 scope link 2024-09-11T00:15:21.321 INFO:teuthology.orchestra.run.smithi092.stdout: valid_lft forever preferred_lft forever 2024-09-11T00:15:21.321 INFO:teuthology.orchestra.run.smithi092.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-11T00:15:21.321 INFO:teuthology.orchestra.run.smithi092.stdout: link/ether 1e:fb:97:d7:e2:31 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-11T00:15:21.321 INFO:teuthology.orchestra.run.smithi092.stdout: inet6 fe80::1cfb:97ff:fed7:e231/64 scope link 2024-09-11T00:15:21.321 INFO:teuthology.orchestra.run.smithi092.stdout: valid_lft forever preferred_lft forever 2024-09-11T00:15:21.321 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T00:15:21.321 DEBUG:teuthology.orchestra.run.smithi092:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-11T00:15:21.383 INFO:teuthology.orchestra.run.smithi092.stdout:1 2024-09-11T00:15:21.384 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T00:15:21.385 DEBUG:teuthology.orchestra.run.smithi092:> route 2024-09-11T00:15:21.441 INFO:teuthology.orchestra.run.smithi092.stdout:Kernel IP routing table 2024-09-11T00:15:21.441 INFO:teuthology.orchestra.run.smithi092.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-11T00:15:21.441 INFO:teuthology.orchestra.run.smithi092.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-11T00:15:21.441 INFO:teuthology.orchestra.run.smithi092.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-11T00:15:21.441 INFO:teuthology.orchestra.run.smithi092.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-11T00:15:21.441 DEBUG:teuthology.orchestra.run.smithi092:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-11T00:15:21.442 DEBUG:teuthology.orchestra.run.smithi092:> set -e 2024-09-11T00:15:21.442 DEBUG:teuthology.orchestra.run.smithi092:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-11T00:15:21.442 DEBUG:teuthology.orchestra.run.smithi092:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-11T00:15:21.442 DEBUG:teuthology.orchestra.run.smithi092:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-11T00:15:21.442 DEBUG:teuthology.orchestra.run.smithi092:> ') 2024-09-11T00:15:21.529 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:21 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-11T00:15:21.561 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:21 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T00:15:21.567 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T00:15:21.567 DEBUG:teuthology.orchestra.run.smithi092:> ip netns list 2024-09-11T00:15:21.582 INFO:teuthology.orchestra.run.smithi092.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-11T00:15:21.582 INFO:teuthology.orchestra.run.smithi092.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-11T00:15:21.583 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-11T00:15:21.583 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T00:15:21.583 DEBUG:teuthology.orchestra.run.smithi092:> sudo ip link set brx.0 up 2024-09-11T00:15:21.648 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-11T00:15:21.649 DEBUG:teuthology.orchestra.run.smithi092:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-11T00:15:21.703 INFO:teuthology.orchestra.run.smithi092.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-11T00:15:21.704 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-11T00:15:21.704 DEBUG:teuthology.orchestra.run.smithi092:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-11T00:15:21.759 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-11T00:15:21.759 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T00:15:21.759 DEBUG:teuthology.orchestra.run.smithi092:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-11T00:15:21.842 INFO:teuthology.orchestra.run.smithi092.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-11T00:15:21.842 INFO:teuthology.orchestra.run.smithi092.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-11T00:15:21.842 INFO:teuthology.orchestra.run.smithi092.stdout:invalid new device string format 2024-09-11T00:15:21.851 INFO:teuthology.orchestra.run.smithi092.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-11T00:15:21.851 INFO:teuthology.orchestra.run.smithi092.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-11T00:15:21.851 INFO:teuthology.orchestra.run.smithi092.stdout:invalid new device string format 2024-09-11T00:15:21.851 INFO:teuthology.orchestra.run.smithi092.stdout:mount.ceph: resolved to: "172.21.15.92:3300,172.21.15.145:3300,172.21.15.145:3301" 2024-09-11T00:15:21.851 INFO:teuthology.orchestra.run.smithi092.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-11T00:15:21.858 INFO:teuthology.orchestra.run.smithi092.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-11T00:15:21.858 INFO:teuthology.orchestra.run.smithi092.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-11T00:15:21.858 INFO:teuthology.orchestra.run.smithi092.stdout:invalid new device string format 2024-09-11T00:15:21.858 INFO:teuthology.orchestra.run.smithi092.stdout:mount.ceph: resolved to: "172.21.15.92:3300,172.21.15.145:3300,172.21.15.145:3301" 2024-09-11T00:15:21.858 INFO:teuthology.orchestra.run.smithi092.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-11T00:15:21.858 INFO:teuthology.orchestra.run.smithi092.stdout:mount.ceph: resolved to: "172.21.15.92:6789,172.21.15.145:6789,172.21.15.145:6790" 2024-09-11T00:15:21.859 INFO:teuthology.orchestra.run.smithi092.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.92:6789,172.21.15.145:6789,172.21.15.145:6790:/ 2024-09-11T00:15:21.859 INFO:teuthology.orchestra.run.smithi092.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=47039cb3-5d2a-46bf-9066-8055b5dfc583" will pass to kernel 2024-09-11T00:15:21.859 INFO:teuthology.orchestra.run.smithi092.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-11T00:15:21.859 INFO:teuthology.orchestra.run.smithi092.stdout: You just mounted a file system that supports labels which does not 2024-09-11T00:15:21.859 INFO:teuthology.orchestra.run.smithi092.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-11T00:15:21.859 INFO:teuthology.orchestra.run.smithi092.stdout: applications will generate AVC messages and not be allowed access to 2024-09-11T00:15:21.859 INFO:teuthology.orchestra.run.smithi092.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-11T00:15:21.861 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-11T00:15:21.861 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T00:15:21.861 DEBUG:teuthology.orchestra.run.smithi092:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-11T00:15:21.926 DEBUG:teuthology.orchestra.run.smithi092:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-11T00:15:22.016 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:22 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-11T00:15:22.020 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:22 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T00:15:22.026 INFO:teuthology.orchestra.run.smithi092.stdout:client4999 2024-09-11T00:15:22.026 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2024-09-11T00:15:22.026 DEBUG:teuthology.orchestra.run.smithi092:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T00:15:22.042 DEBUG:teuthology.orchestra.run.smithi092:> mktemp -d --suffix=xfstests-dev 2024-09-11T00:15:22.099 INFO:teuthology.orchestra.run.smithi092.stdout:/tmp/tmp.YVIfjesBePxfstests-dev 2024-09-11T00:15:22.099 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T00:15:22.099 DEBUG:teuthology.orchestra.run.smithi092:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo chmod a+rx /tmp/tmp.YVIfjesBePxfstests-dev) 2024-09-11T00:15:22.166 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T00:15:22.166 DEBUG:teuthology.orchestra.run.smithi092:> (cd /home/ubuntu/cephtest/mnt.0 && exec git clone https://git.ceph.com/xfstests-dev.git --depth 1 /tmp/tmp.YVIfjesBePxfstests-dev) 2024-09-11T00:15:22.226 INFO:teuthology.orchestra.run.smithi092.stderr:Cloning into '/tmp/tmp.YVIfjesBePxfstests-dev'... 2024-09-11T00:15:22.888 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T00:15:22.889 DEBUG:teuthology.orchestra.run.smithi092:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir test) 2024-09-11T00:15:22.949 DEBUG:teuthology.orchestra.run.smithi092:> mktemp -d --suffix=test 2024-09-11T00:15:23.004 INFO:teuthology.orchestra.run.smithi092.stdout:/tmp/tmp.NWxQF6Pu3itest 2024-09-11T00:15:23.004 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T00:15:23.005 DEBUG:teuthology.orchestra.run.smithi092:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir scratch) 2024-09-11T00:15:23.061 DEBUG:teuthology.orchestra.run.smithi092:> mktemp -d --suffix=scratch 2024-09-11T00:15:23.116 INFO:teuthology.orchestra.run.smithi092.stdout:/tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:15:23.116 INFO:tasks.cephfs.xfstests_dev:distro and version detected is "centos" and "9.stream". 2024-09-11T00:15:23.117 DEBUG:teuthology.orchestra.run.smithi092:> sudo yum install -y acl attr automake bc dbench dump e2fsprogs fio gawk gcc gdbm-devel git indent kernel-devel libacl-devel libaio-devel libcap-devel libtool libuuid-devel lvm2 make psmisc python3 quota sed sqlite udftools xfsprogs 2024-09-11T00:15:23.738 INFO:teuthology.orchestra.run.smithi092.stdout:Last metadata expiration check: 0:03:45 ago on Wed 11 Sep 2024 12:11:38 AM UTC. 2024-09-11T00:15:23.829 INFO:teuthology.orchestra.run.smithi092.stdout:Package acl-2.3.1-4.el9.x86_64 is already installed. 2024-09-11T00:15:23.829 INFO:teuthology.orchestra.run.smithi092.stdout:Package attr-2.5.1-3.el9.x86_64 is already installed. 2024-09-11T00:15:23.830 INFO:teuthology.orchestra.run.smithi092.stdout:Package automake-1.16.2-8.el9.noarch is already installed. 2024-09-11T00:15:23.831 INFO:teuthology.orchestra.run.smithi092.stdout:Package bc-1.07.1-14.el9.x86_64 is already installed. 2024-09-11T00:15:23.832 INFO:teuthology.orchestra.run.smithi092.stdout:Package dbench-4.0-25.el9.x86_64 is already installed. 2024-09-11T00:15:23.833 INFO:teuthology.orchestra.run.smithi092.stdout:Package e2fsprogs-1.46.5-5.el9.x86_64 is already installed. 2024-09-11T00:15:23.835 INFO:teuthology.orchestra.run.smithi092.stdout:Package gawk-5.1.0-6.el9.x86_64 is already installed. 2024-09-11T00:15:23.836 INFO:teuthology.orchestra.run.smithi092.stdout:Package gcc-11.5.0-2.el9.x86_64 is already installed. 2024-09-11T00:15:23.838 INFO:teuthology.orchestra.run.smithi092.stdout:Package git-2.43.5-1.el9.x86_64 is already installed. 2024-09-11T00:15:23.840 INFO:teuthology.orchestra.run.smithi092.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-11T00:15:23.841 INFO:teuthology.orchestra.run.smithi092.stdout:Package libaio-devel-0.3.111-13.el9.x86_64 is already installed. 2024-09-11T00:15:23.842 INFO:teuthology.orchestra.run.smithi092.stdout:Package libtool-2.4.6-46.el9.x86_64 is already installed. 2024-09-11T00:15:23.843 INFO:teuthology.orchestra.run.smithi092.stdout:Package libuuid-devel-2.37.4-20.el9.x86_64 is already installed. 2024-09-11T00:15:23.844 INFO:teuthology.orchestra.run.smithi092.stdout:Package lvm2-9:2.03.24-2.el9.x86_64 is already installed. 2024-09-11T00:15:23.845 INFO:teuthology.orchestra.run.smithi092.stdout:Package make-1:4.3-8.el9.x86_64 is already installed. 2024-09-11T00:15:23.846 INFO:teuthology.orchestra.run.smithi092.stdout:Package psmisc-23.4-3.el9.x86_64 is already installed. 2024-09-11T00:15:23.846 INFO:teuthology.orchestra.run.smithi092.stdout:Package python3-3.9.19-8.el9.x86_64 is already installed. 2024-09-11T00:15:23.847 INFO:teuthology.orchestra.run.smithi092.stdout:Package quota-1:4.09-2.el9.x86_64 is already installed. 2024-09-11T00:15:23.848 INFO:teuthology.orchestra.run.smithi092.stdout:Package sed-4.8-9.el9.x86_64 is already installed. 2024-09-11T00:15:23.850 INFO:teuthology.orchestra.run.smithi092.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-11T00:15:23.895 INFO:teuthology.orchestra.run.smithi092.stdout:Dependencies resolved. 2024-09-11T00:15:23.896 INFO:teuthology.orchestra.run.smithi092.stdout:================================================================================ 2024-09-11T00:15:23.896 INFO:teuthology.orchestra.run.smithi092.stdout: Package Arch Version Repository Size 2024-09-11T00:15:23.896 INFO:teuthology.orchestra.run.smithi092.stdout:================================================================================ 2024-09-11T00:15:23.896 INFO:teuthology.orchestra.run.smithi092.stdout:Installing: 2024-09-11T00:15:23.896 INFO:teuthology.orchestra.run.smithi092.stdout: dump x86_64 1:0.4-0.51.b47.el9 epel 88 k 2024-09-11T00:15:23.897 INFO:teuthology.orchestra.run.smithi092.stdout: fio x86_64 3.35-1.el9 appstream 6.2 M 2024-09-11T00:15:23.897 INFO:teuthology.orchestra.run.smithi092.stdout: gdbm-devel x86_64 1:1.23-1.el9 crb 81 k 2024-09-11T00:15:23.897 INFO:teuthology.orchestra.run.smithi092.stdout: indent x86_64 2.2.13-5.el9 epel 179 k 2024-09-11T00:15:23.897 INFO:teuthology.orchestra.run.smithi092.stdout: kernel-devel x86_64 5.14.0-505.el9 appstream 20 M 2024-09-11T00:15:23.897 INFO:teuthology.orchestra.run.smithi092.stdout: libcap-devel x86_64 2.48-9.el9 appstream 41 k 2024-09-11T00:15:23.897 INFO:teuthology.orchestra.run.smithi092.stdout: sqlite x86_64 3.34.1-7.el9 appstream 748 k 2024-09-11T00:15:23.897 INFO:teuthology.orchestra.run.smithi092.stdout: udftools x86_64 2.2-5.el9 appstream 149 k 2024-09-11T00:15:23.897 INFO:teuthology.orchestra.run.smithi092.stdout:Installing dependencies: 2024-09-11T00:15:23.897 INFO:teuthology.orchestra.run.smithi092.stdout: gdbm x86_64 1:1.23-1.el9 crb 153 k 2024-09-11T00:15:23.897 INFO:teuthology.orchestra.run.smithi092.stdout: rmt x86_64 2:1.6-6.el9 baseos 46 k 2024-09-11T00:15:23.897 INFO:teuthology.orchestra.run.smithi092.stdout:Installing weak dependencies: 2024-09-11T00:15:23.897 INFO:teuthology.orchestra.run.smithi092.stdout: fio-engine-http x86_64 3.35-1.el9 appstream 18 k 2024-09-11T00:15:23.897 INFO:teuthology.orchestra.run.smithi092.stdout: fio-engine-libaio x86_64 3.35-1.el9 appstream 16 k 2024-09-11T00:15:23.898 INFO:teuthology.orchestra.run.smithi092.stdout: fio-engine-nbd x86_64 3.35-1.el9 appstream 15 k 2024-09-11T00:15:23.898 INFO:teuthology.orchestra.run.smithi092.stdout: fio-engine-rados x86_64 3.35-1.el9 appstream 16 k 2024-09-11T00:15:23.898 INFO:teuthology.orchestra.run.smithi092.stdout: fio-engine-rbd x86_64 3.35-1.el9 appstream 16 k 2024-09-11T00:15:23.898 INFO:teuthology.orchestra.run.smithi092.stdout: fio-engine-rdma x86_64 3.35-1.el9 appstream 21 k 2024-09-11T00:15:23.898 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:15:23.898 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction Summary 2024-09-11T00:15:23.898 INFO:teuthology.orchestra.run.smithi092.stdout:================================================================================ 2024-09-11T00:15:23.898 INFO:teuthology.orchestra.run.smithi092.stdout:Install 16 Packages 2024-09-11T00:15:23.898 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:15:23.899 INFO:teuthology.orchestra.run.smithi092.stdout:Total download size: 28 M 2024-09-11T00:15:23.899 INFO:teuthology.orchestra.run.smithi092.stdout:Installed size: 80 M 2024-09-11T00:15:23.899 INFO:teuthology.orchestra.run.smithi092.stdout:Downloading Packages: 2024-09-11T00:15:25.111 INFO:teuthology.orchestra.run.smithi092.stdout:(1/16): fio-engine-http-3.35-1.el9.x86_64.rpm 189 kB/s | 18 kB 00:00 2024-09-11T00:15:25.136 INFO:teuthology.orchestra.run.smithi092.stdout:(2/16): rmt-1.6-6.el9.x86_64.rpm 381 kB/s | 46 kB 00:00 2024-09-11T00:15:25.161 INFO:teuthology.orchestra.run.smithi092.stdout:(3/16): fio-engine-libaio-3.35-1.el9.x86_64.rpm 311 kB/s | 16 kB 00:00 2024-09-11T00:15:25.211 INFO:teuthology.orchestra.run.smithi092.stdout:(4/16): fio-engine-rados-3.35-1.el9.x86_64.rpm 314 kB/s | 16 kB 00:00 2024-09-11T00:15:25.236 INFO:teuthology.orchestra.run.smithi092.stdout:(5/16): fio-engine-nbd-3.35-1.el9.x86_64.rpm 145 kB/s | 15 kB 00:00 2024-09-11T00:15:25.262 INFO:teuthology.orchestra.run.smithi092.stdout:(6/16): fio-engine-rbd-3.35-1.el9.x86_64.rpm 322 kB/s | 16 kB 00:00 2024-09-11T00:15:25.287 INFO:teuthology.orchestra.run.smithi092.stdout:(7/16): fio-engine-rdma-3.35-1.el9.x86_64.rpm 411 kB/s | 21 kB 00:00 2024-09-11T00:15:25.363 INFO:teuthology.orchestra.run.smithi092.stdout:(8/16): libcap-devel-2.48-9.el9.x86_64.rpm 540 kB/s | 41 kB 00:00 2024-09-11T00:15:25.554 INFO:teuthology.orchestra.run.smithi092.stdout:(9/16): sqlite-3.34.1-7.el9.x86_64.rpm 3.8 MB/s | 748 kB 00:00 2024-09-11T00:15:25.605 INFO:teuthology.orchestra.run.smithi092.stdout:(10/16): udftools-2.2-5.el9.x86_64.rpm 2.9 MB/s | 149 kB 00:00 2024-09-11T00:15:25.830 INFO:teuthology.orchestra.run.smithi092.stdout:(11/16): gdbm-1.23-1.el9.x86_64.rpm 681 kB/s | 153 kB 00:00 2024-09-11T00:15:25.947 INFO:teuthology.orchestra.run.smithi092.stdout:(12/16): gdbm-devel-1.23-1.el9.x86_64.rpm 689 kB/s | 81 kB 00:00 2024-09-11T00:15:26.031 INFO:teuthology.orchestra.run.smithi092.stdout:(13/16): dump-0.4-0.51.b47.el9.x86_64.rpm 1.0 MB/s | 88 kB 00:00 2024-09-11T00:15:26.073 INFO:teuthology.orchestra.run.smithi092.stdout:(14/16): indent-2.2.13-5.el9.x86_64.rpm 4.2 MB/s | 179 kB 00:00 2024-09-11T00:15:26.798 INFO:teuthology.orchestra.run.smithi092.stdout:(15/16): fio-3.35-1.el9.x86_64.rpm 3.5 MB/s | 6.2 MB 00:01 2024-09-11T00:15:30.397 INFO:teuthology.orchestra.run.smithi092.stdout:(16/16): kernel-devel-5.14.0-505.el9.x86_64.rpm 3.9 MB/s | 20 MB 00:05 2024-09-11T00:15:30.398 INFO:teuthology.orchestra.run.smithi092.stdout:-------------------------------------------------------------------------------- 2024-09-11T00:15:30.399 INFO:teuthology.orchestra.run.smithi092.stdout:Total 4.3 MB/s | 28 MB 00:06 2024-09-11T00:15:30.729 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction check 2024-09-11T00:15:30.798 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction check succeeded. 2024-09-11T00:15:30.799 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction test 2024-09-11T00:15:31.400 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction test succeeded. 2024-09-11T00:15:31.400 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction 2024-09-11T00:15:32.291 INFO:teuthology.orchestra.run.smithi092.stdout: Preparing : 1/1 2024-09-11T00:15:32.341 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : fio-engine-http-3.35-1.el9.x86_64 1/16 2024-09-11T00:15:32.366 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : fio-engine-libaio-3.35-1.el9.x86_64 2/16 2024-09-11T00:15:32.391 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : fio-engine-nbd-3.35-1.el9.x86_64 3/16 2024-09-11T00:15:32.417 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : fio-engine-rados-3.35-1.el9.x86_64 4/16 2024-09-11T00:15:32.442 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : fio-engine-rbd-3.35-1.el9.x86_64 5/16 2024-09-11T00:15:32.593 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : fio-engine-rdma-3.35-1.el9.x86_64 6/16 2024-09-11T00:15:32.639 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : fio-3.35-1.el9.x86_64 7/16 2024-09-11T00:15:32.673 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : gdbm-1:1.23-1.el9.x86_64 8/16 2024-09-11T00:15:32.709 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : rmt-2:1.6-6.el9.x86_64 9/16 2024-09-11T00:15:32.740 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : dump-1:0.4-0.51.b47.el9.x86_64 10/16 2024-09-11T00:15:32.783 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : gdbm-devel-1:1.23-1.el9.x86_64 11/16 2024-09-11T00:15:32.825 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : indent-2.2.13-5.el9.x86_64 12/16 2024-09-11T00:15:32.866 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : udftools-2.2-5.el9.x86_64 13/16 2024-09-11T00:15:32.918 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : sqlite-3.34.1-7.el9.x86_64 14/16 2024-09-11T00:15:42.444 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libcap-devel-2.48-9.el9.x86_64 15/16 2024-09-11T00:15:42.843 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : kernel-devel-5.14.0-505.el9.x86_64 16/16 2024-09-11T00:15:46.325 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T00:15:46.328 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T00:15:55.567 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: kernel-devel-5.14.0-505.el9.x86_64 16/16 2024-09-11T00:15:55.567 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : rmt-2:1.6-6.el9.x86_64 1/16 2024-09-11T00:15:55.567 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : fio-3.35-1.el9.x86_64 2/16 2024-09-11T00:15:55.567 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : fio-engine-http-3.35-1.el9.x86_64 3/16 2024-09-11T00:15:55.567 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : fio-engine-libaio-3.35-1.el9.x86_64 4/16 2024-09-11T00:15:55.567 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : fio-engine-nbd-3.35-1.el9.x86_64 5/16 2024-09-11T00:15:55.567 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : fio-engine-rados-3.35-1.el9.x86_64 6/16 2024-09-11T00:15:55.567 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : fio-engine-rbd-3.35-1.el9.x86_64 7/16 2024-09-11T00:15:55.567 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : fio-engine-rdma-3.35-1.el9.x86_64 8/16 2024-09-11T00:15:55.567 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : kernel-devel-5.14.0-505.el9.x86_64 9/16 2024-09-11T00:15:55.568 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libcap-devel-2.48-9.el9.x86_64 10/16 2024-09-11T00:15:55.568 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : sqlite-3.34.1-7.el9.x86_64 11/16 2024-09-11T00:15:55.568 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : udftools-2.2-5.el9.x86_64 12/16 2024-09-11T00:15:55.568 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : gdbm-1:1.23-1.el9.x86_64 13/16 2024-09-11T00:15:55.568 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : gdbm-devel-1:1.23-1.el9.x86_64 14/16 2024-09-11T00:15:55.568 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : dump-1:0.4-0.51.b47.el9.x86_64 15/16 2024-09-11T00:15:55.984 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : indent-2.2.13-5.el9.x86_64 16/16 2024-09-11T00:15:55.985 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:15:55.985 INFO:teuthology.orchestra.run.smithi092.stdout:Installed: 2024-09-11T00:15:55.985 INFO:teuthology.orchestra.run.smithi092.stdout: dump-1:0.4-0.51.b47.el9.x86_64 fio-3.35-1.el9.x86_64 2024-09-11T00:15:55.985 INFO:teuthology.orchestra.run.smithi092.stdout: fio-engine-http-3.35-1.el9.x86_64 fio-engine-libaio-3.35-1.el9.x86_64 2024-09-11T00:15:55.985 INFO:teuthology.orchestra.run.smithi092.stdout: fio-engine-nbd-3.35-1.el9.x86_64 fio-engine-rados-3.35-1.el9.x86_64 2024-09-11T00:15:55.985 INFO:teuthology.orchestra.run.smithi092.stdout: fio-engine-rbd-3.35-1.el9.x86_64 fio-engine-rdma-3.35-1.el9.x86_64 2024-09-11T00:15:55.985 INFO:teuthology.orchestra.run.smithi092.stdout: gdbm-1:1.23-1.el9.x86_64 gdbm-devel-1:1.23-1.el9.x86_64 2024-09-11T00:15:55.985 INFO:teuthology.orchestra.run.smithi092.stdout: indent-2.2.13-5.el9.x86_64 kernel-devel-5.14.0-505.el9.x86_64 2024-09-11T00:15:55.985 INFO:teuthology.orchestra.run.smithi092.stdout: libcap-devel-2.48-9.el9.x86_64 rmt-2:1.6-6.el9.x86_64 2024-09-11T00:15:55.986 INFO:teuthology.orchestra.run.smithi092.stdout: sqlite-3.34.1-7.el9.x86_64 udftools-2.2-5.el9.x86_64 2024-09-11T00:15:55.986 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:15:55.986 INFO:teuthology.orchestra.run.smithi092.stdout:Complete! 2024-09-11T00:15:56.405 DEBUG:teuthology.orchestra.run.smithi092:> sudo useradd -m fsgqa 2024-09-11T00:15:56.431 INFO:teuthology.orchestra.run.smithi092.stderr:useradd: user 'fsgqa' already exists 2024-09-11T00:15:56.433 DEBUG:teuthology.orchestra.run:got remote process result: 9 2024-09-11T00:15:56.433 DEBUG:teuthology.orchestra.run.smithi092:> sudo groupadd fsgqa 2024-09-11T00:15:56.499 INFO:teuthology.orchestra.run.smithi092.stderr:groupadd: group 'fsgqa' already exists 2024-09-11T00:15:56.500 DEBUG:teuthology.orchestra.run:got remote process result: 9 2024-09-11T00:15:56.501 DEBUG:teuthology.orchestra.run.smithi092:> sudo useradd fsgqa2 2024-09-11T00:15:57.346 DEBUG:teuthology.orchestra.run.smithi092:> sudo useradd 123456-fsgqa 2024-09-11T00:15:58.215 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json mon dump 2024-09-11T00:15:58.324 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:58.322+0000 7f42f5e7f640 1 -- 172.21.15.92:0/3989809609 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f42f0072680 msgr2=0x7f42f0072aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:58.324 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:58.322+0000 7f42f5e7f640 1 --2- 172.21.15.92:0/3989809609 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f42f0072680 0x7f42f0072aa0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f42f00749f0 tx=0x7f42d802a4d0 comp rx=0 tx=0).stop 2024-09-11T00:15:58.324 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:58.322+0000 7f42f5e7f640 1 -- 172.21.15.92:0/3989809609 shutdown_connections 2024-09-11T00:15:58.324 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:58.322+0000 7f42f5e7f640 1 --2- 172.21.15.92:0/3989809609 >> v2:172.21.15.145:3300/0 conn(0x7f42f00ceb00 0x7f42f00cef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:58.324 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:58.322+0000 7f42f5e7f640 1 --2- 172.21.15.92:0/3989809609 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f42f0072680 0x7f42f0072aa0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:58.324 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:58.322+0000 7f42f5e7f640 1 --2- 172.21.15.92:0/3989809609 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f42f0144780 0x7f42f00b3da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:58.325 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:58.322+0000 7f42f5e7f640 1 -- 172.21.15.92:0/3989809609 >> 172.21.15.92:0/3989809609 conn(0x7f42f00b1760 msgr2=0x7f42f00b1b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:15:58.325 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:58.322+0000 7f42f5e7f640 1 -- 172.21.15.92:0/3989809609 shutdown_connections 2024-09-11T00:15:58.325 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:58.322+0000 7f42f5e7f640 1 -- 172.21.15.92:0/3989809609 wait complete. 2024-09-11T00:15:58.327 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:58.323+0000 7f42f5e7f640 1 Processor -- start 2024-09-11T00:15:58.327 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:58.323+0000 7f42f5e7f640 1 -- start start 2024-09-11T00:15:58.327 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:58.324+0000 7f42f5e7f640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f42f0072680 0x7f42f013e020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:58.327 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:58.324+0000 7f42f5e7f640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f42f00ceb00 0x7f42f0165440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:58.327 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:58.324+0000 7f42f5e7f640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f42f0144780 0x7f42f00cc0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:58.327 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:58.324+0000 7f42f5e7f640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f42f015c8e0 con 0x7f42f0072680 2024-09-11T00:15:58.327 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:58.324+0000 7f42f5e7f640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f42f015c760 con 0x7f42f0144780 2024-09-11T00:15:58.327 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:58.324+0000 7f42f5e7f640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f42f015ca60 con 0x7f42f00ceb00 2024-09-11T00:15:58.327 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:58.324+0000 7f42ef7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f42f0072680 0x7f42f013e020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:58.327 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:58.324+0000 7f42ef7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f42f0072680 0x7f42f013e020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:39520/0 (socket says 172.21.15.92:39520) 2024-09-11T00:15:58.328 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:58.324+0000 7f42ef7fe640 1 -- 172.21.15.92:0/1800597568 learned_addr learned my addr 172.21.15.92:0/1800597568 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-11T00:15:58.328 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:58.324+0000 7f42effff640 1 --2- 172.21.15.92:0/1800597568 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f42f0144780 0x7f42f00cc0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:58.328 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:58.324+0000 7f42e7fff640 1 --2- 172.21.15.92:0/1800597568 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f42f00ceb00 0x7f42f0165440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:58.328 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:58.324+0000 7f42ef7fe640 1 -- 172.21.15.92:0/1800597568 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f42f00ceb00 msgr2=0x7f42f0165440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:58.328 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:58.324+0000 7f42ef7fe640 1 --2- 172.21.15.92:0/1800597568 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f42f00ceb00 0x7f42f0165440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:58.328 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:58.324+0000 7f42ef7fe640 1 -- 172.21.15.92:0/1800597568 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f42f0144780 msgr2=0x7f42f00cc0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:58.328 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:58.324+0000 7f42ef7fe640 1 --2- 172.21.15.92:0/1800597568 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f42f0144780 0x7f42f00cc0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:58.328 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:58.324+0000 7f42ef7fe640 1 -- 172.21.15.92:0/1800597568 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42f012aa10 con 0x7f42f0072680 2024-09-11T00:15:58.328 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:58.324+0000 7f42effff640 1 --2- 172.21.15.92:0/1800597568 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f42f0144780 0x7f42f00cc0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:15:58.328 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:58.324+0000 7f42ef7fe640 1 --2- 172.21.15.92:0/1800597568 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f42f0072680 0x7f42f013e020 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f42e000b410 tx=0x7f42e000b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:15:58.328 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:58.325+0000 7f42ecff9640 1 -- 172.21.15.92:0/1800597568 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42e0015020 con 0x7f42f0072680 2024-09-11T00:15:58.329 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:58.325+0000 7f42ecff9640 1 -- 172.21.15.92:0/1800597568 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f42e0011940 con 0x7f42f0072680 2024-09-11T00:15:58.329 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:58.325+0000 7f42f5e7f640 1 -- 172.21.15.92:0/1800597568 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42f0129ef0 con 0x7f42f0072680 2024-09-11T00:15:58.329 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:58.325+0000 7f42ecff9640 1 -- 172.21.15.92:0/1800597568 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42e0011d90 con 0x7f42f0072680 2024-09-11T00:15:58.329 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:58.325+0000 7f42f5e7f640 1 -- 172.21.15.92:0/1800597568 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42f012a730 con 0x7f42f0072680 2024-09-11T00:15:58.330 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:58.326+0000 7f42f5e7f640 1 -- 172.21.15.92:0/1800597568 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f42f013bb40 con 0x7f42f0072680 2024-09-11T00:15:58.330 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:58.326+0000 7f42ecff9640 1 -- 172.21.15.92:0/1800597568 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f42e001a400 con 0x7f42f0072680 2024-09-11T00:15:58.330 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:58.327+0000 7f42ecff9640 1 --2- 172.21.15.92:0/1800597568 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f42d0077f70 0x7f42d007a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:58.330 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:58.327+0000 7f42ecff9640 1 -- 172.21.15.92:0/1800597568 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7f42e009a170 con 0x7f42f0072680 2024-09-11T00:15:58.330 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:58.327+0000 7f42e7fff640 1 --2- 172.21.15.92:0/1800597568 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f42d0077f70 0x7f42d007a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:58.330 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:58.328+0000 7f42e7fff640 1 --2- 172.21.15.92:0/1800597568 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f42d0077f70 0x7f42d007a430 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f42d8033000 tx=0x7f42d8004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:15:58.332 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:58.331+0000 7f42ecff9640 1 -- 172.21.15.92:0/1800597568 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f42e001f020 con 0x7f42f0072680 2024-09-11T00:15:58.580 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:58.578+0000 7f42f5e7f640 1 -- 172.21.15.92:0/1800597568 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f42f00cd560 con 0x7f42f0072680 2024-09-11T00:15:58.581 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:58.579+0000 7f42ecff9640 1 -- 172.21.15.92:0/1800597568 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) ==== 95+0+1285 (secure 0 0 0) 0x7f42f0129ef0 con 0x7f42f0072680 2024-09-11T00:15:58.581 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:15:58.581 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":1,"fsid":"47039cb3-5d2a-46bf-9066-8055b5dfc583","modified":"2024-09-11T00:13:17.713218Z","created":"2024-09-11T00:13:17.713218Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:3300","nonce":0},{"type":"v1","addr":"172.21.15.92:6789","nonce":0}]},"addr":"172.21.15.92:6789/0","public_addr":"172.21.15.92:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:3300","nonce":0},{"type":"v1","addr":"172.21.15.145:6789","nonce":0}]},"addr":"172.21.15.145:6789/0","public_addr":"172.21.15.145:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:3301","nonce":0},{"type":"v1","addr":"172.21.15.145:6790","nonce":0}]},"addr":"172.21.15.145:6790/0","public_addr":"172.21.15.145:6790/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1,2]} 2024-09-11T00:15:58.581 INFO:teuthology.orchestra.run.smithi092.stderr:dumped monmap epoch 1 2024-09-11T00:15:58.583 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:58.581+0000 7f42f5e7f640 1 -- 172.21.15.92:0/1800597568 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f42d0077f70 msgr2=0x7f42d007a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:58.583 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:58.581+0000 7f42f5e7f640 1 --2- 172.21.15.92:0/1800597568 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f42d0077f70 0x7f42d007a430 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f42d8033000 tx=0x7f42d8004730 comp rx=0 tx=0).stop 2024-09-11T00:15:58.583 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:58.581+0000 7f42f5e7f640 1 -- 172.21.15.92:0/1800597568 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f42f0072680 msgr2=0x7f42f013e020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:58.583 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:58.581+0000 7f42f5e7f640 1 --2- 172.21.15.92:0/1800597568 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f42f0072680 0x7f42f013e020 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f42e000b410 tx=0x7f42e000b8d0 comp rx=0 tx=0).stop 2024-09-11T00:15:58.583 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:58.581+0000 7f42f5e7f640 1 -- 172.21.15.92:0/1800597568 shutdown_connections 2024-09-11T00:15:58.583 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:58.581+0000 7f42f5e7f640 1 --2- 172.21.15.92:0/1800597568 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f42d0077f70 0x7f42d007a430 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:58.583 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:58.581+0000 7f42f5e7f640 1 --2- 172.21.15.92:0/1800597568 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f42f0144780 0x7f42f00cc0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:58.584 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:58.581+0000 7f42f5e7f640 1 --2- 172.21.15.92:0/1800597568 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f42f00ceb00 0x7f42f0165440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:58.584 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:58.581+0000 7f42f5e7f640 1 --2- 172.21.15.92:0/1800597568 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f42f0072680 0x7f42f013e020 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:58.584 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:58.581+0000 7f42f5e7f640 1 -- 172.21.15.92:0/1800597568 >> 172.21.15.92:0/1800597568 conn(0x7f42f00b1760 msgr2=0x7f42f00702f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:15:58.584 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:58.581+0000 7f42f5e7f640 1 -- 172.21.15.92:0/1800597568 shutdown_connections 2024-09-11T00:15:58.584 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:58.581+0000 7f42f5e7f640 1 -- 172.21.15.92:0/1800597568 wait complete. 2024-09-11T00:15:58.596 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth get-or-create client.admin 2024-09-11T00:15:58.755 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:58.753+0000 7f8bad0fe640 1 -- 172.21.15.92:0/3777934487 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8ba8072680 msgr2=0x7f8ba80ceb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:58.755 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:58.753+0000 7f8bad0fe640 1 --2- 172.21.15.92:0/3777934487 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8ba8072680 0x7f8ba80ceb00 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f8b90009830 tx=0x7f8b9002a480 comp rx=0 tx=0).stop 2024-09-11T00:15:58.755 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:58.753+0000 7f8bad0fe640 1 -- 172.21.15.92:0/3777934487 shutdown_connections 2024-09-11T00:15:58.755 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:58.753+0000 7f8bad0fe640 1 --2- 172.21.15.92:0/3777934487 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8ba8072680 0x7f8ba80ceb00 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:58.755 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:58.753+0000 7f8bad0fe640 1 -- 172.21.15.92:0/3777934487 >> 172.21.15.92:0/3777934487 conn(0x7f8ba80b1760 msgr2=0x7f8ba80b1b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:15:58.755 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:58.753+0000 7f8bad0fe640 1 -- 172.21.15.92:0/3777934487 shutdown_connections 2024-09-11T00:15:58.755 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:58.753+0000 7f8bad0fe640 1 -- 172.21.15.92:0/3777934487 wait complete. 2024-09-11T00:15:58.756 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:58.754+0000 7f8bad0fe640 1 Processor -- start 2024-09-11T00:15:58.756 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:58.754+0000 7f8bad0fe640 1 -- start start 2024-09-11T00:15:58.758 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:58.755+0000 7f8bad0fe640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8ba8072680 0x7f8ba813e190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:58.758 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:58.755+0000 7f8bad0fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8ba8072ad0 0x7f8ba8137500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:58.758 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:58.755+0000 7f8bad0fe640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8ba8144780 0x7f8ba81e8c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:58.758 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:58.755+0000 7f8bad0fe640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f8ba815cc60 con 0x7f8ba8072ad0 2024-09-11T00:15:58.758 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:58.755+0000 7f8bad0fe640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f8ba80cf390 con 0x7f8ba8072680 2024-09-11T00:15:58.758 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:58.755+0000 7f8bad0fe640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f8ba815cde0 con 0x7f8ba8144780 2024-09-11T00:15:58.759 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:58.755+0000 7f8ba659c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8ba8072ad0 0x7f8ba8137500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:58.759 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:58.755+0000 7f8ba659c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8ba8072ad0 0x7f8ba8137500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:39532/0 (socket says 172.21.15.92:39532) 2024-09-11T00:15:58.759 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:58.755+0000 7f8ba659c640 1 -- 172.21.15.92:0/2130572897 learned_addr learned my addr 172.21.15.92:0/2130572897 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-11T00:15:58.759 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:58.755+0000 7f8ba759e640 1 --2- 172.21.15.92:0/2130572897 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8ba8144780 0x7f8ba81e8c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:58.759 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:58.755+0000 7f8ba6d9d640 1 --2- 172.21.15.92:0/2130572897 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8ba8072680 0x7f8ba813e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:58.759 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:58.755+0000 7f8ba659c640 1 -- 172.21.15.92:0/2130572897 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8ba8144780 msgr2=0x7f8ba81e8c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:58.759 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:58.755+0000 7f8ba659c640 1 --2- 172.21.15.92:0/2130572897 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8ba8144780 0x7f8ba81e8c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:58.759 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:58.755+0000 7f8ba659c640 1 -- 172.21.15.92:0/2130572897 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8ba8072680 msgr2=0x7f8ba813e190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:58.759 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:58.755+0000 7f8ba659c640 1 --2- 172.21.15.92:0/2130572897 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8ba8072680 0x7f8ba813e190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:58.759 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:58.755+0000 7f8ba659c640 1 -- 172.21.15.92:0/2130572897 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ba8139730 con 0x7f8ba8072ad0 2024-09-11T00:15:58.759 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:58.755+0000 7f8ba6d9d640 1 --2- 172.21.15.92:0/2130572897 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8ba8072680 0x7f8ba813e190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:15:58.760 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:58.755+0000 7f8ba759e640 1 --2- 172.21.15.92:0/2130572897 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8ba8144780 0x7f8ba81e8c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:15:58.760 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:58.756+0000 7f8ba659c640 1 --2- 172.21.15.92:0/2130572897 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8ba8072ad0 0x7f8ba8137500 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f8b90000c00 tx=0x7f8b90032d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:15:58.760 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:58.756+0000 7f8b9f7fe640 1 -- 172.21.15.92:0/2130572897 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b90040070 con 0x7f8ba8072ad0 2024-09-11T00:15:58.760 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:58.756+0000 7f8b9f7fe640 1 -- 172.21.15.92:0/2130572897 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8b90003af0 con 0x7f8ba8072ad0 2024-09-11T00:15:58.760 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:58.756+0000 7f8bad0fe640 1 -- 172.21.15.92:0/2130572897 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ba8137d70 con 0x7f8ba8072ad0 2024-09-11T00:15:58.760 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:58.756+0000 7f8b9f7fe640 1 -- 172.21.15.92:0/2130572897 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b90045460 con 0x7f8ba8072ad0 2024-09-11T00:15:58.760 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:58.756+0000 7f8bad0fe640 1 -- 172.21.15.92:0/2130572897 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ba814c090 con 0x7f8ba8072ad0 2024-09-11T00:15:58.760 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:58.757+0000 7f8bad0fe640 1 -- 172.21.15.92:0/2130572897 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8ba80cedf0 con 0x7f8ba8072ad0 2024-09-11T00:15:58.761 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:58.757+0000 7f8b9f7fe640 1 -- 172.21.15.92:0/2130572897 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f8b9004d030 con 0x7f8ba8072ad0 2024-09-11T00:15:58.761 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:58.758+0000 7f8b9f7fe640 1 --2- 172.21.15.92:0/2130572897 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f8b88077f70 0x7f8b8807a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:58.761 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:58.758+0000 7f8b9f7fe640 1 -- 172.21.15.92:0/2130572897 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7f8b900bb6d0 con 0x7f8ba8072ad0 2024-09-11T00:15:58.761 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:58.758+0000 7f8ba6d9d640 1 --2- 172.21.15.92:0/2130572897 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f8b88077f70 0x7f8b8807a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:58.761 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:58.759+0000 7f8ba6d9d640 1 --2- 172.21.15.92:0/2130572897 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f8b88077f70 0x7f8b8807a430 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f8b98007e90 tx=0x7f8b980073a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:15:58.763 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:58.762+0000 7f8b9f7fe640 1 -- 172.21.15.92:0/2130572897 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f8ba8139730 con 0x7f8ba8072ad0 2024-09-11T00:15:59.007 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:59.005+0000 7f8bad0fe640 1 -- 172.21.15.92:0/2130572897 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.admin"} v 0) -- 0x7f8ba80b4d40 con 0x7f8ba8072ad0 2024-09-11T00:15:59.007 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:59.006+0000 7f8b9f7fe640 1 -- 172.21.15.92:0/2130572897 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.admin"}]=0 v11) ==== 92+0+63 (secure 0 0 0) 0x7f8b90083f10 con 0x7f8ba8072ad0 2024-09-11T00:15:59.007 INFO:teuthology.orchestra.run.smithi092.stdout:[client.admin] 2024-09-11T00:15:59.007 INFO:teuthology.orchestra.run.smithi092.stdout: key = AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== 2024-09-11T00:15:59.010 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:59.008+0000 7f8bad0fe640 1 -- 172.21.15.92:0/2130572897 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f8b88077f70 msgr2=0x7f8b8807a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:59.010 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:59.008+0000 7f8bad0fe640 1 --2- 172.21.15.92:0/2130572897 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f8b88077f70 0x7f8b8807a430 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f8b98007e90 tx=0x7f8b980073a0 comp rx=0 tx=0).stop 2024-09-11T00:15:59.010 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:59.008+0000 7f8bad0fe640 1 -- 172.21.15.92:0/2130572897 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8ba8072ad0 msgr2=0x7f8ba8137500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:59.010 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:59.008+0000 7f8bad0fe640 1 --2- 172.21.15.92:0/2130572897 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8ba8072ad0 0x7f8ba8137500 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f8b90000c00 tx=0x7f8b90032d50 comp rx=0 tx=0).stop 2024-09-11T00:15:59.010 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:59.008+0000 7f8bad0fe640 1 -- 172.21.15.92:0/2130572897 shutdown_connections 2024-09-11T00:15:59.010 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:59.008+0000 7f8bad0fe640 1 --2- 172.21.15.92:0/2130572897 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f8b88077f70 0x7f8b8807a430 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:59.010 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:59.008+0000 7f8bad0fe640 1 --2- 172.21.15.92:0/2130572897 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8ba8144780 0x7f8ba81e8c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:59.010 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:59.008+0000 7f8bad0fe640 1 --2- 172.21.15.92:0/2130572897 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8ba8072ad0 0x7f8ba8137500 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:59.010 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:59.008+0000 7f8bad0fe640 1 --2- 172.21.15.92:0/2130572897 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8ba8072680 0x7f8ba813e190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:59.010 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:59.008+0000 7f8bad0fe640 1 -- 172.21.15.92:0/2130572897 >> 172.21.15.92:0/2130572897 conn(0x7f8ba80b1760 msgr2=0x7f8ba81434c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:15:59.010 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:59.008+0000 7f8bad0fe640 1 -- 172.21.15.92:0/2130572897 shutdown_connections 2024-09-11T00:15:59.010 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T00:15:59.008+0000 7f8bad0fe640 1 -- 172.21.15.92:0/2130572897 wait complete. 2024-09-11T00:15:59.021 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2024-09-11T00:15:59.021 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd of=/tmp/tmp.YVIfjesBePxfstests-dev/local.config 2024-09-11T00:15:59.046 INFO:tasks.cephfs.xfstests_dev:local.config's contents - export FSTYP=ceph export TEST_DEV=172.21.15.92:6789:/test export TEST_DIR=/tmp/tmp.NWxQF6Pu3itest export SCRATCH_DEV=172.21.15.92:6789:/scratch export SCRATCH_MNT=/tmp/tmp.uDPYbHx6DKscratch export CEPHFS_MOUNT_OPTIONS="-o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg==" 2024-09-11T00:15:59.046 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2024-09-11T00:15:59.046 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd of=/tmp/tmp.YVIfjesBePxfstests-dev/ceph.exclude 2024-09-11T00:15:59.111 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo make) 2024-09-11T00:15:59.191 INFO:teuthology.orchestra.run.smithi092.stdout:libtoolize -cfi 2024-09-11T00:15:59.564 INFO:teuthology.orchestra.run.smithi092.stdout:libtoolize: putting auxiliary files in '.'. 2024-09-11T00:15:59.564 INFO:teuthology.orchestra.run.smithi092.stdout:libtoolize: copying file './config.guess' 2024-09-11T00:15:59.567 INFO:teuthology.orchestra.run.smithi092.stdout:libtoolize: copying file './config.sub' 2024-09-11T00:15:59.571 INFO:teuthology.orchestra.run.smithi092.stdout:libtoolize: copying file './install-sh' 2024-09-11T00:15:59.575 INFO:teuthology.orchestra.run.smithi092.stdout:libtoolize: copying file './ltmain.sh' 2024-09-11T00:15:59.596 INFO:teuthology.orchestra.run.smithi092.stdout:libtoolize: putting macros in AC_CONFIG_MACRO_DIRS, 'm4'. 2024-09-11T00:15:59.597 INFO:teuthology.orchestra.run.smithi092.stdout:libtoolize: copying file 'm4/libtool.m4' 2024-09-11T00:15:59.601 INFO:teuthology.orchestra.run.smithi092.stdout:libtoolize: copying file 'm4/ltoptions.m4' 2024-09-11T00:15:59.605 INFO:teuthology.orchestra.run.smithi092.stdout:libtoolize: copying file 'm4/ltsugar.m4' 2024-09-11T00:15:59.610 INFO:teuthology.orchestra.run.smithi092.stdout:libtoolize: copying file 'm4/ltversion.m4' 2024-09-11T00:15:59.614 INFO:teuthology.orchestra.run.smithi092.stdout:libtoolize: copying file 'm4/lt~obsolete.m4' 2024-09-11T00:15:59.621 INFO:teuthology.orchestra.run.smithi092.stdout:libtoolize: Consider adding '-I m4' to ACLOCAL_AMFLAGS in Makefile.am. 2024-09-11T00:15:59.622 INFO:teuthology.orchestra.run.smithi092.stdout:cp include/install-sh . 2024-09-11T00:15:59.623 INFO:teuthology.orchestra.run.smithi092.stdout:aclocal -I m4 2024-09-11T00:16:00.621 INFO:teuthology.orchestra.run.smithi092.stdout:autoheader 2024-09-11T00:16:00.914 INFO:teuthology.orchestra.run.smithi092.stdout:autoconf 2024-09-11T00:16:01.085 INFO:teuthology.orchestra.run.smithi092.stdout:./configure \ 2024-09-11T00:16:01.085 INFO:teuthology.orchestra.run.smithi092.stdout: --libexecdir=/usr/lib \ 2024-09-11T00:16:01.085 INFO:teuthology.orchestra.run.smithi092.stdout: --exec_prefix=/var/lib 2024-09-11T00:16:01.478 INFO:teuthology.orchestra.run.smithi092.stdout:checking build system type... x86_64-pc-linux-gnu 2024-09-11T00:16:01.478 INFO:teuthology.orchestra.run.smithi092.stdout:checking host system type... x86_64-pc-linux-gnu 2024-09-11T00:16:01.479 INFO:teuthology.orchestra.run.smithi092.stdout:checking how to print strings... printf 2024-09-11T00:16:01.479 INFO:teuthology.orchestra.run.smithi092.stdout:checking for gcc... gcc 2024-09-11T00:16:01.599 INFO:teuthology.orchestra.run.smithi092.stdout:checking whether the C compiler works... yes 2024-09-11T00:16:01.599 INFO:teuthology.orchestra.run.smithi092.stdout:checking for C compiler default output file name... a.out 2024-09-11T00:16:01.626 INFO:teuthology.orchestra.run.smithi092.stdout:checking for suffix of executables... 2024-09-11T00:16:01.735 INFO:teuthology.orchestra.run.smithi092.stdout:checking whether we are cross compiling... no 2024-09-11T00:16:01.753 INFO:teuthology.orchestra.run.smithi092.stdout:checking for suffix of object files... o 2024-09-11T00:16:01.768 INFO:teuthology.orchestra.run.smithi092.stdout:checking whether we are using the GNU C compiler... yes 2024-09-11T00:16:01.784 INFO:teuthology.orchestra.run.smithi092.stdout:checking whether gcc accepts -g... yes 2024-09-11T00:16:01.830 INFO:teuthology.orchestra.run.smithi092.stdout:checking for gcc option to accept ISO C89... none needed 2024-09-11T00:16:01.833 INFO:teuthology.orchestra.run.smithi092.stdout:checking for a sed that does not truncate output... /bin/sed 2024-09-11T00:16:01.835 INFO:teuthology.orchestra.run.smithi092.stdout:checking for grep that handles long lines and -e... /bin/grep 2024-09-11T00:16:01.836 INFO:teuthology.orchestra.run.smithi092.stdout:checking for egrep... /bin/grep -E 2024-09-11T00:16:01.837 INFO:teuthology.orchestra.run.smithi092.stdout:checking for fgrep... /bin/grep -F 2024-09-11T00:16:01.840 INFO:teuthology.orchestra.run.smithi092.stdout:checking for ld used by gcc... /bin/ld 2024-09-11T00:16:01.842 INFO:teuthology.orchestra.run.smithi092.stdout:checking if the linker (/bin/ld) is GNU ld... yes 2024-09-11T00:16:01.848 INFO:teuthology.orchestra.run.smithi092.stdout:checking for BSD- or MS-compatible name lister (nm)... /bin/nm -B 2024-09-11T00:16:02.809 INFO:teuthology.orchestra.run.smithi092.stdout:checking the name lister (/bin/nm -B) interface... BSD nm 2024-09-11T00:16:02.809 INFO:teuthology.orchestra.run.smithi092.stdout:checking whether ln -s works... yes 2024-09-11T00:16:02.819 INFO:teuthology.orchestra.run.smithi092.stdout:checking the maximum length of command line arguments... 1572864 2024-09-11T00:16:02.824 INFO:teuthology.orchestra.run.smithi092.stdout:checking how to convert x86_64-pc-linux-gnu file names to x86_64-pc-linux-gnu format... func_convert_file_noop 2024-09-11T00:16:02.824 INFO:teuthology.orchestra.run.smithi092.stdout:checking how to convert x86_64-pc-linux-gnu file names to toolchain format... func_convert_file_noop 2024-09-11T00:16:02.824 INFO:teuthology.orchestra.run.smithi092.stdout:checking for /bin/ld option to reload object files... -r 2024-09-11T00:16:02.824 INFO:teuthology.orchestra.run.smithi092.stdout:checking for objdump... objdump 2024-09-11T00:16:02.825 INFO:teuthology.orchestra.run.smithi092.stdout:checking how to recognize dependent libraries... pass_all 2024-09-11T00:16:02.825 INFO:teuthology.orchestra.run.smithi092.stdout:checking for dlltool... no 2024-09-11T00:16:02.825 INFO:teuthology.orchestra.run.smithi092.stdout:checking how to associate runtime and link libraries... printf %s\n 2024-09-11T00:16:02.825 INFO:teuthology.orchestra.run.smithi092.stdout:checking for ar... ar 2024-09-11T00:16:02.879 INFO:teuthology.orchestra.run.smithi092.stdout:checking for archiver @FILE support... @ 2024-09-11T00:16:02.879 INFO:teuthology.orchestra.run.smithi092.stdout:checking for strip... strip 2024-09-11T00:16:02.879 INFO:teuthology.orchestra.run.smithi092.stdout:checking for ranlib... ranlib 2024-09-11T00:16:02.880 INFO:teuthology.orchestra.run.smithi092.stdout:checking for gawk... gawk 2024-09-11T00:16:02.948 INFO:teuthology.orchestra.run.smithi092.stdout:checking command to parse /bin/nm -B output from gcc object... ok 2024-09-11T00:16:02.949 INFO:teuthology.orchestra.run.smithi092.stdout:checking for sysroot... no 2024-09-11T00:16:02.949 INFO:teuthology.orchestra.run.smithi092.stdout:checking for a working dd... /bin/dd 2024-09-11T00:16:02.951 INFO:teuthology.orchestra.run.smithi092.stdout:checking how to truncate binary pipes... /bin/dd bs=4096 count=1 2024-09-11T00:16:02.965 INFO:teuthology.orchestra.run.smithi092.stdout:checking for mt... no 2024-09-11T00:16:02.967 INFO:teuthology.orchestra.run.smithi092.stdout:checking if : is a manifest tool... no 2024-09-11T00:16:03.036 INFO:teuthology.orchestra.run.smithi092.stdout:checking how to run the C preprocessor... gcc -E 2024-09-11T00:16:03.206 INFO:teuthology.orchestra.run.smithi092.stdout:checking for ANSI C header files... yes 2024-09-11T00:16:03.227 INFO:teuthology.orchestra.run.smithi092.stdout:checking for sys/types.h... yes 2024-09-11T00:16:03.259 INFO:teuthology.orchestra.run.smithi092.stdout:checking for sys/stat.h... yes 2024-09-11T00:16:03.283 INFO:teuthology.orchestra.run.smithi092.stdout:checking for stdlib.h... yes 2024-09-11T00:16:03.307 INFO:teuthology.orchestra.run.smithi092.stdout:checking for string.h... yes 2024-09-11T00:16:03.333 INFO:teuthology.orchestra.run.smithi092.stdout:checking for memory.h... yes 2024-09-11T00:16:03.358 INFO:teuthology.orchestra.run.smithi092.stdout:checking for strings.h... yes 2024-09-11T00:16:03.395 INFO:teuthology.orchestra.run.smithi092.stdout:checking for inttypes.h... yes 2024-09-11T00:16:03.421 INFO:teuthology.orchestra.run.smithi092.stdout:checking for stdint.h... yes 2024-09-11T00:16:03.451 INFO:teuthology.orchestra.run.smithi092.stdout:checking for unistd.h... yes 2024-09-11T00:16:03.494 INFO:teuthology.orchestra.run.smithi092.stdout:checking for dlfcn.h... yes 2024-09-11T00:16:03.497 INFO:teuthology.orchestra.run.smithi092.stdout:checking for objdir... .libs 2024-09-11T00:16:03.561 INFO:teuthology.orchestra.run.smithi092.stdout:checking if gcc supports -fno-rtti -fno-exceptions... no 2024-09-11T00:16:03.561 INFO:teuthology.orchestra.run.smithi092.stdout:checking for gcc option to produce PIC... -fPIC -DPIC 2024-09-11T00:16:03.575 INFO:teuthology.orchestra.run.smithi092.stdout:checking if gcc PIC flag -fPIC -DPIC works... yes 2024-09-11T00:16:03.611 INFO:teuthology.orchestra.run.smithi092.stdout:checking if gcc static flag -static works... no 2024-09-11T00:16:03.632 INFO:teuthology.orchestra.run.smithi092.stdout:checking if gcc supports -c -o file.o... yes 2024-09-11T00:16:03.632 INFO:teuthology.orchestra.run.smithi092.stdout:checking if gcc supports -c -o file.o... (cached) yes 2024-09-11T00:16:03.639 INFO:teuthology.orchestra.run.smithi092.stdout:checking whether the gcc linker (/bin/ld -m elf_x86_64) supports shared libraries... yes 2024-09-11T00:16:03.679 INFO:teuthology.orchestra.run.smithi092.stdout:checking whether -lc should be explicitly linked in... no 2024-09-11T00:16:03.725 INFO:teuthology.orchestra.run.smithi092.stdout:checking dynamic linker characteristics... GNU/Linux ld.so 2024-09-11T00:16:03.726 INFO:teuthology.orchestra.run.smithi092.stdout:checking how to hardcode library paths into programs... immediate 2024-09-11T00:16:03.727 INFO:teuthology.orchestra.run.smithi092.stdout:checking whether stripping libraries is possible... yes 2024-09-11T00:16:03.727 INFO:teuthology.orchestra.run.smithi092.stdout:checking if libtool supports shared libraries... yes 2024-09-11T00:16:03.727 INFO:teuthology.orchestra.run.smithi092.stdout:checking whether to build shared libraries... yes 2024-09-11T00:16:03.727 INFO:teuthology.orchestra.run.smithi092.stdout:checking whether to build static libraries... yes 2024-09-11T00:16:03.732 INFO:teuthology.orchestra.run.smithi092.stdout:checking for gcc... (cached) gcc 2024-09-11T00:16:03.748 INFO:teuthology.orchestra.run.smithi092.stdout:checking whether we are using the GNU C compiler... (cached) yes 2024-09-11T00:16:03.748 INFO:teuthology.orchestra.run.smithi092.stdout:checking whether gcc accepts -g... (cached) yes 2024-09-11T00:16:03.748 INFO:teuthology.orchestra.run.smithi092.stdout:checking for gcc option to accept ISO C89... (cached) none needed 2024-09-11T00:16:03.748 INFO:teuthology.orchestra.run.smithi092.stdout:checking for gmake... /usr/bin/gmake 2024-09-11T00:16:03.749 INFO:teuthology.orchestra.run.smithi092.stderr:./configure: line 12082: test: $(SHELL): binary operator expected 2024-09-11T00:16:03.750 INFO:teuthology.orchestra.run.smithi092.stdout:checking for tar... /bin/tar 2024-09-11T00:16:03.750 INFO:teuthology.orchestra.run.smithi092.stdout:checking for gzip... /bin/gzip 2024-09-11T00:16:03.764 INFO:teuthology.orchestra.run.smithi092.stdout:checking whether gcc -MM is supported... yes 2024-09-11T00:16:03.764 INFO:teuthology.orchestra.run.smithi092.stdout:checking for sort... /bin/sort 2024-09-11T00:16:03.764 INFO:teuthology.orchestra.run.smithi092.stdout:checking whether ln -s works... yes 2024-09-11T00:16:03.764 INFO:teuthology.orchestra.run.smithi092.stdout:checking for rpm... /bin/rpm 2024-09-11T00:16:03.767 INFO:teuthology.orchestra.run.smithi092.stdout:checking for rpmbuild... no 2024-09-11T00:16:03.793 INFO:teuthology.orchestra.run.smithi092.stdout:checking assert.h usability... yes 2024-09-11T00:16:03.801 INFO:teuthology.orchestra.run.smithi092.stdout:checking assert.h presence... yes 2024-09-11T00:16:03.801 INFO:teuthology.orchestra.run.smithi092.stdout:checking for assert.h... yes 2024-09-11T00:16:03.828 INFO:teuthology.orchestra.run.smithi092.stdout:checking bstring.h usability... no 2024-09-11T00:16:03.838 INFO:teuthology.orchestra.run.smithi092.stdout:checking bstring.h presence... no 2024-09-11T00:16:03.839 INFO:teuthology.orchestra.run.smithi092.stdout:checking for bstring.h... no 2024-09-11T00:16:03.863 INFO:teuthology.orchestra.run.smithi092.stdout:checking libgen.h usability... yes 2024-09-11T00:16:03.872 INFO:teuthology.orchestra.run.smithi092.stdout:checking libgen.h presence... yes 2024-09-11T00:16:03.872 INFO:teuthology.orchestra.run.smithi092.stdout:checking for libgen.h... yes 2024-09-11T00:16:03.900 INFO:teuthology.orchestra.run.smithi092.stdout:checking dirent.h usability... yes 2024-09-11T00:16:03.910 INFO:teuthology.orchestra.run.smithi092.stdout:checking dirent.h presence... yes 2024-09-11T00:16:03.910 INFO:teuthology.orchestra.run.smithi092.stdout:checking for dirent.h... yes 2024-09-11T00:16:03.967 INFO:teuthology.orchestra.run.smithi092.stdout:checking errno.h usability... yes 2024-09-11T00:16:03.976 INFO:teuthology.orchestra.run.smithi092.stdout:checking errno.h presence... yes 2024-09-11T00:16:03.976 INFO:teuthology.orchestra.run.smithi092.stdout:checking for errno.h... yes 2024-09-11T00:16:04.004 INFO:teuthology.orchestra.run.smithi092.stdout:checking malloc.h usability... yes 2024-09-11T00:16:04.014 INFO:teuthology.orchestra.run.smithi092.stdout:checking malloc.h presence... yes 2024-09-11T00:16:04.014 INFO:teuthology.orchestra.run.smithi092.stdout:checking for malloc.h... yes 2024-09-11T00:16:04.041 INFO:teuthology.orchestra.run.smithi092.stdout:checking uuid.h usability... no 2024-09-11T00:16:04.051 INFO:teuthology.orchestra.run.smithi092.stdout:checking uuid.h presence... no 2024-09-11T00:16:04.052 INFO:teuthology.orchestra.run.smithi092.stdout:checking for uuid.h... no 2024-09-11T00:16:04.097 INFO:teuthology.orchestra.run.smithi092.stdout:checking uuid/uuid.h usability... yes 2024-09-11T00:16:04.107 INFO:teuthology.orchestra.run.smithi092.stdout:checking uuid/uuid.h presence... yes 2024-09-11T00:16:04.107 INFO:teuthology.orchestra.run.smithi092.stdout:checking for uuid/uuid.h... yes 2024-09-11T00:16:04.151 INFO:teuthology.orchestra.run.smithi092.stdout:checking sys/uuid.h usability... no 2024-09-11T00:16:04.161 INFO:teuthology.orchestra.run.smithi092.stdout:checking sys/uuid.h presence... no 2024-09-11T00:16:04.162 INFO:teuthology.orchestra.run.smithi092.stdout:checking for sys/uuid.h... no 2024-09-11T00:16:04.199 INFO:teuthology.orchestra.run.smithi092.stdout:checking sys/file.h usability... yes 2024-09-11T00:16:04.208 INFO:teuthology.orchestra.run.smithi092.stdout:checking sys/file.h presence... yes 2024-09-11T00:16:04.208 INFO:teuthology.orchestra.run.smithi092.stdout:checking for sys/file.h... yes 2024-09-11T00:16:04.236 INFO:teuthology.orchestra.run.smithi092.stdout:checking sys/fcntl.h usability... yes 2024-09-11T00:16:04.246 INFO:teuthology.orchestra.run.smithi092.stdout:checking sys/fcntl.h presence... yes 2024-09-11T00:16:04.246 INFO:teuthology.orchestra.run.smithi092.stdout:checking for sys/fcntl.h... yes 2024-09-11T00:16:04.273 INFO:teuthology.orchestra.run.smithi092.stdout:checking sys/syssgi.h usability... no 2024-09-11T00:16:04.284 INFO:teuthology.orchestra.run.smithi092.stdout:checking sys/syssgi.h presence... no 2024-09-11T00:16:04.284 INFO:teuthology.orchestra.run.smithi092.stdout:checking for sys/syssgi.h... no 2024-09-11T00:16:04.335 INFO:teuthology.orchestra.run.smithi092.stdout:checking sys/param.h usability... yes 2024-09-11T00:16:04.346 INFO:teuthology.orchestra.run.smithi092.stdout:checking sys/param.h presence... yes 2024-09-11T00:16:04.347 INFO:teuthology.orchestra.run.smithi092.stdout:checking for sys/param.h... yes 2024-09-11T00:16:04.351 INFO:teuthology.orchestra.run.smithi092.stdout:checking for sys/stat.h... (cached) yes 2024-09-11T00:16:04.380 INFO:teuthology.orchestra.run.smithi092.stdout:checking sys/statvfs.h usability... yes 2024-09-11T00:16:04.388 INFO:teuthology.orchestra.run.smithi092.stdout:checking sys/statvfs.h presence... yes 2024-09-11T00:16:04.388 INFO:teuthology.orchestra.run.smithi092.stdout:checking for sys/statvfs.h... yes 2024-09-11T00:16:04.416 INFO:teuthology.orchestra.run.smithi092.stdout:checking sys/time.h usability... yes 2024-09-11T00:16:04.425 INFO:teuthology.orchestra.run.smithi092.stdout:checking sys/time.h presence... yes 2024-09-11T00:16:04.425 INFO:teuthology.orchestra.run.smithi092.stdout:checking for sys/time.h... yes 2024-09-11T00:16:04.456 INFO:teuthology.orchestra.run.smithi092.stdout:checking sys/ioctl.h usability... yes 2024-09-11T00:16:04.465 INFO:teuthology.orchestra.run.smithi092.stdout:checking sys/ioctl.h presence... yes 2024-09-11T00:16:04.465 INFO:teuthology.orchestra.run.smithi092.stdout:checking for sys/ioctl.h... yes 2024-09-11T00:16:04.500 INFO:teuthology.orchestra.run.smithi092.stdout:checking sys/wait.h usability... yes 2024-09-11T00:16:04.510 INFO:teuthology.orchestra.run.smithi092.stdout:checking sys/wait.h presence... yes 2024-09-11T00:16:04.510 INFO:teuthology.orchestra.run.smithi092.stdout:checking for sys/wait.h... yes 2024-09-11T00:16:04.515 INFO:teuthology.orchestra.run.smithi092.stdout:checking for sys/types.h... (cached) yes 2024-09-11T00:16:04.519 INFO:teuthology.orchestra.run.smithi092.stdout:checking for strings.h... (cached) yes 2024-09-11T00:16:04.547 INFO:teuthology.orchestra.run.smithi092.stdout:checking err.h usability... yes 2024-09-11T00:16:04.556 INFO:teuthology.orchestra.run.smithi092.stdout:checking err.h presence... yes 2024-09-11T00:16:04.556 INFO:teuthology.orchestra.run.smithi092.stdout:checking for err.h... yes 2024-09-11T00:16:04.584 INFO:teuthology.orchestra.run.smithi092.stdout:checking linux/falloc.h usability... yes 2024-09-11T00:16:04.592 INFO:teuthology.orchestra.run.smithi092.stdout:checking linux/falloc.h presence... yes 2024-09-11T00:16:04.592 INFO:teuthology.orchestra.run.smithi092.stdout:checking for linux/falloc.h... yes 2024-09-11T00:16:04.619 INFO:teuthology.orchestra.run.smithi092.stdout:checking sys/fs/xfs_fsops.h usability... no 2024-09-11T00:16:04.630 INFO:teuthology.orchestra.run.smithi092.stdout:checking sys/fs/xfs_fsops.h presence... no 2024-09-11T00:16:04.630 INFO:teuthology.orchestra.run.smithi092.stdout:checking for sys/fs/xfs_fsops.h... no 2024-09-11T00:16:04.655 INFO:teuthology.orchestra.run.smithi092.stdout:checking sys/fs/xfs_itable.h usability... no 2024-09-11T00:16:04.665 INFO:teuthology.orchestra.run.smithi092.stdout:checking sys/fs/xfs_itable.h presence... no 2024-09-11T00:16:04.666 INFO:teuthology.orchestra.run.smithi092.stdout:checking for sys/fs/xfs_itable.h... no 2024-09-11T00:16:04.690 INFO:teuthology.orchestra.run.smithi092.stdout:checking xfs/platform_defs.h usability... no 2024-09-11T00:16:04.701 INFO:teuthology.orchestra.run.smithi092.stdout:checking xfs/platform_defs.h presence... no 2024-09-11T00:16:04.701 INFO:teuthology.orchestra.run.smithi092.stdout:checking for xfs/platform_defs.h... no 2024-09-11T00:16:04.725 INFO:teuthology.orchestra.run.smithi092.stdout:checking btrfs/ioctl.h usability... no 2024-09-11T00:16:04.737 INFO:teuthology.orchestra.run.smithi092.stdout:checking btrfs/ioctl.h presence... no 2024-09-11T00:16:04.737 INFO:teuthology.orchestra.run.smithi092.stdout:checking for btrfs/ioctl.h... no 2024-09-11T00:16:04.761 INFO:teuthology.orchestra.run.smithi092.stdout:checking cifs/ioctl.h usability... no 2024-09-11T00:16:04.772 INFO:teuthology.orchestra.run.smithi092.stdout:checking cifs/ioctl.h presence... no 2024-09-11T00:16:04.772 INFO:teuthology.orchestra.run.smithi092.stdout:checking for cifs/ioctl.h... no 2024-09-11T00:16:04.807 INFO:teuthology.orchestra.run.smithi092.stdout:checking sys/mman.h usability... yes 2024-09-11T00:16:04.816 INFO:teuthology.orchestra.run.smithi092.stdout:checking sys/mman.h presence... yes 2024-09-11T00:16:04.817 INFO:teuthology.orchestra.run.smithi092.stdout:checking for sys/mman.h... yes 2024-09-11T00:16:04.844 INFO:teuthology.orchestra.run.smithi092.stdout:checking linux/ext4.h usability... no 2024-09-11T00:16:04.855 INFO:teuthology.orchestra.run.smithi092.stdout:checking linux/ext4.h presence... no 2024-09-11T00:16:04.855 INFO:teuthology.orchestra.run.smithi092.stdout:checking for linux/ext4.h... no 2024-09-11T00:16:04.867 INFO:teuthology.orchestra.run.smithi092.stdout:checking for xfs/xfs_log_format.h... no 2024-09-11T00:16:04.913 INFO:teuthology.orchestra.run.smithi092.stdout:checking for uuid_compare... no 2024-09-11T00:16:04.945 INFO:teuthology.orchestra.run.smithi092.stdout:checking for uuid_compare in -luuid... yes 2024-09-11T00:16:05.002 INFO:teuthology.orchestra.run.smithi092.stdout:checking for xfs/xfs.h... yes 2024-09-11T00:16:05.015 INFO:teuthology.orchestra.run.smithi092.stdout:checking for xfs/libxfs.h... no 2024-09-11T00:16:05.030 INFO:teuthology.orchestra.run.smithi092.stdout:checking whether xlog_assign_lsn is declared... no 2024-09-11T00:16:05.060 INFO:teuthology.orchestra.run.smithi092.stdout:checking for xfs/xqm.h... yes 2024-09-11T00:16:05.110 INFO:teuthology.orchestra.run.smithi092.stdout:checking xfsctl from xfs/xfs.h... ok 2024-09-11T00:16:05.133 INFO:teuthology.orchestra.run.smithi092.stdout:checking xfs/handle.h usability... yes 2024-09-11T00:16:05.141 INFO:teuthology.orchestra.run.smithi092.stdout:checking xfs/handle.h presence... yes 2024-09-11T00:16:05.141 INFO:teuthology.orchestra.run.smithi092.stdout:checking for xfs/handle.h... yes 2024-09-11T00:16:05.179 INFO:teuthology.orchestra.run.smithi092.stdout:checking for attr_list_by_handle in -lhandle... yes 2024-09-11T00:16:05.209 INFO:teuthology.orchestra.run.smithi092.stdout:checking sys/acl.h usability... yes 2024-09-11T00:16:05.218 INFO:teuthology.orchestra.run.smithi092.stdout:checking sys/acl.h presence... yes 2024-09-11T00:16:05.218 INFO:teuthology.orchestra.run.smithi092.stdout:checking for sys/acl.h... yes 2024-09-11T00:16:05.250 INFO:teuthology.orchestra.run.smithi092.stdout:checking acl/libacl.h usability... yes 2024-09-11T00:16:05.260 INFO:teuthology.orchestra.run.smithi092.stdout:checking acl/libacl.h presence... yes 2024-09-11T00:16:05.260 INFO:teuthology.orchestra.run.smithi092.stdout:checking for acl/libacl.h... yes 2024-09-11T00:16:05.292 INFO:teuthology.orchestra.run.smithi092.stdout:checking for acl_init in -lacl... yes 2024-09-11T00:16:05.315 INFO:teuthology.orchestra.run.smithi092.stdout:checking gdbm-ndbm.h usability... no 2024-09-11T00:16:05.326 INFO:teuthology.orchestra.run.smithi092.stdout:checking gdbm-ndbm.h presence... no 2024-09-11T00:16:05.326 INFO:teuthology.orchestra.run.smithi092.stdout:checking for gdbm-ndbm.h... no 2024-09-11T00:16:05.349 INFO:teuthology.orchestra.run.smithi092.stdout:checking gdbm/ndbm.h usability... yes 2024-09-11T00:16:05.360 INFO:teuthology.orchestra.run.smithi092.stdout:checking gdbm/ndbm.h presence... yes 2024-09-11T00:16:05.360 INFO:teuthology.orchestra.run.smithi092.stdout:checking for gdbm/ndbm.h... yes 2024-09-11T00:16:05.395 INFO:teuthology.orchestra.run.smithi092.stdout:checking for dbm_open in -lgdbm... no 2024-09-11T00:16:05.433 INFO:teuthology.orchestra.run.smithi092.stdout:checking for dbm_fetch in -lgdbm... no 2024-09-11T00:16:05.470 INFO:teuthology.orchestra.run.smithi092.stdout:checking for dbm_store in -lgdbm... no 2024-09-11T00:16:05.505 INFO:teuthology.orchestra.run.smithi092.stdout:checking for dbm_close in -lgdbm... no 2024-09-11T00:16:05.548 INFO:teuthology.orchestra.run.smithi092.stdout:checking for dbm_open in -lgdbm_compat... yes 2024-09-11T00:16:05.579 INFO:teuthology.orchestra.run.smithi092.stdout:checking for dbm_fetch in -lgdbm_compat... yes 2024-09-11T00:16:05.611 INFO:teuthology.orchestra.run.smithi092.stdout:checking for dbm_store in -lgdbm_compat... yes 2024-09-11T00:16:05.643 INFO:teuthology.orchestra.run.smithi092.stdout:checking for dbm_close in -lgdbm_compat... yes 2024-09-11T00:16:05.668 INFO:teuthology.orchestra.run.smithi092.stdout:checking libaio.h usability... yes 2024-09-11T00:16:05.678 INFO:teuthology.orchestra.run.smithi092.stdout:checking libaio.h presence... yes 2024-09-11T00:16:05.678 INFO:teuthology.orchestra.run.smithi092.stdout:checking for libaio.h... yes 2024-09-11T00:16:05.701 INFO:teuthology.orchestra.run.smithi092.stdout:checking liburing.h usability... no 2024-09-11T00:16:05.713 INFO:teuthology.orchestra.run.smithi092.stdout:checking liburing.h presence... no 2024-09-11T00:16:05.713 INFO:teuthology.orchestra.run.smithi092.stdout:checking for liburing.h... no 2024-09-11T00:16:05.737 INFO:teuthology.orchestra.run.smithi092.stdout:checking sys/capability.h usability... yes 2024-09-11T00:16:05.747 INFO:teuthology.orchestra.run.smithi092.stdout:checking sys/capability.h presence... yes 2024-09-11T00:16:05.748 INFO:teuthology.orchestra.run.smithi092.stdout:checking for sys/capability.h... yes 2024-09-11T00:16:05.772 INFO:teuthology.orchestra.run.smithi092.stdout:checking linux/fiemap.h usability... yes 2024-09-11T00:16:05.780 INFO:teuthology.orchestra.run.smithi092.stdout:checking linux/fiemap.h presence... yes 2024-09-11T00:16:05.780 INFO:teuthology.orchestra.run.smithi092.stdout:checking for linux/fiemap.h... yes 2024-09-11T00:16:05.814 INFO:teuthology.orchestra.run.smithi092.stdout:checking for fallocate... yes 2024-09-11T00:16:05.849 INFO:teuthology.orchestra.run.smithi092.stdout:checking for open_by_handle_at... yes 2024-09-11T00:16:05.873 INFO:teuthology.orchestra.run.smithi092.stdout:checking linux/fs.h usability... yes 2024-09-11T00:16:05.882 INFO:teuthology.orchestra.run.smithi092.stdout:checking linux/fs.h presence... yes 2024-09-11T00:16:05.882 INFO:teuthology.orchestra.run.smithi092.stdout:checking for linux/fs.h... yes 2024-09-11T00:16:05.904 INFO:teuthology.orchestra.run.smithi092.stdout:checking btrfsutil.h usability... no 2024-09-11T00:16:05.916 INFO:teuthology.orchestra.run.smithi092.stdout:checking btrfsutil.h presence... no 2024-09-11T00:16:05.916 INFO:teuthology.orchestra.run.smithi092.stdout:checking for btrfsutil.h... no 2024-09-11T00:16:05.952 INFO:teuthology.orchestra.run.smithi092.stdout:checking for copy_file_range... yes 2024-09-11T00:16:05.988 INFO:teuthology.orchestra.run.smithi092.stdout:checking for SEEK_DATA... yes 2024-09-11T00:16:06.037 INFO:teuthology.orchestra.run.smithi092.stdout:checking for BMV_OF_SHARED... yes 2024-09-11T00:16:06.074 INFO:teuthology.orchestra.run.smithi092.stdout:checking for nftw... yes 2024-09-11T00:16:06.113 INFO:teuthology.orchestra.run.smithi092.stdout:checking for RLIMIT_NOFILE... yes 2024-09-11T00:16:06.146 INFO:teuthology.orchestra.run.smithi092.stdout:checking for new enough XFS_IOC_EXCHANGE_RANGE... no 2024-09-11T00:16:06.179 INFO:teuthology.orchestra.run.smithi092.stdout:checking for FICLONE... yes 2024-09-11T00:16:06.213 INFO:teuthology.orchestra.run.smithi092.stdout:checking for renameat2... yes 2024-09-11T00:16:06.247 INFO:teuthology.orchestra.run.smithi092.stdout:checking for reallocarray... yes 2024-09-11T00:16:06.278 INFO:teuthology.orchestra.run.smithi092.stdout:checking for struct mount_attr... yes 2024-09-11T00:16:06.313 INFO:teuthology.orchestra.run.smithi092.stdout:checking for struct btrfs_qgroup_limit... yes 2024-09-11T00:16:06.346 INFO:teuthology.orchestra.run.smithi092.stdout:checking for struct btrfs_qgroup_inherit... yes 2024-09-11T00:16:06.379 INFO:teuthology.orchestra.run.smithi092.stdout:checking for struct btrfs_ioctl_vol_args... yes 2024-09-11T00:16:06.413 INFO:teuthology.orchestra.run.smithi092.stdout:checking for struct btrfs_ioctl_vol_args_v2... yes 2024-09-11T00:16:06.445 INFO:teuthology.orchestra.run.smithi092.stdout:checking for struct btrfs_ioctl_ino_lookup_args... yes 2024-09-11T00:16:06.478 INFO:teuthology.orchestra.run.smithi092.stdout:checking for struct btrfs_ioctl_ino_lookup_user_args... yes 2024-09-11T00:16:06.511 INFO:teuthology.orchestra.run.smithi092.stdout:checking for struct btrfs_ioctl_get_subvol_rootref_args... yes 2024-09-11T00:16:06.537 INFO:teuthology.orchestra.run.smithi092.stdout:checking linux/btrfs.h usability... yes 2024-09-11T00:16:06.546 INFO:teuthology.orchestra.run.smithi092.stdout:checking linux/btrfs.h presence... yes 2024-09-11T00:16:06.546 INFO:teuthology.orchestra.run.smithi092.stdout:checking for linux/btrfs.h... yes 2024-09-11T00:16:06.576 INFO:teuthology.orchestra.run.smithi092.stdout:checking linux/btrfs_tree.h usability... yes 2024-09-11T00:16:06.585 INFO:teuthology.orchestra.run.smithi092.stdout:checking linux/btrfs_tree.h presence... yes 2024-09-11T00:16:06.585 INFO:teuthology.orchestra.run.smithi092.stdout:checking for linux/btrfs_tree.h... yes 2024-09-11T00:16:06.606 INFO:teuthology.orchestra.run.smithi092.stdout:checking for struct btrfs_ioctl_vol_args_v2.subvolid... yes 2024-09-11T00:16:06.628 INFO:teuthology.orchestra.run.smithi092.stdout:checking whether BTRFS_IOC_SNAP_DESTROY_V2 is declared... yes 2024-09-11T00:16:06.644 INFO:teuthology.orchestra.run.smithi092.stdout:configure: creating ./config.status 2024-09-11T00:16:06.936 INFO:teuthology.orchestra.run.smithi092.stdout:config.status: creating include/builddefs 2024-09-11T00:16:06.947 INFO:teuthology.orchestra.run.smithi092.stdout:config.status: creating include/config.h 2024-09-11T00:16:06.955 INFO:teuthology.orchestra.run.smithi092.stdout:config.status: executing libtool commands 2024-09-11T00:16:06.993 INFO:teuthology.orchestra.run.smithi092.stdout:Building include 2024-09-11T00:16:06.996 INFO:teuthology.orchestra.run.smithi092.stdout:Building lib 2024-09-11T00:16:07.000 INFO:teuthology.orchestra.run.smithi092.stdout: [LTDEP] 2024-09-11T00:16:07.136 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] dataascii.lo 2024-09-11T00:16:07.252 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] databin.lo 2024-09-11T00:16:07.386 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] datapid.lo 2024-09-11T00:16:07.481 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] file_lock.lo 2024-09-11T00:16:07.615 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] forker.lo 2024-09-11T00:16:07.735 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] pattern.lo 2024-09-11T00:16:07.845 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] open_flags.lo 2024-09-11T00:16:07.971 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] random_range.lo 2024-09-11T00:16:08.178 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] string_to_tokens.lo 2024-09-11T00:16:08.271 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] str_to_bytes.lo 2024-09-11T00:16:08.403 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] tlibio.lo 2024-09-11T00:16:08.619 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] write_log.lo 2024-09-11T00:16:08.835 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] random.lo 2024-09-11T00:16:08.932 INFO:teuthology.orchestra.run.smithi092.stdout: [LD] 2024-09-11T00:16:09.016 INFO:teuthology.orchestra.run.smithi092.stdout:Building ltp 2024-09-11T00:16:09.018 INFO:teuthology.orchestra.run.smithi092.stdout: [DEP] 2024-09-11T00:16:09.147 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] doio 2024-09-11T00:16:09.754 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] fsstress 2024-09-11T00:16:11.067 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] fsx 2024-09-11T00:16:11.735 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] growfiles 2024-09-11T00:16:12.193 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] iogen 2024-09-11T00:16:12.533 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] aio-stress 2024-09-11T00:16:12.919 INFO:teuthology.orchestra.run.smithi092.stdout:Building src 2024-09-11T00:16:12.925 INFO:teuthology.orchestra.run.smithi092.stdout: [DEP] 2024-09-11T00:16:14.689 INFO:teuthology.orchestra.run.smithi092.stdout: [DEP] 2024-09-11T00:16:14.719 INFO:teuthology.orchestra.run.smithi092.stdout: [DEP] 2024-09-11T00:16:14.727 INFO:teuthology.orchestra.run.smithi092.stdout: [DEP] 2024-09-11T00:16:14.938 INFO:teuthology.orchestra.run.smithi092.stdout: [DEP] 2024-09-11T00:16:14.959 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] dirstress 2024-09-11T00:16:15.166 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] fill 2024-09-11T00:16:15.299 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] fill2 2024-09-11T00:16:15.498 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] getpagesize 2024-09-11T00:16:15.614 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] holes 2024-09-11T00:16:15.783 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] lstat64 2024-09-11T00:16:15.942 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] nametest 2024-09-11T00:16:16.152 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] permname 2024-09-11T00:16:16.328 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] randholes 2024-09-11T00:16:16.547 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] runas 2024-09-11T00:16:16.675 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T00:16:16.678 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T00:16:16.698 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] truncfile 2024-09-11T00:16:16.851 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] usemem 2024-09-11T00:16:16.980 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] mmapcat 2024-09-11T00:16:17.107 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] append_reader 2024-09-11T00:16:17.235 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] append_writer 2024-09-11T00:16:17.364 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] dirperf 2024-09-11T00:16:17.561 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] metaperf 2024-09-11T00:16:17.806 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] devzero 2024-09-11T00:16:17.956 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] feature 2024-09-11T00:16:18.144 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] alloc 2024-09-11T00:16:18.327 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] fault 2024-09-11T00:16:18.466 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] fstest 2024-09-11T00:16:18.671 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] t_access_root 2024-09-11T00:16:18.804 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] godown 2024-09-11T00:16:18.948 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] resvtest 2024-09-11T00:16:19.108 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] writemod 2024-09-11T00:16:19.231 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] writev_on_pagefault 2024-09-11T00:16:19.368 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] makeextents 2024-09-11T00:16:19.520 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] itrash 2024-09-11T00:16:19.651 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] rename 2024-09-11T00:16:19.769 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] multi_open_unlink 2024-09-11T00:16:19.911 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] unwritten_sync 2024-09-11T00:16:20.065 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] genhashnames 2024-09-11T00:16:20.234 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] t_holes 2024-09-11T00:16:20.359 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] t_mmap_writev 2024-09-11T00:16:20.486 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] t_truncate_cmtime 2024-09-11T00:16:20.623 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] dirhash_collide 2024-09-11T00:16:20.787 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] t_rename_overwrite 2024-09-11T00:16:20.907 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] holetest 2024-09-11T00:16:21.106 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] t_truncate_self 2024-09-11T00:16:21.226 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] af_unix 2024-09-11T00:16:21.356 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] t_mmap_stale_pmd 2024-09-11T00:16:21.487 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] t_mmap_cow_race 2024-09-11T00:16:21.629 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] t_mmap_fallocate 2024-09-11T00:16:21.759 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] fsync-err 2024-09-11T00:16:21.918 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] t_mmap_write_ro 2024-09-11T00:16:22.049 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] t_ext4_dax_journal_corruption 2024-09-11T00:16:22.184 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] t_ext4_dax_inline_corruption 2024-09-11T00:16:22.317 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] t_ofd_locks 2024-09-11T00:16:22.489 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] t_mmap_collision 2024-09-11T00:16:22.662 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] mmap-write-concurrent 2024-09-11T00:16:22.809 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] t_get_file_time 2024-09-11T00:16:22.934 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] t_create_short_dirs 2024-09-11T00:16:23.081 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] t_create_long_dirs 2024-09-11T00:16:23.225 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] t_enospc 2024-09-11T00:16:23.387 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] t_mmap_writev_overlap 2024-09-11T00:16:23.533 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] checkpoint_journal 2024-09-11T00:16:23.667 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] mmap-rw-fault 2024-09-11T00:16:23.827 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] allocstale 2024-09-11T00:16:23.971 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] t_mmap_cow_memory_failure 2024-09-11T00:16:24.118 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] fake-dump-rootino 2024-09-11T00:16:24.247 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] dio-buf-fault 2024-09-11T00:16:24.379 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] rewinddir-test 2024-09-11T00:16:24.527 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] readdir-while-renames 2024-09-11T00:16:24.669 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] dio-append-buf-fault 2024-09-11T00:16:24.807 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] xfsctl 2024-09-11T00:16:24.970 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] bstat 2024-09-11T00:16:25.151 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] t_mtab 2024-09-11T00:16:25.313 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] getdevicesize 2024-09-11T00:16:25.435 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] preallo_rw_pattern_reader 2024-09-11T00:16:25.570 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] preallo_rw_pattern_writer 2024-09-11T00:16:25.705 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] ftrunc 2024-09-11T00:16:25.832 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] trunc 2024-09-11T00:16:25.971 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] fs_perms 2024-09-11T00:16:26.111 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] testx 2024-09-11T00:16:26.223 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] looptest 2024-09-11T00:16:26.391 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] locktest 2024-09-11T00:16:26.669 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] unwritten_mmap 2024-09-11T00:16:26.809 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] bulkstat_unlink_test 2024-09-11T00:16:26.981 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] deduperace 2024-09-11T00:16:27.150 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] bulkstat_unlink_test_modified 2024-09-11T00:16:27.321 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] t_dir_offset 2024-09-11T00:16:27.449 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] t_futimens 2024-09-11T00:16:27.568 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] t_immutable 2024-09-11T00:16:28.127 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] stale_handle 2024-09-11T00:16:28.274 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] pwrite_mmap_blocked 2024-09-11T00:16:28.407 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] t_dir_offset2 2024-09-11T00:16:28.575 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] seek_sanity_test 2024-09-11T00:16:28.978 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] seek_copy_test 2024-09-11T00:16:29.131 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] t_readdir_1 2024-09-11T00:16:29.258 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] t_readdir_2 2024-09-11T00:16:29.389 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] fsync-tester 2024-09-11T00:16:29.610 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] nsexec 2024-09-11T00:16:29.763 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] cloner 2024-09-11T00:16:29.917 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] renameat2 2024-09-11T00:16:30.061 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] t_getcwd 2024-09-11T00:16:30.197 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] e4compact 2024-09-11T00:16:30.372 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] test-nextquota 2024-09-11T00:16:30.519 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] punch-alternating 2024-09-11T00:16:30.667 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] attr-list-by-handle-cursor-test 2024-09-11T00:16:30.810 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] listxattr 2024-09-11T00:16:30.937 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] dio-interleaved 2024-09-11T00:16:31.077 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] t_dir_type 2024-09-11T00:16:31.211 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] dio-invalidate-cache 2024-09-11T00:16:31.388 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] stat_test 2024-09-11T00:16:31.650 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] t_encrypted_d_revalidate 2024-09-11T00:16:31.792 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] attr_replace_test 2024-09-11T00:16:31.933 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] swapon 2024-09-11T00:16:32.076 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] mkswap 2024-09-11T00:16:32.207 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] t_attr_corruption 2024-09-11T00:16:32.336 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] t_open_tmpfiles 2024-09-11T00:16:32.494 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] fscrypt-crypt-util 2024-09-11T00:16:33.104 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] bulkstat_null_ocount 2024-09-11T00:16:33.239 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] splice-test 2024-09-11T00:16:33.397 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] chprojid_fail 2024-09-11T00:16:33.536 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] detached_mounts_propagation 2024-09-11T00:16:33.694 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] ext4_resize 2024-09-11T00:16:33.823 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] t_readdir_3 2024-09-11T00:16:33.992 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] splice2pipe 2024-09-11T00:16:34.131 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] uuid_ioctl 2024-09-11T00:16:34.268 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] t_snapshot_deleted_subvolume 2024-09-11T00:16:34.406 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] fiemap-fault 2024-09-11T00:16:34.541 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] min_dio_alignment 2024-09-11T00:16:34.673 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] fiemap-tester 2024-09-11T00:16:34.910 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] t_stripealign 2024-09-11T00:16:35.047 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] open_by_handle 2024-09-11T00:16:35.267 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] dbtest 2024-09-11T00:16:35.488 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] t_mmap_dio 2024-09-11T00:16:35.626 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] xfsfind 2024-09-11T00:16:35.795 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] t_reflink_read_race 2024-09-11T00:16:35.962 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] fssum 2024-09-11T00:16:36.360 INFO:teuthology.orchestra.run.smithi092.stdout:Building log-writes 2024-09-11T00:16:36.365 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] replay-log 2024-09-11T00:16:36.648 INFO:teuthology.orchestra.run.smithi092.stdout:Building perf 2024-09-11T00:16:36.651 INFO:teuthology.orchestra.run.smithi092.stdout:Building aio-dio-regress 2024-09-11T00:16:36.657 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] aiocp 2024-09-11T00:16:36.858 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] aio-dio-append-write-fallocate-race 2024-09-11T00:16:37.004 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] aio-dio-append-write-read-race 2024-09-11T00:16:37.154 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] aio-dio-cow-race 2024-09-11T00:16:37.285 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] aio-dio-cycle-write 2024-09-11T00:16:37.445 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] aio-dio-eof-race 2024-09-11T00:16:37.603 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] aio-dio-extend-stat 2024-09-11T00:16:37.743 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] aio-dio-fcntl-race 2024-09-11T00:16:37.884 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] aio-dio-hole-filling-race 2024-09-11T00:16:38.010 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] aio-dio-invalidate-failure 2024-09-11T00:16:38.147 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] aio-dio-invalidate-readahead 2024-09-11T00:16:38.289 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] aiodio_sparse2 2024-09-11T00:16:38.480 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] aio-dio-subblock-eof-read 2024-09-11T00:16:38.601 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] aio-dio-write-verify 2024-09-11T00:16:38.772 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] aio-free-ring-with-bogus-nr-pages 2024-09-11T00:16:38.885 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] aio-io-setup-with-nonwritable-context-pointer 2024-09-11T00:16:38.998 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] aio-last-ref-held-by-io 2024-09-11T00:16:39.148 INFO:teuthology.orchestra.run.smithi092.stdout:Building vfs 2024-09-11T00:16:39.153 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] vfstest 2024-09-11T00:16:42.449 INFO:teuthology.orchestra.run.smithi092.stdout: [CC] mount-idmapped 2024-09-11T00:16:42.792 INFO:teuthology.orchestra.run.smithi092.stdout:Building m4 2024-09-11T00:16:42.795 INFO:teuthology.orchestra.run.smithi092.stdout:Building common 2024-09-11T00:16:42.799 INFO:teuthology.orchestra.run.smithi092.stdout:Building tests 2024-09-11T00:16:42.804 INFO:teuthology.orchestra.run.smithi092.stdout:Building btrfs 2024-09-11T00:16:42.810 INFO:teuthology.orchestra.run.smithi092.stdout: [GROUP] /tmp/tmp.YVIfjesBePxfstests-dev/tests/btrfs/group.list 2024-09-11T00:16:42.873 INFO:teuthology.orchestra.run.smithi092.stdout:Building ceph 2024-09-11T00:16:42.878 INFO:teuthology.orchestra.run.smithi092.stdout: [GROUP] /tmp/tmp.YVIfjesBePxfstests-dev/tests/ceph/group.list 2024-09-11T00:16:42.892 INFO:teuthology.orchestra.run.smithi092.stdout:Building cifs 2024-09-11T00:16:42.897 INFO:teuthology.orchestra.run.smithi092.stdout: [GROUP] /tmp/tmp.YVIfjesBePxfstests-dev/tests/cifs/group.list 2024-09-11T00:16:42.910 INFO:teuthology.orchestra.run.smithi092.stdout:Building ext4 2024-09-11T00:16:42.916 INFO:teuthology.orchestra.run.smithi092.stdout: [GROUP] /tmp/tmp.YVIfjesBePxfstests-dev/tests/ext4/group.list 2024-09-11T00:16:42.955 INFO:teuthology.orchestra.run.smithi092.stdout:Building f2fs 2024-09-11T00:16:42.960 INFO:teuthology.orchestra.run.smithi092.stdout: [GROUP] /tmp/tmp.YVIfjesBePxfstests-dev/tests/f2fs/group.list 2024-09-11T00:16:42.978 INFO:teuthology.orchestra.run.smithi092.stdout:Building generic 2024-09-11T00:16:42.985 INFO:teuthology.orchestra.run.smithi092.stdout: [GROUP] /tmp/tmp.YVIfjesBePxfstests-dev/tests/generic/group.list 2024-09-11T00:16:43.086 INFO:teuthology.orchestra.run.smithi092.stdout:Building nfs 2024-09-11T00:16:43.091 INFO:teuthology.orchestra.run.smithi092.stdout: [GROUP] /tmp/tmp.YVIfjesBePxfstests-dev/tests/nfs/group.list 2024-09-11T00:16:43.106 INFO:teuthology.orchestra.run.smithi092.stdout:Building ocfs2 2024-09-11T00:16:43.111 INFO:teuthology.orchestra.run.smithi092.stdout: [GROUP] /tmp/tmp.YVIfjesBePxfstests-dev/tests/ocfs2/group.list 2024-09-11T00:16:43.124 INFO:teuthology.orchestra.run.smithi092.stdout:Building overlay 2024-09-11T00:16:43.129 INFO:teuthology.orchestra.run.smithi092.stdout: [GROUP] /tmp/tmp.YVIfjesBePxfstests-dev/tests/overlay/group.list 2024-09-11T00:16:43.171 INFO:teuthology.orchestra.run.smithi092.stdout:Building perf 2024-09-11T00:16:43.176 INFO:teuthology.orchestra.run.smithi092.stdout: [GROUP] /tmp/tmp.YVIfjesBePxfstests-dev/tests/perf/group.list 2024-09-11T00:16:43.187 INFO:teuthology.orchestra.run.smithi092.stdout:Building selftest 2024-09-11T00:16:43.192 INFO:teuthology.orchestra.run.smithi092.stdout: [GROUP] /tmp/tmp.YVIfjesBePxfstests-dev/tests/selftest/group.list 2024-09-11T00:16:43.205 INFO:teuthology.orchestra.run.smithi092.stdout:Building tmpfs 2024-09-11T00:16:43.210 INFO:teuthology.orchestra.run.smithi092.stdout: [GROUP] /tmp/tmp.YVIfjesBePxfstests-dev/tests/tmpfs/group.list 2024-09-11T00:16:43.224 INFO:teuthology.orchestra.run.smithi092.stdout:Building udf 2024-09-11T00:16:43.229 INFO:teuthology.orchestra.run.smithi092.stdout: [GROUP] /tmp/tmp.YVIfjesBePxfstests-dev/tests/udf/group.list 2024-09-11T00:16:43.240 INFO:teuthology.orchestra.run.smithi092.stdout:Building xfs 2024-09-11T00:16:43.247 INFO:teuthology.orchestra.run.smithi092.stdout: [GROUP] /tmp/tmp.YVIfjesBePxfstests-dev/tests/xfs/group.list 2024-09-11T00:16:43.350 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo make install) 2024-09-11T00:16:43.386 INFO:teuthology.orchestra.run.smithi092.stdout:Building include 2024-09-11T00:16:43.389 INFO:teuthology.orchestra.run.smithi092.stdout:Building lib 2024-09-11T00:16:43.393 INFO:teuthology.orchestra.run.smithi092.stdout:Building ltp 2024-09-11T00:16:43.398 INFO:teuthology.orchestra.run.smithi092.stdout:Building src 2024-09-11T00:16:43.432 INFO:teuthology.orchestra.run.smithi092.stdout:Building log-writes 2024-09-11T00:16:43.435 INFO:teuthology.orchestra.run.smithi092.stdout:Building perf 2024-09-11T00:16:43.439 INFO:teuthology.orchestra.run.smithi092.stdout:Building aio-dio-regress 2024-09-11T00:16:43.443 INFO:teuthology.orchestra.run.smithi092.stdout:Building vfs 2024-09-11T00:16:43.446 INFO:teuthology.orchestra.run.smithi092.stdout:Building m4 2024-09-11T00:16:43.450 INFO:teuthology.orchestra.run.smithi092.stdout:Building common 2024-09-11T00:16:43.453 INFO:teuthology.orchestra.run.smithi092.stdout:Building tests 2024-09-11T00:16:43.459 INFO:teuthology.orchestra.run.smithi092.stdout:Building btrfs 2024-09-11T00:16:43.465 INFO:teuthology.orchestra.run.smithi092.stdout: [GROUP] /tmp/tmp.YVIfjesBePxfstests-dev/tests/btrfs/group.list 2024-09-11T00:16:43.527 INFO:teuthology.orchestra.run.smithi092.stdout:Building ceph 2024-09-11T00:16:43.532 INFO:teuthology.orchestra.run.smithi092.stdout: [GROUP] /tmp/tmp.YVIfjesBePxfstests-dev/tests/ceph/group.list 2024-09-11T00:16:43.547 INFO:teuthology.orchestra.run.smithi092.stdout:Building cifs 2024-09-11T00:16:43.552 INFO:teuthology.orchestra.run.smithi092.stdout: [GROUP] /tmp/tmp.YVIfjesBePxfstests-dev/tests/cifs/group.list 2024-09-11T00:16:43.565 INFO:teuthology.orchestra.run.smithi092.stdout:Building ext4 2024-09-11T00:16:43.570 INFO:teuthology.orchestra.run.smithi092.stdout: [GROUP] /tmp/tmp.YVIfjesBePxfstests-dev/tests/ext4/group.list 2024-09-11T00:16:43.609 INFO:teuthology.orchestra.run.smithi092.stdout:Building f2fs 2024-09-11T00:16:43.614 INFO:teuthology.orchestra.run.smithi092.stdout: [GROUP] /tmp/tmp.YVIfjesBePxfstests-dev/tests/f2fs/group.list 2024-09-11T00:16:43.633 INFO:teuthology.orchestra.run.smithi092.stdout:Building generic 2024-09-11T00:16:43.639 INFO:teuthology.orchestra.run.smithi092.stdout: [GROUP] /tmp/tmp.YVIfjesBePxfstests-dev/tests/generic/group.list 2024-09-11T00:16:43.739 INFO:teuthology.orchestra.run.smithi092.stdout:Building nfs 2024-09-11T00:16:43.743 INFO:teuthology.orchestra.run.smithi092.stdout: [GROUP] /tmp/tmp.YVIfjesBePxfstests-dev/tests/nfs/group.list 2024-09-11T00:16:43.758 INFO:teuthology.orchestra.run.smithi092.stdout:Building ocfs2 2024-09-11T00:16:43.763 INFO:teuthology.orchestra.run.smithi092.stdout: [GROUP] /tmp/tmp.YVIfjesBePxfstests-dev/tests/ocfs2/group.list 2024-09-11T00:16:43.777 INFO:teuthology.orchestra.run.smithi092.stdout:Building overlay 2024-09-11T00:16:43.782 INFO:teuthology.orchestra.run.smithi092.stdout: [GROUP] /tmp/tmp.YVIfjesBePxfstests-dev/tests/overlay/group.list 2024-09-11T00:16:43.823 INFO:teuthology.orchestra.run.smithi092.stdout:Building perf 2024-09-11T00:16:43.828 INFO:teuthology.orchestra.run.smithi092.stdout: [GROUP] /tmp/tmp.YVIfjesBePxfstests-dev/tests/perf/group.list 2024-09-11T00:16:43.840 INFO:teuthology.orchestra.run.smithi092.stdout:Building selftest 2024-09-11T00:16:43.845 INFO:teuthology.orchestra.run.smithi092.stdout: [GROUP] /tmp/tmp.YVIfjesBePxfstests-dev/tests/selftest/group.list 2024-09-11T00:16:43.857 INFO:teuthology.orchestra.run.smithi092.stdout:Building tmpfs 2024-09-11T00:16:43.862 INFO:teuthology.orchestra.run.smithi092.stdout: [GROUP] /tmp/tmp.YVIfjesBePxfstests-dev/tests/tmpfs/group.list 2024-09-11T00:16:43.876 INFO:teuthology.orchestra.run.smithi092.stdout:Building udf 2024-09-11T00:16:43.881 INFO:teuthology.orchestra.run.smithi092.stdout: [GROUP] /tmp/tmp.YVIfjesBePxfstests-dev/tests/udf/group.list 2024-09-11T00:16:43.893 INFO:teuthology.orchestra.run.smithi092.stdout:Building xfs 2024-09-11T00:16:43.899 INFO:teuthology.orchestra.run.smithi092.stdout: [GROUP] /tmp/tmp.YVIfjesBePxfstests-dev/tests/xfs/group.list 2024-09-11T00:16:43.998 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/gmake --no-print-directory Q=@ -C include install 2024-09-11T00:16:43.999 INFO:teuthology.orchestra.run.smithi092.stdout:gmake[1]: Nothing to be done for 'install'. 2024-09-11T00:16:43.999 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/gmake --no-print-directory Q=@ -C lib install 2024-09-11T00:16:44.001 INFO:teuthology.orchestra.run.smithi092.stdout:gmake[1]: Nothing to be done for 'install'. 2024-09-11T00:16:44.002 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/gmake --no-print-directory Q=@ -C ltp install 2024-09-11T00:16:44.004 INFO:teuthology.orchestra.run.smithi092.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/ltp 2024-09-11T00:16:44.013 INFO:teuthology.orchestra.run.smithi092.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 doio fsstress fsx growfiles iogen aio-stress /var/lib/xfstests/ltp 2024-09-11T00:16:44.082 INFO:teuthology.orchestra.run.smithi092.stdout:../install-sh -o root -g root -m 755 rwtest.sh /var/lib/xfstests/ltp 2024-09-11T00:16:44.091 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/gmake --no-print-directory Q=@ -C src install 2024-09-11T00:16:44.108 INFO:teuthology.orchestra.run.smithi092.stdout:Building log-writes 2024-09-11T00:16:44.111 INFO:teuthology.orchestra.run.smithi092.stdout:Building perf 2024-09-11T00:16:44.115 INFO:teuthology.orchestra.run.smithi092.stdout:Building aio-dio-regress 2024-09-11T00:16:44.119 INFO:teuthology.orchestra.run.smithi092.stdout:Building vfs 2024-09-11T00:16:44.121 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/gmake -C log-writes install 2024-09-11T00:16:44.123 INFO:teuthology.orchestra.run.smithi092.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/log-writes 2024-09-11T00:16:44.132 INFO:teuthology.orchestra.run.smithi092.stdout:../../install-sh -o root -g root -m 755 replay-log /var/lib/xfstests/src/log-writes 2024-09-11T00:16:44.141 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/gmake -C perf install 2024-09-11T00:16:44.142 INFO:teuthology.orchestra.run.smithi092.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/perf 2024-09-11T00:16:44.151 INFO:teuthology.orchestra.run.smithi092.stdout:../../install-sh -o root -g root -m 755 FioCompare.py fio-insert-and-compare.py FioResultDecoder.py generate-schema.py ResultData.py fio-results.sql /var/lib/xfstests/src/perf 2024-09-11T00:16:44.171 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/gmake -C aio-dio-regress install 2024-09-11T00:16:44.173 INFO:teuthology.orchestra.run.smithi092.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/aio-dio-regress 2024-09-11T00:16:44.182 INFO:teuthology.orchestra.run.smithi092.stdout:../../install-sh -o root -g root -m 755 aiocp aio-dio-append-write-fallocate-race aio-dio-append-write-read-race aio-dio-cow-race aio-dio-cycle-write aio-dio-eof-race aio-dio-extend-stat aio-dio-fcntl-race aio-dio-hole-filling-race aio-dio-invalidate-failure aio-dio-invalidate-readahead aiodio_sparse2 aio-dio-subblock-eof-read aio-dio-write-verify aio-free-ring-with-bogus-nr-pages aio-io-setup-with-nonwritable-context-pointer aio-last-ref-held-by-io /var/lib/xfstests/src/aio-dio-regress 2024-09-11T00:16:44.232 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/gmake -C vfs install 2024-09-11T00:16:44.234 INFO:teuthology.orchestra.run.smithi092.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/vfs 2024-09-11T00:16:44.242 INFO:teuthology.orchestra.run.smithi092.stdout:../../install-sh -o root -g root -m 755 vfstest mount-idmapped /var/lib/xfstests/src/vfs 2024-09-11T00:16:44.255 INFO:teuthology.orchestra.run.smithi092.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src 2024-09-11T00:16:44.263 INFO:teuthology.orchestra.run.smithi092.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 dirstress fill fill2 getpagesize holes lstat64 nametest permname randholes runas truncfile usemem mmapcat append_reader append_writer dirperf metaperf devzero feature alloc fault fstest t_access_root godown resvtest writemod writev_on_pagefault makeextents itrash rename multi_open_unlink unwritten_sync genhashnames t_holes t_mmap_writev t_truncate_cmtime dirhash_collide t_rename_overwrite holetest t_truncate_self af_unix t_mmap_stale_pmd t_mmap_cow_race t_mmap_fallocate fsync-err t_mmap_write_ro t_ext4_dax_journal_corruption t_ext4_dax_inline_corruption t_ofd_locks t_mmap_collision mmap-write-concurrent t_get_file_time t_create_short_dirs t_create_long_dirs t_enospc t_mmap_writev_overlap checkpoint_journal mmap-rw-fault allocstale t_mmap_cow_memory_failure fake-dump-rootino dio-buf-fault rewinddir-test readdir-while-renames dio-append-buf-fault xfsctl bstat t_mtab getdevicesize preallo_rw_pattern_reader preallo_rw_pattern_writer ftrunc trunc fs_perms testx looptest locktest unwritten_mmap bulkstat_unlink_test deduperace bulkstat_unlink_test_modified t_dir_offset t_futimens t_immutable stale_handle pwrite_mmap_blocked t_dir_offset2 seek_sanity_test seek_copy_test t_readdir_1 t_readdir_2 fsync-tester nsexec cloner renameat2 t_getcwd e4compact test-nextquota punch-alternating attr-list-by-handle-cursor-test listxattr dio-interleaved t_dir_type dio-invalidate-cache stat_test t_encrypted_d_revalidate attr_replace_test swapon mkswap t_attr_corruption t_open_tmpfiles fscrypt-crypt-util bulkstat_null_ocount splice-test chprojid_fail detached_mounts_propagation ext4_resize t_readdir_3 splice2pipe uuid_ioctl t_snapshot_deleted_subvolume fiemap-fault min_dio_alignment fiemap-tester t_stripealign open_by_handle dbtest t_mmap_dio xfsfind t_reflink_read_race fssum /var/lib/xfstests/src 2024-09-11T00:16:45.456 INFO:teuthology.orchestra.run.smithi092.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 dmerror fill2attr fill2fs fill2fs_check scaleread.sh btrfs_crc32c_forged_name.py popdir.pl popattr.py soak_duration.awk /var/lib/xfstests/src 2024-09-11T00:16:45.551 INFO:teuthology.orchestra.run.smithi092.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 644 dumpfile /var/lib/xfstests/src 2024-09-11T00:16:45.575 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/gmake --no-print-directory Q=@ -C m4 install 2024-09-11T00:16:45.577 INFO:teuthology.orchestra.run.smithi092.stdout:gmake[1]: Nothing to be done for 'install'. 2024-09-11T00:16:45.577 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/gmake --no-print-directory Q=@ -C common install 2024-09-11T00:16:45.578 INFO:teuthology.orchestra.run.smithi092.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/common 2024-09-11T00:16:45.587 INFO:teuthology.orchestra.run.smithi092.stdout:../install-sh -o root -g root -m 644 * /var/lib/xfstests/common 2024-09-11T00:16:45.723 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/gmake --no-print-directory Q=@ -C tests install 2024-09-11T00:16:45.724 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.YVIfjesBePxfstests-dev/tests/btrfs/ install 2024-09-11T00:16:45.727 INFO:teuthology.orchestra.run.smithi092.stdout: [GROUP] /tmp/tmp.YVIfjesBePxfstests-dev/tests/btrfs/group.list 2024-09-11T00:16:45.791 INFO:teuthology.orchestra.run.smithi092.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/btrfs 2024-09-11T00:16:45.800 INFO:teuthology.orchestra.run.smithi092.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 303 304 305 306 307 308 309 310 311 312 313 314 315 316 317 318 319 320 330 331 332 /var/lib/xfstests/tests/btrfs 2024-09-11T00:16:46.638 INFO:teuthology.orchestra.run.smithi092.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/btrfs 2024-09-11T00:16:46.646 INFO:teuthology.orchestra.run.smithi092.stdout:../../install-sh -o root -g root -m 644 001.out 002.out 003.out 004.out 005.out 006.out 007.out 008.out 009.out 010.out 011.out 012.out 013.out 014.out 015.out 016.out 017.out 018.out 019.out 020.out 021.out 022.out 023.out 024.out 025.out 026.out 027.out 028.out 029.out 030.out 031.out 032.out 033.out 034.out 035.out 036.out 037.out 038.out 039.out 040.out 041.out 042.out 043.out 044.out 045.out 046.out 047.out 048.out 049.out 050.out 051.out 052.out 053.out 054.out 055.out 056.out 057.out 058.out 059.out 060.out 061.out 062.out 063.out 064.out 065.out 066.out 067.out 068.out 069.out 070.out 071.out 072.out 073.out 074.out 075.out 076.out 077.out 078.out 079.out 080.out 081.out 082.out 083.out 084.out 085.out 086.out 087.out 088.out 089.out 090.out 091.out 092.out 093.out 094.out 095.out 096.out 097.out 098.out 099.out 100.out 101.out 102.out 103.out 104.out 105.out 106.out 107.out 108.out 109.out 110.out 111.out 112.out 113.out 114.out 115.out 116.out 117.out 118.out 119.out 120.out 121.out 122.out 123.out 124.out 125.out 126.out 127.out 128.out 129.out 130.out 131.out 132.out 133.out 134.out 135.out 136.out 137.out 138.out 139.out 140.out 141.out 142.out 143.out 144.out 145.out 146.out 147.out 148.out 149.out 150.out 151.out 152.out 153.out 154.out 155.out 156.out 157.out 158.out 159.out 160.out 161.out 162.out 163.out 164.out 165.out 166.out 167.out 168.out 169.out 170.out 171.out 172.out 173.out 174.out 175.out 176.out 177.out 178.out 179.out 180.out 181.out 182.out 183.out 184.out 185.out 186.out 187.out 188.out 189.out 190.out 191.out 192.out 193.out 194.out 195.out 196.out 197.out 198.out 199.out 200.out 201.out 202.out 203.out 204.out 205.out 206.out 207.out 208.out 209.out 210.out 211.out 212.out 213.out 214.out 215.out 216.out 217.out 218.out 219.out 220.out 221.out 222.out 223.out 224.out 225.out 226.out 227.out 228.out 229.out 230.out 231.out 232.out 233.out 234.out 235.out 236.out 237.out 238.out 239.out 240.out 241.out 242.out 243.out 244.out 245.out 246.out 247.out 248.out 249.out 250.out 251.out 252.out 253.out 254.out 255.out 256.out 257.out 258.out 259.out 260.out 261.out 262.out 263.out 264.out 265.out 266.out 267.out 268.out 269.out 270.out 271.out 272.out 273.out 274.out 275.out 276.out 277.out 278.out 279.out 280.out 281.out 282.out 283.out 284.out 285.out 286.out 287.out 288.out 289.out 290.out 291.out 292.out 293.out 294.out 295.out 296.out 297.out 298.out 299.out 300.out 301.out 302.out 303.out 304.out 305.out 306.out 307.out 308.out 309.out 310.out 311.out 312.out 313.out 314.out 315.out 316.out 317.out 318.out 319.out 320.out 330.out 331.out 332.out /var/lib/xfstests/tests/btrfs 2024-09-11T00:16:46.737 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T00:16:46.740 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T00:16:47.486 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.YVIfjesBePxfstests-dev/tests/ceph/ install 2024-09-11T00:16:47.489 INFO:teuthology.orchestra.run.smithi092.stdout: [GROUP] /tmp/tmp.YVIfjesBePxfstests-dev/tests/ceph/group.list 2024-09-11T00:16:47.502 INFO:teuthology.orchestra.run.smithi092.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ceph 2024-09-11T00:16:47.511 INFO:teuthology.orchestra.run.smithi092.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 /var/lib/xfstests/tests/ceph 2024-09-11T00:16:47.530 INFO:teuthology.orchestra.run.smithi092.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ceph 2024-09-11T00:16:47.538 INFO:teuthology.orchestra.run.smithi092.stdout:../../install-sh -o root -g root -m 644 001.out 002.out 003.out 004.out 005.out /var/lib/xfstests/tests/ceph 2024-09-11T00:16:47.557 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.YVIfjesBePxfstests-dev/tests/cifs/ install 2024-09-11T00:16:47.560 INFO:teuthology.orchestra.run.smithi092.stdout: [GROUP] /tmp/tmp.YVIfjesBePxfstests-dev/tests/cifs/group.list 2024-09-11T00:16:47.571 INFO:teuthology.orchestra.run.smithi092.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/cifs 2024-09-11T00:16:47.580 INFO:teuthology.orchestra.run.smithi092.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/cifs 2024-09-11T00:16:47.588 INFO:teuthology.orchestra.run.smithi092.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/cifs 2024-09-11T00:16:47.597 INFO:teuthology.orchestra.run.smithi092.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/cifs 2024-09-11T00:16:47.606 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.YVIfjesBePxfstests-dev/tests/ext4/ install 2024-09-11T00:16:47.609 INFO:teuthology.orchestra.run.smithi092.stdout: [GROUP] /tmp/tmp.YVIfjesBePxfstests-dev/tests/ext4/group.list 2024-09-11T00:16:47.647 INFO:teuthology.orchestra.run.smithi092.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ext4 2024-09-11T00:16:47.655 INFO:teuthology.orchestra.run.smithi092.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 271 301 302 303 304 305 306 307 308 /var/lib/xfstests/tests/ext4 2024-09-11T00:16:47.834 INFO:teuthology.orchestra.run.smithi092.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ext4 2024-09-11T00:16:47.843 INFO:teuthology.orchestra.run.smithi092.stdout:../../install-sh -o root -g root -m 644 001.out.default 001.out.nodelalloc 001.out.nozero 001.cfg 002.out 003.out 004.out 005.out 006.out 007.out 008.out 009.out 010.out 011.out 012.out 013.out 014.out 015.out 016.out 017.out 018.out 019.out 020.out 021.out 022.out 023.out 024.out 025.out 026.out 027.out 028.out 029.out 030.out 031.out 032.out 033.out 034.out 035.out 036.out 037.out 038.out 039.out 040.out 041.out 042.out 043.out 044.out 045.out 046.out 047.out 048.out 049.out 050.out 051.out 052.out 053.out 054.out 055.out 056.out 057.out 058.out 059.out 271.out 301.out 302.out 303.out 304.out 305.out 306.out 307.out 308.out /var/lib/xfstests/tests/ext4 2024-09-11T00:16:48.030 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.YVIfjesBePxfstests-dev/tests/f2fs/ install 2024-09-11T00:16:48.032 INFO:teuthology.orchestra.run.smithi092.stdout: [GROUP] /tmp/tmp.YVIfjesBePxfstests-dev/tests/f2fs/group.list 2024-09-11T00:16:48.049 INFO:teuthology.orchestra.run.smithi092.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/f2fs 2024-09-11T00:16:48.058 INFO:teuthology.orchestra.run.smithi092.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 /var/lib/xfstests/tests/f2fs 2024-09-11T00:16:48.075 INFO:teuthology.orchestra.run.smithi092.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/f2fs 2024-09-11T00:16:48.084 INFO:teuthology.orchestra.run.smithi092.stdout:../../install-sh -o root -g root -m 644 001.out 002.out 003.out 004.out /var/lib/xfstests/tests/f2fs 2024-09-11T00:16:48.100 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.YVIfjesBePxfstests-dev/tests/generic/ install 2024-09-11T00:16:48.103 INFO:teuthology.orchestra.run.smithi092.stdout: [GROUP] /tmp/tmp.YVIfjesBePxfstests-dev/tests/generic/group.list 2024-09-11T00:16:48.204 INFO:teuthology.orchestra.run.smithi092.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/generic 2024-09-11T00:16:48.213 INFO:teuthology.orchestra.run.smithi092.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 303 304 305 306 307 308 309 310 311 312 313 314 315 316 317 318 319 320 321 322 323 324 325 326 327 328 329 330 331 332 333 334 335 336 337 338 339 340 341 342 343 344 345 346 347 348 349 350 351 352 353 354 355 356 357 358 359 360 361 362 371 372 373 374 375 376 377 378 379 380 381 382 383 384 385 386 387 388 389 390 391 392 393 394 395 396 397 398 399 400 401 402 403 404 405 406 407 408 409 410 411 412 413 414 415 416 417 418 419 420 421 422 423 424 425 426 427 428 429 430 431 432 433 434 435 436 437 438 439 440 441 442 443 444 445 446 447 448 449 450 451 452 453 454 455 456 457 458 459 460 461 462 463 464 465 466 467 468 469 470 471 472 473 474 475 476 477 478 479 480 481 482 483 484 485 486 487 488 489 490 491 492 493 494 495 496 497 498 499 500 501 502 503 504 505 506 507 508 509 510 511 512 513 514 515 516 517 518 519 520 521 522 523 524 525 526 527 528 529 530 531 532 533 534 535 536 537 538 539 540 541 542 543 544 545 546 547 548 549 550 551 552 553 554 555 556 557 558 559 560 561 562 563 564 565 566 567 568 569 570 571 572 573 574 575 576 577 578 579 580 581 582 583 584 585 586 587 588 589 590 591 592 593 594 595 596 597 598 599 600 601 602 603 604 605 606 607 608 609 610 611 612 613 614 615 616 617 618 619 620 621 622 623 624 625 626 627 628 629 630 631 632 633 634 635 636 637 638 639 640 641 642 643 644 645 646 647 648 649 650 651 652 653 654 655 656 657 658 659 660 661 662 663 664 665 666 667 668 669 670 671 672 673 674 675 676 677 678 679 680 681 682 683 684 685 686 687 688 689 690 691 692 693 694 695 696 697 698 699 700 701 702 703 704 705 706 707 708 709 710 711 712 713 714 715 716 717 718 719 720 721 722 723 724 725 726 727 728 729 730 731 732 733 734 735 736 737 738 739 740 741 742 743 744 745 746 747 748 749 750 751 752 753 754 755 /var/lib/xfstests/tests/generic 2024-09-11T00:16:50.146 INFO:teuthology.orchestra.run.smithi092.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/generic 2024-09-11T00:16:50.154 INFO:teuthology.orchestra.run.smithi092.stdout:../../install-sh -o root -g root -m 644 035.out.default 035.out.nfs 050.out.default 050.out.nojournal 050.out.xfsquota 035.cfg 050.cfg 001.out 002.out 003.out 004.out 005.out 006.out 007.out 008.out 009.out 010.out 011.out 012.out 013.out 014.out 015.out 016.out 017.out 018.out 019.out 020.out 021.out 022.out 023.out 024.out 025.out 026.out 027.out 028.out 029.out 030.out 031.out 032.out 033.out 034.out 036.out 037.out 038.out 039.out 040.out 041.out 042.out 043.out 044.out 045.out 046.out 047.out 048.out 049.out 051.out 052.out 053.out 054.out 055.out 056.out 057.out 058.out 059.out 060.out 061.out 062.out 063.out 064.out 065.out 066.out 067.out 068.out 069.out 070.out 071.out 072.out 073.out 074.out 075.out 076.out 077.out 078.out 079.out 080.out 081.out 082.out 083.out 084.out 085.out 086.out 087.out 088.out 089.out 090.out 091.out 092.out 093.out 094.out 095.out 096.out 097.out 098.out 099.out 100.out 101.out 102.out 103.out 104.out 105.out 106.out 107.out 108.out 109.out 110.out 111.out 112.out 113.out 114.out 115.out 116.out 117.out 118.out 119.out 120.out 121.out 122.out 123.out 124.out 125.out 126.out 127.out 128.out 129.out 130.out 131.out 132.out 133.out 134.out 135.out 136.out 137.out 138.out 139.out 140.out 141.out 142.out 143.out 144.out 145.out 146.out 147.out 148.out 149.out 150.out 151.out 152.out 153.out 154.out 155.out 156.out 157.out 158.out 159.out 160.out 161.out 162.out 163.out 164.out 165.out 166.out 167.out 168.out 169.out 170.out 171.out 172.out 173.out 174.out 175.out 176.out 177.out 178.out 179.out 180.out 181.out 182.out 183.out 184.out 185.out 186.out 187.out 188.out 189.out 190.out 191.out 192.out 193.out 194.out 195.out 196.out 197.out 198.out 199.out 200.out 201.out 202.out 203.out 204.out 205.out 206.out 207.out 208.out 209.out 210.out 211.out 212.out 213.out 214.out 215.out 216.out 217.out 218.out 219.out 220.out 221.out 222.out 223.out 224.out 225.out 226.out 227.out 228.out 229.out 230.out 231.out 232.out 233.out 234.out 235.out 236.out 237.out 238.out 239.out 240.out 241.out 242.out 243.out 244.out 245.out 246.out 247.out 248.out 249.out 250.out 251.out 252.out 253.out 254.out 255.out 256.out 257.out 258.out 259.out 260.out 261.out 262.out 263.out 264.out 265.out 266.out 267.out 268.out 269.out 270.out 271.out 272.out 273.out 274.out 275.out 276.out 277.out 278.out 279.out 280.out 281.out 282.out 283.out 284.out 285.out 286.out 287.out 288.out 289.out 290.out 291.out 292.out 293.out 294.out 295.out 296.out 297.out 298.out 299.out 300.out 301.out 302.out 303.out 304.out 305.out 306.out 307.out 308.out 309.out 310.out 311.out 312.out 313.out 314.out 315.out 316.out 317.out 318.out 319.out 320.out 321.out 322.out 323.out 324.out 325.out 326.out 327.out 328.out 329.out 330.out 331.out 332.out 333.out 334.out 335.out 336.out 337.out 338.out 339.out 340.out 341.out 342.out 343.out 344.out 345.out 346.out 347.out 348.out 349.out 350.out 351.out 352.out 353.out 354.out 355.out 356.out 357.out 358.out 359.out 360.out 361.out 362.out 371.out 372.out 373.out 374.out 375.out 376.out 377.out 378.out 379.out 380.out 381.out 382.out 383.out 384.out 385.out 386.out 387.out 388.out 389.out 390.out 391.out 392.out 393.out 394.out 395.out 396.out 397.out 398.out 399.out 400.out 401.out 402.out 403.out 404.out 405.out 406.out 407.out 408.out 409.out 410.out 411.out 412.out 413.out 414.out 415.out 416.out 417.out 418.out 419.out 420.out 421.out 422.out 423.out 424.out 425.out 426.out 427.out 428.out 429.out 430.out 431.out 432.out 433.out 434.out 435.out 436.out 437.out 438.out 439.out 440.out 441.out 442.out 443.out 444.out 445.out 446.out 447.out 448.out 449.out 450.out 451.out 452.out 453.out 454.out 455.out 456.out 457.out 458.out 459.out 460.out 461.out 462.out 463.out 464.out 465.out 466.out 467.out 468.out 469.out 470.out 471.out 472.out 473.out 474.out 475.out 476.out 477.out 478.out 479.out 480.out 481.out 482.out 483.out 484.out 485.out 486.out 487.out 488.out 489.out 490.out 491.out 492.out 493.out 494.out 495.out 496.out 497.out 498.out 499.out 500.out 501.out 502.out 503.out 504.out 505.out 506.out 507.out 508.out 509.out 510.out 511.out 512.out 513.out 514.out 515.out 516.out 517.out 518.out 519.out 520.out 521.out 522.out 523.out 524.out 525.out 526.out 527.out 528.out 529.out 530.out 531.out 532.out 533.out 534.out 535.out 536.out 537.out 538.out 539.out 540.out 541.out 542.out 543.out 544.out 545.out 546.out 547.out 548.out 549.out 550.out 551.out 552.out 553.out 554.out 555.out 556.out 557.out 558.out 559.out 560.out 561.out 562.out 563.out 564.out 565.out 566.out 567.out 568.out 569.out 570.out 571.out 572.out 573.out 574.out 575.out 576.out 577.out 578.out 579.out 580.out 581.out 582.out 583.out 584.out 585.out 586.out 587.out 588.out 589.out 590.out 591.out 592.out 593.out 594.out 595.out 596.out 597.out 598.out 599.out 600.out 601.out 602.out 603.out 604.out 605.out 606.out 607.out 608.out 609.out 610.out 611.out 612.out 613.out 614.out 615.out 616.out 617.out 618.out 619.out 620.out 621.out 622.out 623.out 624.out 625.out 626.out 627.out 628.out 629.out 630.out 631.out 632.out 633.out 634.out 635.out 636.out 637.out 638.out 639.out 640.out 641.out 642.out 643.out 644.out 645.out 646.out 647.out 648.out 649.out 650.out 651.out 652.out 653.out 654.out 655.out 656.out 657.out 658.out 659.out 660.out 661.out 662.out 663.out 664.out 665.out 666.out 667.out 668.out 669.out 670.out 671.out 672.out 673.out 674.out 675.out 676.out 677.out 678.out 679.out 680.out 681.out 682.out 683.out 684.out 685.out 686.out 687.out 688.out 689.out 690.out 691.out 692.out 693.out 694.out 695.out 696.out 697.out 698.out 699.out 700.out 701.out 702.out 703.out 704.out 705.out 706.out 707.out 708.out 709.out 710.out 711.out 712.out 713.out 714.out 715.out 716.out 717.out 718.out 719.out 720.out 721.out 722.out 723.out 724.out 725.out 726.out 727.out 728.out 729.out 730.out 731.out 732.out 733.out 734.out 735.out 736.out 737.out 738.out 739.out 740.out 741.out 742.out 743.out 744.out 745.out 746.out 747.out 748.out 749.out 750.out 751.out 752.out 753.out 754.out 755.out /var/lib/xfstests/tests/generic 2024-09-11T00:16:52.110 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.YVIfjesBePxfstests-dev/tests/nfs/ install 2024-09-11T00:16:52.112 INFO:teuthology.orchestra.run.smithi092.stdout: [GROUP] /tmp/tmp.YVIfjesBePxfstests-dev/tests/nfs/group.list 2024-09-11T00:16:52.126 INFO:teuthology.orchestra.run.smithi092.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/nfs 2024-09-11T00:16:52.134 INFO:teuthology.orchestra.run.smithi092.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/nfs 2024-09-11T00:16:52.143 INFO:teuthology.orchestra.run.smithi092.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/nfs 2024-09-11T00:16:52.151 INFO:teuthology.orchestra.run.smithi092.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/nfs 2024-09-11T00:16:52.160 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.YVIfjesBePxfstests-dev/tests/ocfs2/ install 2024-09-11T00:16:52.163 INFO:teuthology.orchestra.run.smithi092.stdout: [GROUP] /tmp/tmp.YVIfjesBePxfstests-dev/tests/ocfs2/group.list 2024-09-11T00:16:52.176 INFO:teuthology.orchestra.run.smithi092.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ocfs2 2024-09-11T00:16:52.184 INFO:teuthology.orchestra.run.smithi092.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/ocfs2 2024-09-11T00:16:52.193 INFO:teuthology.orchestra.run.smithi092.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ocfs2 2024-09-11T00:16:52.201 INFO:teuthology.orchestra.run.smithi092.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/ocfs2 2024-09-11T00:16:52.210 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.YVIfjesBePxfstests-dev/tests/overlay/ install 2024-09-11T00:16:52.213 INFO:teuthology.orchestra.run.smithi092.stdout: [GROUP] /tmp/tmp.YVIfjesBePxfstests-dev/tests/overlay/group.list 2024-09-11T00:16:52.254 INFO:teuthology.orchestra.run.smithi092.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/overlay 2024-09-11T00:16:52.262 INFO:teuthology.orchestra.run.smithi092.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 /var/lib/xfstests/tests/overlay 2024-09-11T00:16:52.536 INFO:teuthology.orchestra.run.smithi092.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/overlay 2024-09-11T00:16:52.545 INFO:teuthology.orchestra.run.smithi092.stdout:../../install-sh -o root -g root -m 644 001.out 002.out 003.out 004.out 005.out 006.out 007.out 008.out 009.out 010.out 011.out 012.out 013.out 014.out 015.out 016.out 017.out 018.out 019.out 020.out 021.out 022.out 023.out 024.out 025.out 026.out 027.out 028.out 029.out 030.out 031.out 032.out 033.out 034.out 035.out 036.out 037.out 038.out 039.out 040.out 041.out 042.out 043.out 044.out 045.out 046.out 047.out 048.out 049.out 050.out 051.out 052.out 053.out 054.out 055.out 056.out 057.out 058.out 059.out 060.out 061.out 062.out 063.out 064.out 065.out 066.out 067.out 068.out 069.out 070.out 071.out 072.out 073.out 074.out 075.out 076.out 077.out 078.out 079.out 080.out 081.out 082.out 083.out 084.out 085.out 086.out 100.out 101.out 102.out 103.out 104.out 105.out 106.out 107.out 108.out 109.out 110.out 111.out 112.out 113.out 114.out 115.out 116.out 117.out /var/lib/xfstests/tests/overlay 2024-09-11T00:16:52.820 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.YVIfjesBePxfstests-dev/tests/perf/ install 2024-09-11T00:16:52.822 INFO:teuthology.orchestra.run.smithi092.stdout: [GROUP] /tmp/tmp.YVIfjesBePxfstests-dev/tests/perf/group.list 2024-09-11T00:16:52.833 INFO:teuthology.orchestra.run.smithi092.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/perf 2024-09-11T00:16:52.842 INFO:teuthology.orchestra.run.smithi092.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/perf 2024-09-11T00:16:52.851 INFO:teuthology.orchestra.run.smithi092.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/perf 2024-09-11T00:16:52.859 INFO:teuthology.orchestra.run.smithi092.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/perf 2024-09-11T00:16:52.868 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.YVIfjesBePxfstests-dev/tests/selftest/ install 2024-09-11T00:16:52.871 INFO:teuthology.orchestra.run.smithi092.stdout: [GROUP] /tmp/tmp.YVIfjesBePxfstests-dev/tests/selftest/group.list 2024-09-11T00:16:52.883 INFO:teuthology.orchestra.run.smithi092.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/selftest 2024-09-11T00:16:52.891 INFO:teuthology.orchestra.run.smithi092.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 /var/lib/xfstests/tests/selftest 2024-09-11T00:16:52.912 INFO:teuthology.orchestra.run.smithi092.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/selftest 2024-09-11T00:16:52.921 INFO:teuthology.orchestra.run.smithi092.stdout:../../install-sh -o root -g root -m 644 001.out 002.out 003.out 004.out 005.out 006.out /var/lib/xfstests/tests/selftest 2024-09-11T00:16:52.943 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.YVIfjesBePxfstests-dev/tests/tmpfs/ install 2024-09-11T00:16:52.945 INFO:teuthology.orchestra.run.smithi092.stdout: [GROUP] /tmp/tmp.YVIfjesBePxfstests-dev/tests/tmpfs/group.list 2024-09-11T00:16:52.957 INFO:teuthology.orchestra.run.smithi092.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/tmpfs 2024-09-11T00:16:52.966 INFO:teuthology.orchestra.run.smithi092.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/tmpfs 2024-09-11T00:16:52.974 INFO:teuthology.orchestra.run.smithi092.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/tmpfs 2024-09-11T00:16:52.983 INFO:teuthology.orchestra.run.smithi092.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/tmpfs 2024-09-11T00:16:52.992 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.YVIfjesBePxfstests-dev/tests/udf/ install 2024-09-11T00:16:52.995 INFO:teuthology.orchestra.run.smithi092.stdout: [GROUP] /tmp/tmp.YVIfjesBePxfstests-dev/tests/udf/group.list 2024-09-11T00:16:53.005 INFO:teuthology.orchestra.run.smithi092.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/udf 2024-09-11T00:16:53.014 INFO:teuthology.orchestra.run.smithi092.stdout:../../install-sh -o root -g root -m 755 102 /var/lib/xfstests/tests/udf 2024-09-11T00:16:53.023 INFO:teuthology.orchestra.run.smithi092.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/udf 2024-09-11T00:16:53.031 INFO:teuthology.orchestra.run.smithi092.stdout:../../install-sh -o root -g root -m 644 102.out /var/lib/xfstests/tests/udf 2024-09-11T00:16:53.040 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.YVIfjesBePxfstests-dev/tests/xfs/ install 2024-09-11T00:16:53.043 INFO:teuthology.orchestra.run.smithi092.stdout: [GROUP] /tmp/tmp.YVIfjesBePxfstests-dev/tests/xfs/group.list 2024-09-11T00:16:53.143 INFO:teuthology.orchestra.run.smithi092.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/xfs 2024-09-11T00:16:53.152 INFO:teuthology.orchestra.run.smithi092.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 303 304 305 306 307 308 309 310 311 312 313 314 315 316 317 318 319 320 321 322 323 324 325 326 327 328 329 330 331 332 333 334 335 336 337 338 339 340 341 342 343 344 345 346 347 348 349 350 351 352 353 354 355 356 357 358 359 360 361 362 363 364 365 366 367 368 369 370 371 372 373 374 375 376 377 378 379 380 381 382 383 384 385 386 387 388 389 390 391 392 393 394 395 396 397 398 399 400 401 402 403 404 405 406 407 408 409 410 411 412 413 414 415 416 417 418 419 420 421 422 423 424 425 426 427 428 429 430 431 432 433 434 435 436 437 438 439 440 441 442 443 444 445 446 447 448 449 450 451 452 453 454 455 456 457 458 459 460 461 462 463 464 465 466 467 468 469 470 471 472 473 474 475 476 477 478 479 480 481 482 483 484 485 486 487 488 489 490 491 492 493 494 495 496 497 498 499 500 501 502 503 504 505 506 507 508 509 510 511 512 513 514 515 516 517 518 519 520 521 522 523 524 525 526 527 528 529 530 531 532 533 534 535 536 537 538 539 540 541 542 543 544 545 546 547 548 549 550 551 552 553 554 555 556 557 558 559 560 561 562 563 564 565 566 567 568 569 570 571 572 573 574 575 576 577 578 579 580 581 582 583 584 585 586 587 588 589 590 591 592 593 594 595 596 597 598 599 600 601 602 603 604 605 606 607 608 612 613 614 615 616 617 618 619 620 621 622 623 624 625 626 627 628 708 709 710 711 712 713 714 715 716 717 718 719 720 721 722 723 724 725 726 727 728 729 730 731 732 733 734 735 736 737 738 739 740 741 742 743 744 745 746 747 748 749 750 751 752 753 754 755 756 757 758 759 760 761 762 763 764 765 766 767 768 769 770 771 772 773 774 775 776 777 778 779 780 781 782 783 784 785 786 787 788 789 790 791 792 793 794 795 796 797 798 799 800 801 /var/lib/xfstests/tests/xfs 2024-09-11T00:16:55.011 INFO:teuthology.orchestra.run.smithi092.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/xfs 2024-09-11T00:16:55.019 INFO:teuthology.orchestra.run.smithi092.stdout:../../install-sh -o root -g root -m 644 021.out.default 021.out.parent 033.out.crc 033.out.default 071.out.32 071.out.64 216.out.64mblog 216.out.classic 614.out.lba1024 614.out.lba2048 614.out.lba4096 614.out.lba512 021.cfg 033.cfg 216.cfg 614.cfg 001.out 002.out 003.out 004.out 005.out 006.out 007.out 008.out 009.out 010.out 011.out 012.out 013.out 014.out 015.out 016.out 017.out 018.out 019.out 020.out 022.out 023.out 024.out 025.out 026.out 027.out 028.out 029.out 030.out 031.out 032.out 034.out 035.out 036.out 037.out 038.out 039.out 040.out 041.out 042.out 043.out 044.out 045.out 046.out 047.out 048.out 049.out 050.out 051.out 052.out 053.out 054.out 055.out 056.out 057.out 058.out 059.out 060.out 061.out 062.out 063.out 064.out 065.out 066.out 067.out 068.out 069.out 070.out 072.out 073.out 074.out 075.out 076.out 077.out 078.out 079.out 080.out 081.out 082.out 083.out 084.out 085.out 086.out 087.out 088.out 089.out 090.out 091.out 092.out 093.out 094.out 095.out 096.out 097.out 098.out 099.out 100.out 101.out 102.out 103.out 104.out 105.out 106.out 107.out 108.out 109.out 110.out 111.out 112.out 113.out 114.out 115.out 116.out 117.out 118.out 119.out 120.out 121.out 122.out 123.out 124.out 125.out 126.out 127.out 128.out 129.out 130.out 131.out 132.out 133.out 134.out 135.out 136.out 137.out 138.out 139.out 140.out 141.out 142.out 143.out 144.out 145.out 146.out 147.out 148.out 149.out 150.out 151.out 152.out 153.out 154.out 155.out 156.out 157.out 158.out 159.out 160.out 161.out 162.out 163.out 164.out 165.out 166.out 167.out 168.out 169.out 170.out 171.out 172.out 173.out 174.out 175.out 176.out 177.out 178.out 179.out 180.out 181.out 182.out 183.out 184.out 185.out 186.out 187.out 188.out 189.out 190.out 191.out 192.out 193.out 194.out 195.out 196.out 197.out 198.out 199.out 200.out 201.out 202.out 203.out 204.out 205.out 206.out 207.out 208.out 209.out 210.out 211.out 212.out 213.out 214.out 215.out 217.out 218.out 219.out 220.out 221.out 222.out 223.out 224.out 225.out 226.out 227.out 228.out 229.out 230.out 231.out 232.out 233.out 234.out 235.out 236.out 237.out 238.out 239.out 240.out 241.out 242.out 243.out 244.out 245.out 246.out 247.out 248.out 249.out 250.out 251.out 252.out 253.out 254.out 255.out 256.out 257.out 258.out 259.out 260.out 261.out 262.out 263.out 264.out 265.out 266.out 267.out 268.out 269.out 270.out 271.out 272.out 273.out 274.out 275.out 276.out 277.out 278.out 279.out 280.out 281.out 282.out 283.out 284.out 285.out 286.out 287.out 288.out 289.out 290.out 291.out 292.out 293.out 294.out 295.out 296.out 297.out 298.out 299.out 300.out 301.out 302.out 303.out 304.out 305.out 306.out 307.out 308.out 309.out 310.out 311.out 312.out 313.out 314.out 315.out 316.out 317.out 318.out 319.out 320.out 321.out 322.out 323.out 324.out 325.out 326.out 327.out 328.out 329.out 330.out 331.out 332.out 333.out 334.out 335.out 336.out 337.out 338.out 339.out 340.out 341.out 342.out 343.out 344.out 345.out 346.out 347.out 348.out 349.out 350.out 351.out 352.out 353.out 354.out 355.out 356.out 357.out 358.out 359.out 360.out 361.out 362.out 363.out 364.out 365.out 366.out 367.out 368.out 369.out 370.out 371.out 372.out 373.out 374.out 375.out 376.out 377.out 378.out 379.out 380.out 381.out 382.out 383.out 384.out 385.out 386.out 387.out 388.out 389.out 390.out 391.out 392.out 393.out 394.out 395.out 396.out 397.out 398.out 399.out 400.out 401.out 402.out 403.out 404.out 405.out 406.out 407.out 408.out 409.out 410.out 411.out 412.out 413.out 414.out 415.out 416.out 417.out 418.out 419.out 420.out 421.out 422.out 423.out 424.out 425.out 426.out 427.out 428.out 429.out 430.out 431.out 432.out 433.out 434.out 435.out 436.out 437.out 438.out 439.out 440.out 441.out 442.out 443.out 444.out 445.out 446.out 447.out 448.out 449.out 450.out 451.out 452.out 453.out 454.out 455.out 456.out 457.out 458.out 459.out 460.out 461.out 462.out 463.out 464.out 465.out 466.out 467.out 468.out 469.out 470.out 471.out 472.out 473.out 474.out 475.out 476.out 477.out 478.out 479.out 480.out 481.out 482.out 483.out 484.out 485.out 486.out 487.out 488.out 489.out 490.out 491.out 492.out 493.out 494.out 495.out 496.out 497.out 498.out 499.out 500.out 501.out 502.out 503.out 504.out 505.out 506.out 507.out 508.out 509.out 510.out 511.out 512.out 513.out 514.out 515.out 516.out 517.out 518.out 519.out 520.out 521.out 522.out 523.out 524.out 525.out 526.out 527.out 528.out 529.out 530.out 531.out 532.out 533.out 534.out 535.out 536.out 537.out 538.out 539.out 540.out 541.out 542.out 543.out 544.out 545.out 546.out 547.out 548.out 549.out 550.out 551.out 552.out 553.out 554.out 555.out 556.out 557.out 558.out 559.out 560.out 561.out 562.out 563.out 564.out 565.out 566.out 567.out 568.out 569.out 570.out 571.out 572.out 573.out 574.out 575.out 576.out 577.out 578.out 579.out 580.out 581.out 582.out 583.out 584.out 585.out 586.out 587.out 588.out 589.out 590.out 591.out 592.out 593.out 594.out 595.out 596.out 597.out 598.out 599.out 600.out 601.out 602.out 603.out 604.out 605.out 606.out 607.out 608.out 612.out 613.out 615.out 616.out 617.out 618.out 619.out 620.out 621.out 622.out 623.out 624.out 625.out 626.out 627.out 628.out 708.out 709.out 710.out 711.out 712.out 713.out 714.out 715.out 716.out 717.out 718.out 719.out 720.out 721.out 722.out 723.out 724.out 725.out 726.out 727.out 728.out 729.out 730.out 731.out 732.out 733.out 734.out 735.out 736.out 737.out 738.out 739.out 740.out 741.out 742.out 743.out 744.out 745.out 746.out 747.out 748.out 749.out 750.out 751.out 752.out 753.out 754.out 755.out 756.out 757.out 758.out 759.out 760.out 761.out 762.out 763.out 764.out 765.out 766.out 767.out 768.out 769.out 770.out 771.out 772.out 773.out 774.out 775.out 776.out 777.out 778.out 779.out 780.out 781.out 782.out 783.out 784.out 785.out 786.out 787.out 788.out 789.out 790.out 791.out 792.out 793.out 794.out 795.out 796.out 797.out 798.out 799.out 800.out 801.out /var/lib/xfstests/tests/xfs 2024-09-11T00:16:56.920 INFO:teuthology.orchestra.run.smithi092.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests 2024-09-11T00:16:56.929 INFO:teuthology.orchestra.run.smithi092.stdout:./install-sh -o root -g root -m 755 -d /var/lib/xfstests 2024-09-11T00:16:56.937 INFO:teuthology.orchestra.run.smithi092.stdout:./install-sh -o root -g root -m 755 check /var/lib/xfstests 2024-09-11T00:16:56.946 INFO:teuthology.orchestra.run.smithi092.stdout:./install-sh -o root -g root -m 644 randomize.awk /var/lib/xfstests 2024-09-11T00:16:56.957 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T00:16:56.957 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec ls tests/generic) 2024-09-11T00:16:56.973 INFO:teuthology.orchestra.run.smithi092.stdout:001 2024-09-11T00:16:56.974 INFO:teuthology.orchestra.run.smithi092.stdout:001.out 2024-09-11T00:16:56.974 INFO:teuthology.orchestra.run.smithi092.stdout:002 2024-09-11T00:16:56.974 INFO:teuthology.orchestra.run.smithi092.stdout:002.out 2024-09-11T00:16:56.974 INFO:teuthology.orchestra.run.smithi092.stdout:003 2024-09-11T00:16:56.974 INFO:teuthology.orchestra.run.smithi092.stdout:003.out 2024-09-11T00:16:56.974 INFO:teuthology.orchestra.run.smithi092.stdout:004 2024-09-11T00:16:56.974 INFO:teuthology.orchestra.run.smithi092.stdout:004.out 2024-09-11T00:16:56.974 INFO:teuthology.orchestra.run.smithi092.stdout:005 2024-09-11T00:16:56.974 INFO:teuthology.orchestra.run.smithi092.stdout:005.out 2024-09-11T00:16:56.974 INFO:teuthology.orchestra.run.smithi092.stdout:006 2024-09-11T00:16:56.974 INFO:teuthology.orchestra.run.smithi092.stdout:006.out 2024-09-11T00:16:56.974 INFO:teuthology.orchestra.run.smithi092.stdout:007 2024-09-11T00:16:56.974 INFO:teuthology.orchestra.run.smithi092.stdout:007.out 2024-09-11T00:16:56.974 INFO:teuthology.orchestra.run.smithi092.stdout:008 2024-09-11T00:16:56.975 INFO:teuthology.orchestra.run.smithi092.stdout:008.out 2024-09-11T00:16:56.975 INFO:teuthology.orchestra.run.smithi092.stdout:009 2024-09-11T00:16:56.975 INFO:teuthology.orchestra.run.smithi092.stdout:009.out 2024-09-11T00:16:56.975 INFO:teuthology.orchestra.run.smithi092.stdout:010 2024-09-11T00:16:56.975 INFO:teuthology.orchestra.run.smithi092.stdout:010.out 2024-09-11T00:16:56.975 INFO:teuthology.orchestra.run.smithi092.stdout:011 2024-09-11T00:16:56.975 INFO:teuthology.orchestra.run.smithi092.stdout:011.out 2024-09-11T00:16:56.975 INFO:teuthology.orchestra.run.smithi092.stdout:012 2024-09-11T00:16:56.975 INFO:teuthology.orchestra.run.smithi092.stdout:012.out 2024-09-11T00:16:56.975 INFO:teuthology.orchestra.run.smithi092.stdout:013 2024-09-11T00:16:56.975 INFO:teuthology.orchestra.run.smithi092.stdout:013.out 2024-09-11T00:16:56.975 INFO:teuthology.orchestra.run.smithi092.stdout:014 2024-09-11T00:16:56.975 INFO:teuthology.orchestra.run.smithi092.stdout:014.out 2024-09-11T00:16:56.976 INFO:teuthology.orchestra.run.smithi092.stdout:015 2024-09-11T00:16:56.976 INFO:teuthology.orchestra.run.smithi092.stdout:015.out 2024-09-11T00:16:56.976 INFO:teuthology.orchestra.run.smithi092.stdout:016 2024-09-11T00:16:56.976 INFO:teuthology.orchestra.run.smithi092.stdout:016.out 2024-09-11T00:16:56.976 INFO:teuthology.orchestra.run.smithi092.stdout:017 2024-09-11T00:16:56.976 INFO:teuthology.orchestra.run.smithi092.stdout:017.out 2024-09-11T00:16:56.976 INFO:teuthology.orchestra.run.smithi092.stdout:018 2024-09-11T00:16:56.976 INFO:teuthology.orchestra.run.smithi092.stdout:018.out 2024-09-11T00:16:56.976 INFO:teuthology.orchestra.run.smithi092.stdout:019 2024-09-11T00:16:56.976 INFO:teuthology.orchestra.run.smithi092.stdout:019.out 2024-09-11T00:16:56.976 INFO:teuthology.orchestra.run.smithi092.stdout:020 2024-09-11T00:16:56.976 INFO:teuthology.orchestra.run.smithi092.stdout:020.out 2024-09-11T00:16:56.976 INFO:teuthology.orchestra.run.smithi092.stdout:021 2024-09-11T00:16:56.976 INFO:teuthology.orchestra.run.smithi092.stdout:021.out 2024-09-11T00:16:56.977 INFO:teuthology.orchestra.run.smithi092.stdout:022 2024-09-11T00:16:56.977 INFO:teuthology.orchestra.run.smithi092.stdout:022.out 2024-09-11T00:16:56.977 INFO:teuthology.orchestra.run.smithi092.stdout:023 2024-09-11T00:16:56.977 INFO:teuthology.orchestra.run.smithi092.stdout:023.out 2024-09-11T00:16:56.977 INFO:teuthology.orchestra.run.smithi092.stdout:024 2024-09-11T00:16:56.977 INFO:teuthology.orchestra.run.smithi092.stdout:024.out 2024-09-11T00:16:56.977 INFO:teuthology.orchestra.run.smithi092.stdout:025 2024-09-11T00:16:56.977 INFO:teuthology.orchestra.run.smithi092.stdout:025.out 2024-09-11T00:16:56.977 INFO:teuthology.orchestra.run.smithi092.stdout:026 2024-09-11T00:16:56.977 INFO:teuthology.orchestra.run.smithi092.stdout:026.out 2024-09-11T00:16:56.977 INFO:teuthology.orchestra.run.smithi092.stdout:027 2024-09-11T00:16:56.978 INFO:teuthology.orchestra.run.smithi092.stdout:027.out 2024-09-11T00:16:56.978 INFO:teuthology.orchestra.run.smithi092.stdout:028 2024-09-11T00:16:56.978 INFO:teuthology.orchestra.run.smithi092.stdout:028.out 2024-09-11T00:16:56.978 INFO:teuthology.orchestra.run.smithi092.stdout:029 2024-09-11T00:16:56.978 INFO:teuthology.orchestra.run.smithi092.stdout:029.out 2024-09-11T00:16:56.978 INFO:teuthology.orchestra.run.smithi092.stdout:030 2024-09-11T00:16:56.978 INFO:teuthology.orchestra.run.smithi092.stdout:030.out 2024-09-11T00:16:56.978 INFO:teuthology.orchestra.run.smithi092.stdout:031 2024-09-11T00:16:56.978 INFO:teuthology.orchestra.run.smithi092.stdout:031.out 2024-09-11T00:16:56.978 INFO:teuthology.orchestra.run.smithi092.stdout:032 2024-09-11T00:16:56.978 INFO:teuthology.orchestra.run.smithi092.stdout:032.out 2024-09-11T00:16:56.978 INFO:teuthology.orchestra.run.smithi092.stdout:033 2024-09-11T00:16:56.978 INFO:teuthology.orchestra.run.smithi092.stdout:033.out 2024-09-11T00:16:56.978 INFO:teuthology.orchestra.run.smithi092.stdout:034 2024-09-11T00:16:56.978 INFO:teuthology.orchestra.run.smithi092.stdout:034.out 2024-09-11T00:16:56.979 INFO:teuthology.orchestra.run.smithi092.stdout:035 2024-09-11T00:16:56.979 INFO:teuthology.orchestra.run.smithi092.stdout:035.cfg 2024-09-11T00:16:56.979 INFO:teuthology.orchestra.run.smithi092.stdout:035.out.default 2024-09-11T00:16:56.979 INFO:teuthology.orchestra.run.smithi092.stdout:035.out.nfs 2024-09-11T00:16:56.979 INFO:teuthology.orchestra.run.smithi092.stdout:036 2024-09-11T00:16:56.979 INFO:teuthology.orchestra.run.smithi092.stdout:036.out 2024-09-11T00:16:56.979 INFO:teuthology.orchestra.run.smithi092.stdout:037 2024-09-11T00:16:56.979 INFO:teuthology.orchestra.run.smithi092.stdout:037.out 2024-09-11T00:16:56.979 INFO:teuthology.orchestra.run.smithi092.stdout:038 2024-09-11T00:16:56.979 INFO:teuthology.orchestra.run.smithi092.stdout:038.out 2024-09-11T00:16:56.979 INFO:teuthology.orchestra.run.smithi092.stdout:039 2024-09-11T00:16:56.979 INFO:teuthology.orchestra.run.smithi092.stdout:039.out 2024-09-11T00:16:56.979 INFO:teuthology.orchestra.run.smithi092.stdout:040 2024-09-11T00:16:56.979 INFO:teuthology.orchestra.run.smithi092.stdout:040.out 2024-09-11T00:16:56.980 INFO:teuthology.orchestra.run.smithi092.stdout:041 2024-09-11T00:16:56.980 INFO:teuthology.orchestra.run.smithi092.stdout:041.out 2024-09-11T00:16:56.980 INFO:teuthology.orchestra.run.smithi092.stdout:042 2024-09-11T00:16:56.980 INFO:teuthology.orchestra.run.smithi092.stdout:042.out 2024-09-11T00:16:56.980 INFO:teuthology.orchestra.run.smithi092.stdout:043 2024-09-11T00:16:56.980 INFO:teuthology.orchestra.run.smithi092.stdout:043.out 2024-09-11T00:16:56.980 INFO:teuthology.orchestra.run.smithi092.stdout:044 2024-09-11T00:16:56.980 INFO:teuthology.orchestra.run.smithi092.stdout:044.out 2024-09-11T00:16:56.980 INFO:teuthology.orchestra.run.smithi092.stdout:045 2024-09-11T00:16:56.980 INFO:teuthology.orchestra.run.smithi092.stdout:045.out 2024-09-11T00:16:56.980 INFO:teuthology.orchestra.run.smithi092.stdout:046 2024-09-11T00:16:56.980 INFO:teuthology.orchestra.run.smithi092.stdout:046.out 2024-09-11T00:16:56.980 INFO:teuthology.orchestra.run.smithi092.stdout:047 2024-09-11T00:16:56.981 INFO:teuthology.orchestra.run.smithi092.stdout:047.out 2024-09-11T00:16:56.981 INFO:teuthology.orchestra.run.smithi092.stdout:048 2024-09-11T00:16:56.981 INFO:teuthology.orchestra.run.smithi092.stdout:048.out 2024-09-11T00:16:56.981 INFO:teuthology.orchestra.run.smithi092.stdout:049 2024-09-11T00:16:56.981 INFO:teuthology.orchestra.run.smithi092.stdout:049.out 2024-09-11T00:16:56.981 INFO:teuthology.orchestra.run.smithi092.stdout:050 2024-09-11T00:16:56.981 INFO:teuthology.orchestra.run.smithi092.stdout:050.cfg 2024-09-11T00:16:56.981 INFO:teuthology.orchestra.run.smithi092.stdout:050.out.default 2024-09-11T00:16:56.981 INFO:teuthology.orchestra.run.smithi092.stdout:050.out.nojournal 2024-09-11T00:16:56.981 INFO:teuthology.orchestra.run.smithi092.stdout:050.out.xfsquota 2024-09-11T00:16:56.981 INFO:teuthology.orchestra.run.smithi092.stdout:051 2024-09-11T00:16:56.981 INFO:teuthology.orchestra.run.smithi092.stdout:051.out 2024-09-11T00:16:56.981 INFO:teuthology.orchestra.run.smithi092.stdout:052 2024-09-11T00:16:56.981 INFO:teuthology.orchestra.run.smithi092.stdout:052.out 2024-09-11T00:16:56.982 INFO:teuthology.orchestra.run.smithi092.stdout:053 2024-09-11T00:16:56.982 INFO:teuthology.orchestra.run.smithi092.stdout:053.out 2024-09-11T00:16:56.982 INFO:teuthology.orchestra.run.smithi092.stdout:054 2024-09-11T00:16:56.982 INFO:teuthology.orchestra.run.smithi092.stdout:054.out 2024-09-11T00:16:56.982 INFO:teuthology.orchestra.run.smithi092.stdout:055 2024-09-11T00:16:56.982 INFO:teuthology.orchestra.run.smithi092.stdout:055.out 2024-09-11T00:16:56.982 INFO:teuthology.orchestra.run.smithi092.stdout:056 2024-09-11T00:16:56.982 INFO:teuthology.orchestra.run.smithi092.stdout:056.out 2024-09-11T00:16:56.982 INFO:teuthology.orchestra.run.smithi092.stdout:057 2024-09-11T00:16:56.982 INFO:teuthology.orchestra.run.smithi092.stdout:057.out 2024-09-11T00:16:56.982 INFO:teuthology.orchestra.run.smithi092.stdout:058 2024-09-11T00:16:56.982 INFO:teuthology.orchestra.run.smithi092.stdout:058.out 2024-09-11T00:16:56.982 INFO:teuthology.orchestra.run.smithi092.stdout:059 2024-09-11T00:16:56.982 INFO:teuthology.orchestra.run.smithi092.stdout:059.out 2024-09-11T00:16:56.983 INFO:teuthology.orchestra.run.smithi092.stdout:060 2024-09-11T00:16:56.983 INFO:teuthology.orchestra.run.smithi092.stdout:060.out 2024-09-11T00:16:56.983 INFO:teuthology.orchestra.run.smithi092.stdout:061 2024-09-11T00:16:56.983 INFO:teuthology.orchestra.run.smithi092.stdout:061.out 2024-09-11T00:16:56.983 INFO:teuthology.orchestra.run.smithi092.stdout:062 2024-09-11T00:16:56.983 INFO:teuthology.orchestra.run.smithi092.stdout:062.out 2024-09-11T00:16:56.983 INFO:teuthology.orchestra.run.smithi092.stdout:063 2024-09-11T00:16:56.983 INFO:teuthology.orchestra.run.smithi092.stdout:063.out 2024-09-11T00:16:56.983 INFO:teuthology.orchestra.run.smithi092.stdout:064 2024-09-11T00:16:56.983 INFO:teuthology.orchestra.run.smithi092.stdout:064.out 2024-09-11T00:16:56.983 INFO:teuthology.orchestra.run.smithi092.stdout:065 2024-09-11T00:16:56.983 INFO:teuthology.orchestra.run.smithi092.stdout:065.out 2024-09-11T00:16:56.983 INFO:teuthology.orchestra.run.smithi092.stdout:066 2024-09-11T00:16:56.983 INFO:teuthology.orchestra.run.smithi092.stdout:066.out 2024-09-11T00:16:56.984 INFO:teuthology.orchestra.run.smithi092.stdout:067 2024-09-11T00:16:56.984 INFO:teuthology.orchestra.run.smithi092.stdout:067.out 2024-09-11T00:16:56.984 INFO:teuthology.orchestra.run.smithi092.stdout:068 2024-09-11T00:16:56.984 INFO:teuthology.orchestra.run.smithi092.stdout:068.out 2024-09-11T00:16:56.984 INFO:teuthology.orchestra.run.smithi092.stdout:069 2024-09-11T00:16:56.984 INFO:teuthology.orchestra.run.smithi092.stdout:069.out 2024-09-11T00:16:56.984 INFO:teuthology.orchestra.run.smithi092.stdout:070 2024-09-11T00:16:56.984 INFO:teuthology.orchestra.run.smithi092.stdout:070.out 2024-09-11T00:16:56.984 INFO:teuthology.orchestra.run.smithi092.stdout:071 2024-09-11T00:16:56.984 INFO:teuthology.orchestra.run.smithi092.stdout:071.out 2024-09-11T00:16:56.984 INFO:teuthology.orchestra.run.smithi092.stdout:072 2024-09-11T00:16:56.984 INFO:teuthology.orchestra.run.smithi092.stdout:072.out 2024-09-11T00:16:56.984 INFO:teuthology.orchestra.run.smithi092.stdout:073 2024-09-11T00:16:56.984 INFO:teuthology.orchestra.run.smithi092.stdout:073.out 2024-09-11T00:16:56.985 INFO:teuthology.orchestra.run.smithi092.stdout:074 2024-09-11T00:16:56.985 INFO:teuthology.orchestra.run.smithi092.stdout:074.out 2024-09-11T00:16:56.985 INFO:teuthology.orchestra.run.smithi092.stdout:075 2024-09-11T00:16:56.985 INFO:teuthology.orchestra.run.smithi092.stdout:075.out 2024-09-11T00:16:56.985 INFO:teuthology.orchestra.run.smithi092.stdout:076 2024-09-11T00:16:56.985 INFO:teuthology.orchestra.run.smithi092.stdout:076.out 2024-09-11T00:16:56.985 INFO:teuthology.orchestra.run.smithi092.stdout:077 2024-09-11T00:16:56.988 INFO:teuthology.orchestra.run.smithi092.stdout:077.out 2024-09-11T00:16:56.988 INFO:teuthology.orchestra.run.smithi092.stdout:078 2024-09-11T00:16:56.988 INFO:teuthology.orchestra.run.smithi092.stdout:078.out 2024-09-11T00:16:56.989 INFO:teuthology.orchestra.run.smithi092.stdout:079 2024-09-11T00:16:56.989 INFO:teuthology.orchestra.run.smithi092.stdout:079.out 2024-09-11T00:16:56.989 INFO:teuthology.orchestra.run.smithi092.stdout:080 2024-09-11T00:16:56.989 INFO:teuthology.orchestra.run.smithi092.stdout:080.out 2024-09-11T00:16:56.989 INFO:teuthology.orchestra.run.smithi092.stdout:081 2024-09-11T00:16:56.989 INFO:teuthology.orchestra.run.smithi092.stdout:081.out 2024-09-11T00:16:56.989 INFO:teuthology.orchestra.run.smithi092.stdout:082 2024-09-11T00:16:56.989 INFO:teuthology.orchestra.run.smithi092.stdout:082.out 2024-09-11T00:16:56.989 INFO:teuthology.orchestra.run.smithi092.stdout:083 2024-09-11T00:16:56.989 INFO:teuthology.orchestra.run.smithi092.stdout:083.out 2024-09-11T00:16:56.989 INFO:teuthology.orchestra.run.smithi092.stdout:084 2024-09-11T00:16:56.989 INFO:teuthology.orchestra.run.smithi092.stdout:084.out 2024-09-11T00:16:56.989 INFO:teuthology.orchestra.run.smithi092.stdout:085 2024-09-11T00:16:56.990 INFO:teuthology.orchestra.run.smithi092.stdout:085.out 2024-09-11T00:16:56.990 INFO:teuthology.orchestra.run.smithi092.stdout:086 2024-09-11T00:16:56.990 INFO:teuthology.orchestra.run.smithi092.stdout:086.out 2024-09-11T00:16:56.990 INFO:teuthology.orchestra.run.smithi092.stdout:087 2024-09-11T00:16:56.990 INFO:teuthology.orchestra.run.smithi092.stdout:087.out 2024-09-11T00:16:56.990 INFO:teuthology.orchestra.run.smithi092.stdout:088 2024-09-11T00:16:56.990 INFO:teuthology.orchestra.run.smithi092.stdout:088.out 2024-09-11T00:16:56.990 INFO:teuthology.orchestra.run.smithi092.stdout:089 2024-09-11T00:16:56.990 INFO:teuthology.orchestra.run.smithi092.stdout:089.out 2024-09-11T00:16:56.990 INFO:teuthology.orchestra.run.smithi092.stdout:090 2024-09-11T00:16:56.990 INFO:teuthology.orchestra.run.smithi092.stdout:090.out 2024-09-11T00:16:56.990 INFO:teuthology.orchestra.run.smithi092.stdout:091 2024-09-11T00:16:56.990 INFO:teuthology.orchestra.run.smithi092.stdout:091.out 2024-09-11T00:16:56.990 INFO:teuthology.orchestra.run.smithi092.stdout:092 2024-09-11T00:16:56.991 INFO:teuthology.orchestra.run.smithi092.stdout:092.out 2024-09-11T00:16:56.991 INFO:teuthology.orchestra.run.smithi092.stdout:093 2024-09-11T00:16:56.991 INFO:teuthology.orchestra.run.smithi092.stdout:093.out 2024-09-11T00:16:56.991 INFO:teuthology.orchestra.run.smithi092.stdout:094 2024-09-11T00:16:56.991 INFO:teuthology.orchestra.run.smithi092.stdout:094.out 2024-09-11T00:16:56.991 INFO:teuthology.orchestra.run.smithi092.stdout:095 2024-09-11T00:16:56.991 INFO:teuthology.orchestra.run.smithi092.stdout:095.out 2024-09-11T00:16:56.991 INFO:teuthology.orchestra.run.smithi092.stdout:096 2024-09-11T00:16:56.991 INFO:teuthology.orchestra.run.smithi092.stdout:096.out 2024-09-11T00:16:56.991 INFO:teuthology.orchestra.run.smithi092.stdout:097 2024-09-11T00:16:56.991 INFO:teuthology.orchestra.run.smithi092.stdout:097.out 2024-09-11T00:16:56.992 INFO:teuthology.orchestra.run.smithi092.stdout:098 2024-09-11T00:16:56.992 INFO:teuthology.orchestra.run.smithi092.stdout:098.out 2024-09-11T00:16:56.992 INFO:teuthology.orchestra.run.smithi092.stdout:099 2024-09-11T00:16:56.992 INFO:teuthology.orchestra.run.smithi092.stdout:099.out 2024-09-11T00:16:56.992 INFO:teuthology.orchestra.run.smithi092.stdout:100 2024-09-11T00:16:56.992 INFO:teuthology.orchestra.run.smithi092.stdout:100.out 2024-09-11T00:16:56.992 INFO:teuthology.orchestra.run.smithi092.stdout:101 2024-09-11T00:16:56.992 INFO:teuthology.orchestra.run.smithi092.stdout:101.out 2024-09-11T00:16:56.992 INFO:teuthology.orchestra.run.smithi092.stdout:102 2024-09-11T00:16:56.992 INFO:teuthology.orchestra.run.smithi092.stdout:102.out 2024-09-11T00:16:56.992 INFO:teuthology.orchestra.run.smithi092.stdout:103 2024-09-11T00:16:56.992 INFO:teuthology.orchestra.run.smithi092.stdout:103.out 2024-09-11T00:16:56.992 INFO:teuthology.orchestra.run.smithi092.stdout:104 2024-09-11T00:16:56.992 INFO:teuthology.orchestra.run.smithi092.stdout:104.out 2024-09-11T00:16:56.993 INFO:teuthology.orchestra.run.smithi092.stdout:105 2024-09-11T00:16:56.993 INFO:teuthology.orchestra.run.smithi092.stdout:105.out 2024-09-11T00:16:56.993 INFO:teuthology.orchestra.run.smithi092.stdout:106 2024-09-11T00:16:56.993 INFO:teuthology.orchestra.run.smithi092.stdout:106.out 2024-09-11T00:16:56.993 INFO:teuthology.orchestra.run.smithi092.stdout:107 2024-09-11T00:16:56.993 INFO:teuthology.orchestra.run.smithi092.stdout:107.out 2024-09-11T00:16:56.993 INFO:teuthology.orchestra.run.smithi092.stdout:108 2024-09-11T00:16:56.993 INFO:teuthology.orchestra.run.smithi092.stdout:108.out 2024-09-11T00:16:56.993 INFO:teuthology.orchestra.run.smithi092.stdout:109 2024-09-11T00:16:56.993 INFO:teuthology.orchestra.run.smithi092.stdout:109.out 2024-09-11T00:16:56.993 INFO:teuthology.orchestra.run.smithi092.stdout:110 2024-09-11T00:16:56.993 INFO:teuthology.orchestra.run.smithi092.stdout:110.out 2024-09-11T00:16:56.994 INFO:teuthology.orchestra.run.smithi092.stdout:111 2024-09-11T00:16:56.994 INFO:teuthology.orchestra.run.smithi092.stdout:111.out 2024-09-11T00:16:56.994 INFO:teuthology.orchestra.run.smithi092.stdout:112 2024-09-11T00:16:56.994 INFO:teuthology.orchestra.run.smithi092.stdout:112.out 2024-09-11T00:16:56.994 INFO:teuthology.orchestra.run.smithi092.stdout:113 2024-09-11T00:16:56.994 INFO:teuthology.orchestra.run.smithi092.stdout:113.out 2024-09-11T00:16:56.994 INFO:teuthology.orchestra.run.smithi092.stdout:114 2024-09-11T00:16:56.994 INFO:teuthology.orchestra.run.smithi092.stdout:114.out 2024-09-11T00:16:56.994 INFO:teuthology.orchestra.run.smithi092.stdout:115 2024-09-11T00:16:56.994 INFO:teuthology.orchestra.run.smithi092.stdout:115.out 2024-09-11T00:16:56.994 INFO:teuthology.orchestra.run.smithi092.stdout:116 2024-09-11T00:16:56.994 INFO:teuthology.orchestra.run.smithi092.stdout:116.out 2024-09-11T00:16:56.994 INFO:teuthology.orchestra.run.smithi092.stdout:117 2024-09-11T00:16:56.994 INFO:teuthology.orchestra.run.smithi092.stdout:117.out 2024-09-11T00:16:56.995 INFO:teuthology.orchestra.run.smithi092.stdout:118 2024-09-11T00:16:56.995 INFO:teuthology.orchestra.run.smithi092.stdout:118.out 2024-09-11T00:16:56.995 INFO:teuthology.orchestra.run.smithi092.stdout:119 2024-09-11T00:16:56.995 INFO:teuthology.orchestra.run.smithi092.stdout:119.out 2024-09-11T00:16:56.995 INFO:teuthology.orchestra.run.smithi092.stdout:120 2024-09-11T00:16:56.995 INFO:teuthology.orchestra.run.smithi092.stdout:120.out 2024-09-11T00:16:56.995 INFO:teuthology.orchestra.run.smithi092.stdout:121 2024-09-11T00:16:56.995 INFO:teuthology.orchestra.run.smithi092.stdout:121.out 2024-09-11T00:16:56.995 INFO:teuthology.orchestra.run.smithi092.stdout:122 2024-09-11T00:16:56.995 INFO:teuthology.orchestra.run.smithi092.stdout:122.out 2024-09-11T00:16:56.995 INFO:teuthology.orchestra.run.smithi092.stdout:123 2024-09-11T00:16:56.995 INFO:teuthology.orchestra.run.smithi092.stdout:123.out 2024-09-11T00:16:56.995 INFO:teuthology.orchestra.run.smithi092.stdout:124 2024-09-11T00:16:56.995 INFO:teuthology.orchestra.run.smithi092.stdout:124.out 2024-09-11T00:16:56.996 INFO:teuthology.orchestra.run.smithi092.stdout:125 2024-09-11T00:16:56.996 INFO:teuthology.orchestra.run.smithi092.stdout:125.out 2024-09-11T00:16:56.996 INFO:teuthology.orchestra.run.smithi092.stdout:126 2024-09-11T00:16:56.996 INFO:teuthology.orchestra.run.smithi092.stdout:126.out 2024-09-11T00:16:56.996 INFO:teuthology.orchestra.run.smithi092.stdout:127 2024-09-11T00:16:56.996 INFO:teuthology.orchestra.run.smithi092.stdout:127.out 2024-09-11T00:16:56.996 INFO:teuthology.orchestra.run.smithi092.stdout:128 2024-09-11T00:16:56.996 INFO:teuthology.orchestra.run.smithi092.stdout:128.out 2024-09-11T00:16:56.996 INFO:teuthology.orchestra.run.smithi092.stdout:129 2024-09-11T00:16:56.996 INFO:teuthology.orchestra.run.smithi092.stdout:129.out 2024-09-11T00:16:56.996 INFO:teuthology.orchestra.run.smithi092.stdout:130 2024-09-11T00:16:56.996 INFO:teuthology.orchestra.run.smithi092.stdout:130.out 2024-09-11T00:16:56.996 INFO:teuthology.orchestra.run.smithi092.stdout:131 2024-09-11T00:16:56.996 INFO:teuthology.orchestra.run.smithi092.stdout:131.out 2024-09-11T00:16:56.997 INFO:teuthology.orchestra.run.smithi092.stdout:132 2024-09-11T00:16:56.997 INFO:teuthology.orchestra.run.smithi092.stdout:132.out 2024-09-11T00:16:56.997 INFO:teuthology.orchestra.run.smithi092.stdout:133 2024-09-11T00:16:56.997 INFO:teuthology.orchestra.run.smithi092.stdout:133.out 2024-09-11T00:16:56.997 INFO:teuthology.orchestra.run.smithi092.stdout:134 2024-09-11T00:16:56.997 INFO:teuthology.orchestra.run.smithi092.stdout:134.out 2024-09-11T00:16:56.997 INFO:teuthology.orchestra.run.smithi092.stdout:135 2024-09-11T00:16:56.997 INFO:teuthology.orchestra.run.smithi092.stdout:135.out 2024-09-11T00:16:56.997 INFO:teuthology.orchestra.run.smithi092.stdout:136 2024-09-11T00:16:56.997 INFO:teuthology.orchestra.run.smithi092.stdout:136.out 2024-09-11T00:16:56.997 INFO:teuthology.orchestra.run.smithi092.stdout:137 2024-09-11T00:16:56.997 INFO:teuthology.orchestra.run.smithi092.stdout:137.out 2024-09-11T00:16:56.997 INFO:teuthology.orchestra.run.smithi092.stdout:138 2024-09-11T00:16:56.997 INFO:teuthology.orchestra.run.smithi092.stdout:138.out 2024-09-11T00:16:56.998 INFO:teuthology.orchestra.run.smithi092.stdout:139 2024-09-11T00:16:56.998 INFO:teuthology.orchestra.run.smithi092.stdout:139.out 2024-09-11T00:16:56.998 INFO:teuthology.orchestra.run.smithi092.stdout:140 2024-09-11T00:16:56.998 INFO:teuthology.orchestra.run.smithi092.stdout:140.out 2024-09-11T00:16:56.998 INFO:teuthology.orchestra.run.smithi092.stdout:141 2024-09-11T00:16:56.998 INFO:teuthology.orchestra.run.smithi092.stdout:141.out 2024-09-11T00:16:56.998 INFO:teuthology.orchestra.run.smithi092.stdout:142 2024-09-11T00:16:56.998 INFO:teuthology.orchestra.run.smithi092.stdout:142.out 2024-09-11T00:16:56.998 INFO:teuthology.orchestra.run.smithi092.stdout:143 2024-09-11T00:16:56.998 INFO:teuthology.orchestra.run.smithi092.stdout:143.out 2024-09-11T00:16:56.998 INFO:teuthology.orchestra.run.smithi092.stdout:144 2024-09-11T00:16:56.998 INFO:teuthology.orchestra.run.smithi092.stdout:144.out 2024-09-11T00:16:56.998 INFO:teuthology.orchestra.run.smithi092.stdout:145 2024-09-11T00:16:56.999 INFO:teuthology.orchestra.run.smithi092.stdout:145.out 2024-09-11T00:16:56.999 INFO:teuthology.orchestra.run.smithi092.stdout:146 2024-09-11T00:16:56.999 INFO:teuthology.orchestra.run.smithi092.stdout:146.out 2024-09-11T00:16:56.999 INFO:teuthology.orchestra.run.smithi092.stdout:147 2024-09-11T00:16:56.999 INFO:teuthology.orchestra.run.smithi092.stdout:147.out 2024-09-11T00:16:56.999 INFO:teuthology.orchestra.run.smithi092.stdout:148 2024-09-11T00:16:56.999 INFO:teuthology.orchestra.run.smithi092.stdout:148.out 2024-09-11T00:16:56.999 INFO:teuthology.orchestra.run.smithi092.stdout:149 2024-09-11T00:16:56.999 INFO:teuthology.orchestra.run.smithi092.stdout:149.out 2024-09-11T00:16:56.999 INFO:teuthology.orchestra.run.smithi092.stdout:150 2024-09-11T00:16:56.999 INFO:teuthology.orchestra.run.smithi092.stdout:150.out 2024-09-11T00:16:56.999 INFO:teuthology.orchestra.run.smithi092.stdout:151 2024-09-11T00:16:56.999 INFO:teuthology.orchestra.run.smithi092.stdout:151.out 2024-09-11T00:16:56.999 INFO:teuthology.orchestra.run.smithi092.stdout:152 2024-09-11T00:16:56.999 INFO:teuthology.orchestra.run.smithi092.stdout:152.out 2024-09-11T00:16:57.000 INFO:teuthology.orchestra.run.smithi092.stdout:153 2024-09-11T00:16:57.000 INFO:teuthology.orchestra.run.smithi092.stdout:153.out 2024-09-11T00:16:57.000 INFO:teuthology.orchestra.run.smithi092.stdout:154 2024-09-11T00:16:57.000 INFO:teuthology.orchestra.run.smithi092.stdout:154.out 2024-09-11T00:16:57.000 INFO:teuthology.orchestra.run.smithi092.stdout:155 2024-09-11T00:16:57.000 INFO:teuthology.orchestra.run.smithi092.stdout:155.out 2024-09-11T00:16:57.000 INFO:teuthology.orchestra.run.smithi092.stdout:156 2024-09-11T00:16:57.000 INFO:teuthology.orchestra.run.smithi092.stdout:156.out 2024-09-11T00:16:57.000 INFO:teuthology.orchestra.run.smithi092.stdout:157 2024-09-11T00:16:57.000 INFO:teuthology.orchestra.run.smithi092.stdout:157.out 2024-09-11T00:16:57.000 INFO:teuthology.orchestra.run.smithi092.stdout:158 2024-09-11T00:16:57.000 INFO:teuthology.orchestra.run.smithi092.stdout:158.out 2024-09-11T00:16:57.000 INFO:teuthology.orchestra.run.smithi092.stdout:159 2024-09-11T00:16:57.001 INFO:teuthology.orchestra.run.smithi092.stdout:159.out 2024-09-11T00:16:57.001 INFO:teuthology.orchestra.run.smithi092.stdout:160 2024-09-11T00:16:57.001 INFO:teuthology.orchestra.run.smithi092.stdout:160.out 2024-09-11T00:16:57.001 INFO:teuthology.orchestra.run.smithi092.stdout:161 2024-09-11T00:16:57.001 INFO:teuthology.orchestra.run.smithi092.stdout:161.out 2024-09-11T00:16:57.001 INFO:teuthology.orchestra.run.smithi092.stdout:162 2024-09-11T00:16:57.001 INFO:teuthology.orchestra.run.smithi092.stdout:162.out 2024-09-11T00:16:57.001 INFO:teuthology.orchestra.run.smithi092.stdout:163 2024-09-11T00:16:57.001 INFO:teuthology.orchestra.run.smithi092.stdout:163.out 2024-09-11T00:16:57.001 INFO:teuthology.orchestra.run.smithi092.stdout:164 2024-09-11T00:16:57.001 INFO:teuthology.orchestra.run.smithi092.stdout:164.out 2024-09-11T00:16:57.001 INFO:teuthology.orchestra.run.smithi092.stdout:165 2024-09-11T00:16:57.001 INFO:teuthology.orchestra.run.smithi092.stdout:165.out 2024-09-11T00:16:57.002 INFO:teuthology.orchestra.run.smithi092.stdout:166 2024-09-11T00:16:57.002 INFO:teuthology.orchestra.run.smithi092.stdout:166.out 2024-09-11T00:16:57.002 INFO:teuthology.orchestra.run.smithi092.stdout:167 2024-09-11T00:16:57.002 INFO:teuthology.orchestra.run.smithi092.stdout:167.out 2024-09-11T00:16:57.002 INFO:teuthology.orchestra.run.smithi092.stdout:168 2024-09-11T00:16:57.002 INFO:teuthology.orchestra.run.smithi092.stdout:168.out 2024-09-11T00:16:57.002 INFO:teuthology.orchestra.run.smithi092.stdout:169 2024-09-11T00:16:57.002 INFO:teuthology.orchestra.run.smithi092.stdout:169.out 2024-09-11T00:16:57.002 INFO:teuthology.orchestra.run.smithi092.stdout:170 2024-09-11T00:16:57.002 INFO:teuthology.orchestra.run.smithi092.stdout:170.out 2024-09-11T00:16:57.002 INFO:teuthology.orchestra.run.smithi092.stdout:171 2024-09-11T00:16:57.002 INFO:teuthology.orchestra.run.smithi092.stdout:171.out 2024-09-11T00:16:57.002 INFO:teuthology.orchestra.run.smithi092.stdout:172 2024-09-11T00:16:57.002 INFO:teuthology.orchestra.run.smithi092.stdout:172.out 2024-09-11T00:16:57.002 INFO:teuthology.orchestra.run.smithi092.stdout:173 2024-09-11T00:16:57.003 INFO:teuthology.orchestra.run.smithi092.stdout:173.out 2024-09-11T00:16:57.003 INFO:teuthology.orchestra.run.smithi092.stdout:174 2024-09-11T00:16:57.003 INFO:teuthology.orchestra.run.smithi092.stdout:174.out 2024-09-11T00:16:57.003 INFO:teuthology.orchestra.run.smithi092.stdout:175 2024-09-11T00:16:57.003 INFO:teuthology.orchestra.run.smithi092.stdout:175.out 2024-09-11T00:16:57.003 INFO:teuthology.orchestra.run.smithi092.stdout:176 2024-09-11T00:16:57.003 INFO:teuthology.orchestra.run.smithi092.stdout:176.out 2024-09-11T00:16:57.003 INFO:teuthology.orchestra.run.smithi092.stdout:177 2024-09-11T00:16:57.003 INFO:teuthology.orchestra.run.smithi092.stdout:177.out 2024-09-11T00:16:57.003 INFO:teuthology.orchestra.run.smithi092.stdout:178 2024-09-11T00:16:57.003 INFO:teuthology.orchestra.run.smithi092.stdout:178.out 2024-09-11T00:16:57.003 INFO:teuthology.orchestra.run.smithi092.stdout:179 2024-09-11T00:16:57.003 INFO:teuthology.orchestra.run.smithi092.stdout:179.out 2024-09-11T00:16:57.004 INFO:teuthology.orchestra.run.smithi092.stdout:180 2024-09-11T00:16:57.004 INFO:teuthology.orchestra.run.smithi092.stdout:180.out 2024-09-11T00:16:57.004 INFO:teuthology.orchestra.run.smithi092.stdout:181 2024-09-11T00:16:57.004 INFO:teuthology.orchestra.run.smithi092.stdout:181.out 2024-09-11T00:16:57.004 INFO:teuthology.orchestra.run.smithi092.stdout:182 2024-09-11T00:16:57.004 INFO:teuthology.orchestra.run.smithi092.stdout:182.out 2024-09-11T00:16:57.004 INFO:teuthology.orchestra.run.smithi092.stdout:183 2024-09-11T00:16:57.004 INFO:teuthology.orchestra.run.smithi092.stdout:183.out 2024-09-11T00:16:57.004 INFO:teuthology.orchestra.run.smithi092.stdout:184 2024-09-11T00:16:57.004 INFO:teuthology.orchestra.run.smithi092.stdout:184.out 2024-09-11T00:16:57.004 INFO:teuthology.orchestra.run.smithi092.stdout:185 2024-09-11T00:16:57.004 INFO:teuthology.orchestra.run.smithi092.stdout:185.out 2024-09-11T00:16:57.004 INFO:teuthology.orchestra.run.smithi092.stdout:186 2024-09-11T00:16:57.004 INFO:teuthology.orchestra.run.smithi092.stdout:186.out 2024-09-11T00:16:57.005 INFO:teuthology.orchestra.run.smithi092.stdout:187 2024-09-11T00:16:57.005 INFO:teuthology.orchestra.run.smithi092.stdout:187.out 2024-09-11T00:16:57.005 INFO:teuthology.orchestra.run.smithi092.stdout:188 2024-09-11T00:16:57.005 INFO:teuthology.orchestra.run.smithi092.stdout:188.out 2024-09-11T00:16:57.005 INFO:teuthology.orchestra.run.smithi092.stdout:189 2024-09-11T00:16:57.005 INFO:teuthology.orchestra.run.smithi092.stdout:189.out 2024-09-11T00:16:57.005 INFO:teuthology.orchestra.run.smithi092.stdout:190 2024-09-11T00:16:57.005 INFO:teuthology.orchestra.run.smithi092.stdout:190.out 2024-09-11T00:16:57.005 INFO:teuthology.orchestra.run.smithi092.stdout:191 2024-09-11T00:16:57.005 INFO:teuthology.orchestra.run.smithi092.stdout:191.out 2024-09-11T00:16:57.005 INFO:teuthology.orchestra.run.smithi092.stdout:192 2024-09-11T00:16:57.005 INFO:teuthology.orchestra.run.smithi092.stdout:192.out 2024-09-11T00:16:57.005 INFO:teuthology.orchestra.run.smithi092.stdout:193 2024-09-11T00:16:57.006 INFO:teuthology.orchestra.run.smithi092.stdout:193.out 2024-09-11T00:16:57.006 INFO:teuthology.orchestra.run.smithi092.stdout:194 2024-09-11T00:16:57.006 INFO:teuthology.orchestra.run.smithi092.stdout:194.out 2024-09-11T00:16:57.006 INFO:teuthology.orchestra.run.smithi092.stdout:195 2024-09-11T00:16:57.006 INFO:teuthology.orchestra.run.smithi092.stdout:195.out 2024-09-11T00:16:57.006 INFO:teuthology.orchestra.run.smithi092.stdout:196 2024-09-11T00:16:57.006 INFO:teuthology.orchestra.run.smithi092.stdout:196.out 2024-09-11T00:16:57.006 INFO:teuthology.orchestra.run.smithi092.stdout:197 2024-09-11T00:16:57.006 INFO:teuthology.orchestra.run.smithi092.stdout:197.out 2024-09-11T00:16:57.006 INFO:teuthology.orchestra.run.smithi092.stdout:198 2024-09-11T00:16:57.006 INFO:teuthology.orchestra.run.smithi092.stdout:198.out 2024-09-11T00:16:57.006 INFO:teuthology.orchestra.run.smithi092.stdout:199 2024-09-11T00:16:57.006 INFO:teuthology.orchestra.run.smithi092.stdout:199.out 2024-09-11T00:16:57.006 INFO:teuthology.orchestra.run.smithi092.stdout:200 2024-09-11T00:16:57.007 INFO:teuthology.orchestra.run.smithi092.stdout:200.out 2024-09-11T00:16:57.007 INFO:teuthology.orchestra.run.smithi092.stdout:201 2024-09-11T00:16:57.007 INFO:teuthology.orchestra.run.smithi092.stdout:201.out 2024-09-11T00:16:57.007 INFO:teuthology.orchestra.run.smithi092.stdout:202 2024-09-11T00:16:57.007 INFO:teuthology.orchestra.run.smithi092.stdout:202.out 2024-09-11T00:16:57.007 INFO:teuthology.orchestra.run.smithi092.stdout:203 2024-09-11T00:16:57.007 INFO:teuthology.orchestra.run.smithi092.stdout:203.out 2024-09-11T00:16:57.007 INFO:teuthology.orchestra.run.smithi092.stdout:204 2024-09-11T00:16:57.007 INFO:teuthology.orchestra.run.smithi092.stdout:204.out 2024-09-11T00:16:57.007 INFO:teuthology.orchestra.run.smithi092.stdout:205 2024-09-11T00:16:57.007 INFO:teuthology.orchestra.run.smithi092.stdout:205.out 2024-09-11T00:16:57.007 INFO:teuthology.orchestra.run.smithi092.stdout:206 2024-09-11T00:16:57.007 INFO:teuthology.orchestra.run.smithi092.stdout:206.out 2024-09-11T00:16:57.007 INFO:teuthology.orchestra.run.smithi092.stdout:207 2024-09-11T00:16:57.007 INFO:teuthology.orchestra.run.smithi092.stdout:207.out 2024-09-11T00:16:57.007 INFO:teuthology.orchestra.run.smithi092.stdout:208 2024-09-11T00:16:57.008 INFO:teuthology.orchestra.run.smithi092.stdout:208.out 2024-09-11T00:16:57.008 INFO:teuthology.orchestra.run.smithi092.stdout:209 2024-09-11T00:16:57.008 INFO:teuthology.orchestra.run.smithi092.stdout:209.out 2024-09-11T00:16:57.008 INFO:teuthology.orchestra.run.smithi092.stdout:210 2024-09-11T00:16:57.008 INFO:teuthology.orchestra.run.smithi092.stdout:210.out 2024-09-11T00:16:57.008 INFO:teuthology.orchestra.run.smithi092.stdout:211 2024-09-11T00:16:57.008 INFO:teuthology.orchestra.run.smithi092.stdout:211.out 2024-09-11T00:16:57.008 INFO:teuthology.orchestra.run.smithi092.stdout:212 2024-09-11T00:16:57.008 INFO:teuthology.orchestra.run.smithi092.stdout:212.out 2024-09-11T00:16:57.008 INFO:teuthology.orchestra.run.smithi092.stdout:213 2024-09-11T00:16:57.008 INFO:teuthology.orchestra.run.smithi092.stdout:213.out 2024-09-11T00:16:57.008 INFO:teuthology.orchestra.run.smithi092.stdout:214 2024-09-11T00:16:57.008 INFO:teuthology.orchestra.run.smithi092.stdout:214.out 2024-09-11T00:16:57.008 INFO:teuthology.orchestra.run.smithi092.stdout:215 2024-09-11T00:16:57.008 INFO:teuthology.orchestra.run.smithi092.stdout:215.out 2024-09-11T00:16:57.008 INFO:teuthology.orchestra.run.smithi092.stdout:216 2024-09-11T00:16:57.009 INFO:teuthology.orchestra.run.smithi092.stdout:216.out 2024-09-11T00:16:57.009 INFO:teuthology.orchestra.run.smithi092.stdout:217 2024-09-11T00:16:57.009 INFO:teuthology.orchestra.run.smithi092.stdout:217.out 2024-09-11T00:16:57.009 INFO:teuthology.orchestra.run.smithi092.stdout:218 2024-09-11T00:16:57.009 INFO:teuthology.orchestra.run.smithi092.stdout:218.out 2024-09-11T00:16:57.009 INFO:teuthology.orchestra.run.smithi092.stdout:219 2024-09-11T00:16:57.009 INFO:teuthology.orchestra.run.smithi092.stdout:219.out 2024-09-11T00:16:57.009 INFO:teuthology.orchestra.run.smithi092.stdout:220 2024-09-11T00:16:57.009 INFO:teuthology.orchestra.run.smithi092.stdout:220.out 2024-09-11T00:16:57.009 INFO:teuthology.orchestra.run.smithi092.stdout:221 2024-09-11T00:16:57.009 INFO:teuthology.orchestra.run.smithi092.stdout:221.out 2024-09-11T00:16:57.009 INFO:teuthology.orchestra.run.smithi092.stdout:222 2024-09-11T00:16:57.009 INFO:teuthology.orchestra.run.smithi092.stdout:222.out 2024-09-11T00:16:57.010 INFO:teuthology.orchestra.run.smithi092.stdout:223 2024-09-11T00:16:57.010 INFO:teuthology.orchestra.run.smithi092.stdout:223.out 2024-09-11T00:16:57.010 INFO:teuthology.orchestra.run.smithi092.stdout:224 2024-09-11T00:16:57.010 INFO:teuthology.orchestra.run.smithi092.stdout:224.out 2024-09-11T00:16:57.010 INFO:teuthology.orchestra.run.smithi092.stdout:225 2024-09-11T00:16:57.010 INFO:teuthology.orchestra.run.smithi092.stdout:225.out 2024-09-11T00:16:57.010 INFO:teuthology.orchestra.run.smithi092.stdout:226 2024-09-11T00:16:57.010 INFO:teuthology.orchestra.run.smithi092.stdout:226.out 2024-09-11T00:16:57.010 INFO:teuthology.orchestra.run.smithi092.stdout:227 2024-09-11T00:16:57.010 INFO:teuthology.orchestra.run.smithi092.stdout:227.out 2024-09-11T00:16:57.010 INFO:teuthology.orchestra.run.smithi092.stdout:228 2024-09-11T00:16:57.010 INFO:teuthology.orchestra.run.smithi092.stdout:228.out 2024-09-11T00:16:57.010 INFO:teuthology.orchestra.run.smithi092.stdout:229 2024-09-11T00:16:57.010 INFO:teuthology.orchestra.run.smithi092.stdout:229.out 2024-09-11T00:16:57.010 INFO:teuthology.orchestra.run.smithi092.stdout:230 2024-09-11T00:16:57.011 INFO:teuthology.orchestra.run.smithi092.stdout:230.out 2024-09-11T00:16:57.011 INFO:teuthology.orchestra.run.smithi092.stdout:231 2024-09-11T00:16:57.011 INFO:teuthology.orchestra.run.smithi092.stdout:231.out 2024-09-11T00:16:57.011 INFO:teuthology.orchestra.run.smithi092.stdout:232 2024-09-11T00:16:57.011 INFO:teuthology.orchestra.run.smithi092.stdout:232.out 2024-09-11T00:16:57.011 INFO:teuthology.orchestra.run.smithi092.stdout:233 2024-09-11T00:16:57.011 INFO:teuthology.orchestra.run.smithi092.stdout:233.out 2024-09-11T00:16:57.011 INFO:teuthology.orchestra.run.smithi092.stdout:234 2024-09-11T00:16:57.011 INFO:teuthology.orchestra.run.smithi092.stdout:234.out 2024-09-11T00:16:57.011 INFO:teuthology.orchestra.run.smithi092.stdout:235 2024-09-11T00:16:57.011 INFO:teuthology.orchestra.run.smithi092.stdout:235.out 2024-09-11T00:16:57.011 INFO:teuthology.orchestra.run.smithi092.stdout:236 2024-09-11T00:16:57.012 INFO:teuthology.orchestra.run.smithi092.stdout:236.out 2024-09-11T00:16:57.012 INFO:teuthology.orchestra.run.smithi092.stdout:237 2024-09-11T00:16:57.012 INFO:teuthology.orchestra.run.smithi092.stdout:237.out 2024-09-11T00:16:57.012 INFO:teuthology.orchestra.run.smithi092.stdout:238 2024-09-11T00:16:57.012 INFO:teuthology.orchestra.run.smithi092.stdout:238.out 2024-09-11T00:16:57.012 INFO:teuthology.orchestra.run.smithi092.stdout:239 2024-09-11T00:16:57.012 INFO:teuthology.orchestra.run.smithi092.stdout:239.out 2024-09-11T00:16:57.012 INFO:teuthology.orchestra.run.smithi092.stdout:240 2024-09-11T00:16:57.012 INFO:teuthology.orchestra.run.smithi092.stdout:240.out 2024-09-11T00:16:57.012 INFO:teuthology.orchestra.run.smithi092.stdout:241 2024-09-11T00:16:57.012 INFO:teuthology.orchestra.run.smithi092.stdout:241.out 2024-09-11T00:16:57.013 INFO:teuthology.orchestra.run.smithi092.stdout:242 2024-09-11T00:16:57.013 INFO:teuthology.orchestra.run.smithi092.stdout:242.out 2024-09-11T00:16:57.013 INFO:teuthology.orchestra.run.smithi092.stdout:243 2024-09-11T00:16:57.013 INFO:teuthology.orchestra.run.smithi092.stdout:243.out 2024-09-11T00:16:57.013 INFO:teuthology.orchestra.run.smithi092.stdout:244 2024-09-11T00:16:57.013 INFO:teuthology.orchestra.run.smithi092.stdout:244.out 2024-09-11T00:16:57.013 INFO:teuthology.orchestra.run.smithi092.stdout:245 2024-09-11T00:16:57.013 INFO:teuthology.orchestra.run.smithi092.stdout:245.out 2024-09-11T00:16:57.013 INFO:teuthology.orchestra.run.smithi092.stdout:246 2024-09-11T00:16:57.013 INFO:teuthology.orchestra.run.smithi092.stdout:246.out 2024-09-11T00:16:57.013 INFO:teuthology.orchestra.run.smithi092.stdout:247 2024-09-11T00:16:57.013 INFO:teuthology.orchestra.run.smithi092.stdout:247.out 2024-09-11T00:16:57.013 INFO:teuthology.orchestra.run.smithi092.stdout:248 2024-09-11T00:16:57.014 INFO:teuthology.orchestra.run.smithi092.stdout:248.out 2024-09-11T00:16:57.014 INFO:teuthology.orchestra.run.smithi092.stdout:249 2024-09-11T00:16:57.014 INFO:teuthology.orchestra.run.smithi092.stdout:249.out 2024-09-11T00:16:57.014 INFO:teuthology.orchestra.run.smithi092.stdout:250 2024-09-11T00:16:57.014 INFO:teuthology.orchestra.run.smithi092.stdout:250.out 2024-09-11T00:16:57.014 INFO:teuthology.orchestra.run.smithi092.stdout:251 2024-09-11T00:16:57.014 INFO:teuthology.orchestra.run.smithi092.stdout:251.out 2024-09-11T00:16:57.014 INFO:teuthology.orchestra.run.smithi092.stdout:252 2024-09-11T00:16:57.014 INFO:teuthology.orchestra.run.smithi092.stdout:252.out 2024-09-11T00:16:57.014 INFO:teuthology.orchestra.run.smithi092.stdout:253 2024-09-11T00:16:57.015 INFO:teuthology.orchestra.run.smithi092.stdout:253.out 2024-09-11T00:16:57.015 INFO:teuthology.orchestra.run.smithi092.stdout:254 2024-09-11T00:16:57.015 INFO:teuthology.orchestra.run.smithi092.stdout:254.out 2024-09-11T00:16:57.015 INFO:teuthology.orchestra.run.smithi092.stdout:255 2024-09-11T00:16:57.015 INFO:teuthology.orchestra.run.smithi092.stdout:255.out 2024-09-11T00:16:57.015 INFO:teuthology.orchestra.run.smithi092.stdout:256 2024-09-11T00:16:57.015 INFO:teuthology.orchestra.run.smithi092.stdout:256.out 2024-09-11T00:16:57.015 INFO:teuthology.orchestra.run.smithi092.stdout:257 2024-09-11T00:16:57.015 INFO:teuthology.orchestra.run.smithi092.stdout:257.out 2024-09-11T00:16:57.015 INFO:teuthology.orchestra.run.smithi092.stdout:258 2024-09-11T00:16:57.015 INFO:teuthology.orchestra.run.smithi092.stdout:258.out 2024-09-11T00:16:57.016 INFO:teuthology.orchestra.run.smithi092.stdout:259 2024-09-11T00:16:57.016 INFO:teuthology.orchestra.run.smithi092.stdout:259.out 2024-09-11T00:16:57.016 INFO:teuthology.orchestra.run.smithi092.stdout:260 2024-09-11T00:16:57.016 INFO:teuthology.orchestra.run.smithi092.stdout:260.out 2024-09-11T00:16:57.016 INFO:teuthology.orchestra.run.smithi092.stdout:261 2024-09-11T00:16:57.016 INFO:teuthology.orchestra.run.smithi092.stdout:261.out 2024-09-11T00:16:57.016 INFO:teuthology.orchestra.run.smithi092.stdout:262 2024-09-11T00:16:57.016 INFO:teuthology.orchestra.run.smithi092.stdout:262.out 2024-09-11T00:16:57.017 INFO:teuthology.orchestra.run.smithi092.stdout:263 2024-09-11T00:16:57.017 INFO:teuthology.orchestra.run.smithi092.stdout:263.out 2024-09-11T00:16:57.018 INFO:teuthology.orchestra.run.smithi092.stdout:264 2024-09-11T00:16:57.018 INFO:teuthology.orchestra.run.smithi092.stdout:264.out 2024-09-11T00:16:57.018 INFO:teuthology.orchestra.run.smithi092.stdout:265 2024-09-11T00:16:57.018 INFO:teuthology.orchestra.run.smithi092.stdout:265.out 2024-09-11T00:16:57.018 INFO:teuthology.orchestra.run.smithi092.stdout:266 2024-09-11T00:16:57.018 INFO:teuthology.orchestra.run.smithi092.stdout:266.out 2024-09-11T00:16:57.018 INFO:teuthology.orchestra.run.smithi092.stdout:267 2024-09-11T00:16:57.018 INFO:teuthology.orchestra.run.smithi092.stdout:267.out 2024-09-11T00:16:57.019 INFO:teuthology.orchestra.run.smithi092.stdout:268 2024-09-11T00:16:57.019 INFO:teuthology.orchestra.run.smithi092.stdout:268.out 2024-09-11T00:16:57.019 INFO:teuthology.orchestra.run.smithi092.stdout:269 2024-09-11T00:16:57.019 INFO:teuthology.orchestra.run.smithi092.stdout:269.out 2024-09-11T00:16:57.019 INFO:teuthology.orchestra.run.smithi092.stdout:270 2024-09-11T00:16:57.019 INFO:teuthology.orchestra.run.smithi092.stdout:270.out 2024-09-11T00:16:57.019 INFO:teuthology.orchestra.run.smithi092.stdout:271 2024-09-11T00:16:57.019 INFO:teuthology.orchestra.run.smithi092.stdout:271.out 2024-09-11T00:16:57.019 INFO:teuthology.orchestra.run.smithi092.stdout:272 2024-09-11T00:16:57.019 INFO:teuthology.orchestra.run.smithi092.stdout:272.out 2024-09-11T00:16:57.019 INFO:teuthology.orchestra.run.smithi092.stdout:273 2024-09-11T00:16:57.019 INFO:teuthology.orchestra.run.smithi092.stdout:273.out 2024-09-11T00:16:57.019 INFO:teuthology.orchestra.run.smithi092.stdout:274 2024-09-11T00:16:57.020 INFO:teuthology.orchestra.run.smithi092.stdout:274.out 2024-09-11T00:16:57.020 INFO:teuthology.orchestra.run.smithi092.stdout:275 2024-09-11T00:16:57.020 INFO:teuthology.orchestra.run.smithi092.stdout:275.out 2024-09-11T00:16:57.020 INFO:teuthology.orchestra.run.smithi092.stdout:276 2024-09-11T00:16:57.020 INFO:teuthology.orchestra.run.smithi092.stdout:276.out 2024-09-11T00:16:57.020 INFO:teuthology.orchestra.run.smithi092.stdout:277 2024-09-11T00:16:57.020 INFO:teuthology.orchestra.run.smithi092.stdout:277.out 2024-09-11T00:16:57.020 INFO:teuthology.orchestra.run.smithi092.stdout:278 2024-09-11T00:16:57.020 INFO:teuthology.orchestra.run.smithi092.stdout:278.out 2024-09-11T00:16:57.020 INFO:teuthology.orchestra.run.smithi092.stdout:279 2024-09-11T00:16:57.020 INFO:teuthology.orchestra.run.smithi092.stdout:279.out 2024-09-11T00:16:57.020 INFO:teuthology.orchestra.run.smithi092.stdout:280 2024-09-11T00:16:57.020 INFO:teuthology.orchestra.run.smithi092.stdout:280.out 2024-09-11T00:16:57.021 INFO:teuthology.orchestra.run.smithi092.stdout:281 2024-09-11T00:16:57.021 INFO:teuthology.orchestra.run.smithi092.stdout:281.out 2024-09-11T00:16:57.021 INFO:teuthology.orchestra.run.smithi092.stdout:282 2024-09-11T00:16:57.021 INFO:teuthology.orchestra.run.smithi092.stdout:282.out 2024-09-11T00:16:57.021 INFO:teuthology.orchestra.run.smithi092.stdout:283 2024-09-11T00:16:57.021 INFO:teuthology.orchestra.run.smithi092.stdout:283.out 2024-09-11T00:16:57.021 INFO:teuthology.orchestra.run.smithi092.stdout:284 2024-09-11T00:16:57.021 INFO:teuthology.orchestra.run.smithi092.stdout:284.out 2024-09-11T00:16:57.021 INFO:teuthology.orchestra.run.smithi092.stdout:285 2024-09-11T00:16:57.021 INFO:teuthology.orchestra.run.smithi092.stdout:285.out 2024-09-11T00:16:57.021 INFO:teuthology.orchestra.run.smithi092.stdout:286 2024-09-11T00:16:57.021 INFO:teuthology.orchestra.run.smithi092.stdout:286.out 2024-09-11T00:16:57.021 INFO:teuthology.orchestra.run.smithi092.stdout:287 2024-09-11T00:16:57.022 INFO:teuthology.orchestra.run.smithi092.stdout:287.out 2024-09-11T00:16:57.022 INFO:teuthology.orchestra.run.smithi092.stdout:288 2024-09-11T00:16:57.022 INFO:teuthology.orchestra.run.smithi092.stdout:288.out 2024-09-11T00:16:57.022 INFO:teuthology.orchestra.run.smithi092.stdout:289 2024-09-11T00:16:57.022 INFO:teuthology.orchestra.run.smithi092.stdout:289.out 2024-09-11T00:16:57.022 INFO:teuthology.orchestra.run.smithi092.stdout:290 2024-09-11T00:16:57.022 INFO:teuthology.orchestra.run.smithi092.stdout:290.out 2024-09-11T00:16:57.022 INFO:teuthology.orchestra.run.smithi092.stdout:291 2024-09-11T00:16:57.022 INFO:teuthology.orchestra.run.smithi092.stdout:291.out 2024-09-11T00:16:57.022 INFO:teuthology.orchestra.run.smithi092.stdout:292 2024-09-11T00:16:57.022 INFO:teuthology.orchestra.run.smithi092.stdout:292.out 2024-09-11T00:16:57.022 INFO:teuthology.orchestra.run.smithi092.stdout:293 2024-09-11T00:16:57.022 INFO:teuthology.orchestra.run.smithi092.stdout:293.out 2024-09-11T00:16:57.023 INFO:teuthology.orchestra.run.smithi092.stdout:294 2024-09-11T00:16:57.023 INFO:teuthology.orchestra.run.smithi092.stdout:294.out 2024-09-11T00:16:57.023 INFO:teuthology.orchestra.run.smithi092.stdout:295 2024-09-11T00:16:57.023 INFO:teuthology.orchestra.run.smithi092.stdout:295.out 2024-09-11T00:16:57.023 INFO:teuthology.orchestra.run.smithi092.stdout:296 2024-09-11T00:16:57.023 INFO:teuthology.orchestra.run.smithi092.stdout:296.out 2024-09-11T00:16:57.023 INFO:teuthology.orchestra.run.smithi092.stdout:297 2024-09-11T00:16:57.023 INFO:teuthology.orchestra.run.smithi092.stdout:297.out 2024-09-11T00:16:57.023 INFO:teuthology.orchestra.run.smithi092.stdout:298 2024-09-11T00:16:57.023 INFO:teuthology.orchestra.run.smithi092.stdout:298.out 2024-09-11T00:16:57.023 INFO:teuthology.orchestra.run.smithi092.stdout:299 2024-09-11T00:16:57.023 INFO:teuthology.orchestra.run.smithi092.stdout:299.out 2024-09-11T00:16:57.023 INFO:teuthology.orchestra.run.smithi092.stdout:300 2024-09-11T00:16:57.023 INFO:teuthology.orchestra.run.smithi092.stdout:300.out 2024-09-11T00:16:57.024 INFO:teuthology.orchestra.run.smithi092.stdout:301 2024-09-11T00:16:57.024 INFO:teuthology.orchestra.run.smithi092.stdout:301.out 2024-09-11T00:16:57.024 INFO:teuthology.orchestra.run.smithi092.stdout:302 2024-09-11T00:16:57.024 INFO:teuthology.orchestra.run.smithi092.stdout:302.out 2024-09-11T00:16:57.024 INFO:teuthology.orchestra.run.smithi092.stdout:303 2024-09-11T00:16:57.024 INFO:teuthology.orchestra.run.smithi092.stdout:303.out 2024-09-11T00:16:57.024 INFO:teuthology.orchestra.run.smithi092.stdout:304 2024-09-11T00:16:57.024 INFO:teuthology.orchestra.run.smithi092.stdout:304.out 2024-09-11T00:16:57.024 INFO:teuthology.orchestra.run.smithi092.stdout:305 2024-09-11T00:16:57.024 INFO:teuthology.orchestra.run.smithi092.stdout:305.out 2024-09-11T00:16:57.024 INFO:teuthology.orchestra.run.smithi092.stdout:306 2024-09-11T00:16:57.024 INFO:teuthology.orchestra.run.smithi092.stdout:306.out 2024-09-11T00:16:57.024 INFO:teuthology.orchestra.run.smithi092.stdout:307 2024-09-11T00:16:57.024 INFO:teuthology.orchestra.run.smithi092.stdout:307.out 2024-09-11T00:16:57.025 INFO:teuthology.orchestra.run.smithi092.stdout:308 2024-09-11T00:16:57.025 INFO:teuthology.orchestra.run.smithi092.stdout:308.out 2024-09-11T00:16:57.025 INFO:teuthology.orchestra.run.smithi092.stdout:309 2024-09-11T00:16:57.025 INFO:teuthology.orchestra.run.smithi092.stdout:309.out 2024-09-11T00:16:57.025 INFO:teuthology.orchestra.run.smithi092.stdout:310 2024-09-11T00:16:57.025 INFO:teuthology.orchestra.run.smithi092.stdout:310.out 2024-09-11T00:16:57.025 INFO:teuthology.orchestra.run.smithi092.stdout:311 2024-09-11T00:16:57.025 INFO:teuthology.orchestra.run.smithi092.stdout:311.out 2024-09-11T00:16:57.025 INFO:teuthology.orchestra.run.smithi092.stdout:312 2024-09-11T00:16:57.025 INFO:teuthology.orchestra.run.smithi092.stdout:312.out 2024-09-11T00:16:57.025 INFO:teuthology.orchestra.run.smithi092.stdout:313 2024-09-11T00:16:57.025 INFO:teuthology.orchestra.run.smithi092.stdout:313.out 2024-09-11T00:16:57.025 INFO:teuthology.orchestra.run.smithi092.stdout:314 2024-09-11T00:16:57.025 INFO:teuthology.orchestra.run.smithi092.stdout:314.out 2024-09-11T00:16:57.025 INFO:teuthology.orchestra.run.smithi092.stdout:315 2024-09-11T00:16:57.026 INFO:teuthology.orchestra.run.smithi092.stdout:315.out 2024-09-11T00:16:57.026 INFO:teuthology.orchestra.run.smithi092.stdout:316 2024-09-11T00:16:57.026 INFO:teuthology.orchestra.run.smithi092.stdout:316.out 2024-09-11T00:16:57.026 INFO:teuthology.orchestra.run.smithi092.stdout:317 2024-09-11T00:16:57.026 INFO:teuthology.orchestra.run.smithi092.stdout:317.out 2024-09-11T00:16:57.026 INFO:teuthology.orchestra.run.smithi092.stdout:318 2024-09-11T00:16:57.026 INFO:teuthology.orchestra.run.smithi092.stdout:318.out 2024-09-11T00:16:57.026 INFO:teuthology.orchestra.run.smithi092.stdout:319 2024-09-11T00:16:57.026 INFO:teuthology.orchestra.run.smithi092.stdout:319.out 2024-09-11T00:16:57.026 INFO:teuthology.orchestra.run.smithi092.stdout:320 2024-09-11T00:16:57.026 INFO:teuthology.orchestra.run.smithi092.stdout:320.out 2024-09-11T00:16:57.026 INFO:teuthology.orchestra.run.smithi092.stdout:321 2024-09-11T00:16:57.026 INFO:teuthology.orchestra.run.smithi092.stdout:321.out 2024-09-11T00:16:57.026 INFO:teuthology.orchestra.run.smithi092.stdout:322 2024-09-11T00:16:57.027 INFO:teuthology.orchestra.run.smithi092.stdout:322.out 2024-09-11T00:16:57.027 INFO:teuthology.orchestra.run.smithi092.stdout:323 2024-09-11T00:16:57.027 INFO:teuthology.orchestra.run.smithi092.stdout:323.out 2024-09-11T00:16:57.027 INFO:teuthology.orchestra.run.smithi092.stdout:324 2024-09-11T00:16:57.027 INFO:teuthology.orchestra.run.smithi092.stdout:324.out 2024-09-11T00:16:57.027 INFO:teuthology.orchestra.run.smithi092.stdout:325 2024-09-11T00:16:57.027 INFO:teuthology.orchestra.run.smithi092.stdout:325.out 2024-09-11T00:16:57.027 INFO:teuthology.orchestra.run.smithi092.stdout:326 2024-09-11T00:16:57.027 INFO:teuthology.orchestra.run.smithi092.stdout:326.out 2024-09-11T00:16:57.027 INFO:teuthology.orchestra.run.smithi092.stdout:327 2024-09-11T00:16:57.027 INFO:teuthology.orchestra.run.smithi092.stdout:327.out 2024-09-11T00:16:57.027 INFO:teuthology.orchestra.run.smithi092.stdout:328 2024-09-11T00:16:57.027 INFO:teuthology.orchestra.run.smithi092.stdout:328.out 2024-09-11T00:16:57.027 INFO:teuthology.orchestra.run.smithi092.stdout:329 2024-09-11T00:16:57.027 INFO:teuthology.orchestra.run.smithi092.stdout:329.out 2024-09-11T00:16:57.028 INFO:teuthology.orchestra.run.smithi092.stdout:330 2024-09-11T00:16:57.028 INFO:teuthology.orchestra.run.smithi092.stdout:330.out 2024-09-11T00:16:57.028 INFO:teuthology.orchestra.run.smithi092.stdout:331 2024-09-11T00:16:57.028 INFO:teuthology.orchestra.run.smithi092.stdout:331.out 2024-09-11T00:16:57.028 INFO:teuthology.orchestra.run.smithi092.stdout:332 2024-09-11T00:16:57.028 INFO:teuthology.orchestra.run.smithi092.stdout:332.out 2024-09-11T00:16:57.028 INFO:teuthology.orchestra.run.smithi092.stdout:333 2024-09-11T00:16:57.028 INFO:teuthology.orchestra.run.smithi092.stdout:333.out 2024-09-11T00:16:57.028 INFO:teuthology.orchestra.run.smithi092.stdout:334 2024-09-11T00:16:57.028 INFO:teuthology.orchestra.run.smithi092.stdout:334.out 2024-09-11T00:16:57.028 INFO:teuthology.orchestra.run.smithi092.stdout:335 2024-09-11T00:16:57.028 INFO:teuthology.orchestra.run.smithi092.stdout:335.out 2024-09-11T00:16:57.028 INFO:teuthology.orchestra.run.smithi092.stdout:336 2024-09-11T00:16:57.028 INFO:teuthology.orchestra.run.smithi092.stdout:336.out 2024-09-11T00:16:57.029 INFO:teuthology.orchestra.run.smithi092.stdout:337 2024-09-11T00:16:57.029 INFO:teuthology.orchestra.run.smithi092.stdout:337.out 2024-09-11T00:16:57.029 INFO:teuthology.orchestra.run.smithi092.stdout:338 2024-09-11T00:16:57.029 INFO:teuthology.orchestra.run.smithi092.stdout:338.out 2024-09-11T00:16:57.029 INFO:teuthology.orchestra.run.smithi092.stdout:339 2024-09-11T00:16:57.029 INFO:teuthology.orchestra.run.smithi092.stdout:339.out 2024-09-11T00:16:57.029 INFO:teuthology.orchestra.run.smithi092.stdout:340 2024-09-11T00:16:57.029 INFO:teuthology.orchestra.run.smithi092.stdout:340.out 2024-09-11T00:16:57.029 INFO:teuthology.orchestra.run.smithi092.stdout:341 2024-09-11T00:16:57.029 INFO:teuthology.orchestra.run.smithi092.stdout:341.out 2024-09-11T00:16:57.029 INFO:teuthology.orchestra.run.smithi092.stdout:342 2024-09-11T00:16:57.029 INFO:teuthology.orchestra.run.smithi092.stdout:342.out 2024-09-11T00:16:57.029 INFO:teuthology.orchestra.run.smithi092.stdout:343 2024-09-11T00:16:57.029 INFO:teuthology.orchestra.run.smithi092.stdout:343.out 2024-09-11T00:16:57.030 INFO:teuthology.orchestra.run.smithi092.stdout:344 2024-09-11T00:16:57.030 INFO:teuthology.orchestra.run.smithi092.stdout:344.out 2024-09-11T00:16:57.030 INFO:teuthology.orchestra.run.smithi092.stdout:345 2024-09-11T00:16:57.030 INFO:teuthology.orchestra.run.smithi092.stdout:345.out 2024-09-11T00:16:57.030 INFO:teuthology.orchestra.run.smithi092.stdout:346 2024-09-11T00:16:57.030 INFO:teuthology.orchestra.run.smithi092.stdout:346.out 2024-09-11T00:16:57.030 INFO:teuthology.orchestra.run.smithi092.stdout:347 2024-09-11T00:16:57.030 INFO:teuthology.orchestra.run.smithi092.stdout:347.out 2024-09-11T00:16:57.030 INFO:teuthology.orchestra.run.smithi092.stdout:348 2024-09-11T00:16:57.030 INFO:teuthology.orchestra.run.smithi092.stdout:348.out 2024-09-11T00:16:57.030 INFO:teuthology.orchestra.run.smithi092.stdout:349 2024-09-11T00:16:57.030 INFO:teuthology.orchestra.run.smithi092.stdout:349.out 2024-09-11T00:16:57.030 INFO:teuthology.orchestra.run.smithi092.stdout:350 2024-09-11T00:16:57.030 INFO:teuthology.orchestra.run.smithi092.stdout:350.out 2024-09-11T00:16:57.030 INFO:teuthology.orchestra.run.smithi092.stdout:351 2024-09-11T00:16:57.031 INFO:teuthology.orchestra.run.smithi092.stdout:351.out 2024-09-11T00:16:57.031 INFO:teuthology.orchestra.run.smithi092.stdout:352 2024-09-11T00:16:57.031 INFO:teuthology.orchestra.run.smithi092.stdout:352.out 2024-09-11T00:16:57.031 INFO:teuthology.orchestra.run.smithi092.stdout:353 2024-09-11T00:16:57.031 INFO:teuthology.orchestra.run.smithi092.stdout:353.out 2024-09-11T00:16:57.031 INFO:teuthology.orchestra.run.smithi092.stdout:354 2024-09-11T00:16:57.031 INFO:teuthology.orchestra.run.smithi092.stdout:354.out 2024-09-11T00:16:57.031 INFO:teuthology.orchestra.run.smithi092.stdout:355 2024-09-11T00:16:57.031 INFO:teuthology.orchestra.run.smithi092.stdout:355.out 2024-09-11T00:16:57.031 INFO:teuthology.orchestra.run.smithi092.stdout:356 2024-09-11T00:16:57.031 INFO:teuthology.orchestra.run.smithi092.stdout:356.out 2024-09-11T00:16:57.031 INFO:teuthology.orchestra.run.smithi092.stdout:357 2024-09-11T00:16:57.031 INFO:teuthology.orchestra.run.smithi092.stdout:357.out 2024-09-11T00:16:57.031 INFO:teuthology.orchestra.run.smithi092.stdout:358 2024-09-11T00:16:57.032 INFO:teuthology.orchestra.run.smithi092.stdout:358.out 2024-09-11T00:16:57.032 INFO:teuthology.orchestra.run.smithi092.stdout:359 2024-09-11T00:16:57.032 INFO:teuthology.orchestra.run.smithi092.stdout:359.out 2024-09-11T00:16:57.032 INFO:teuthology.orchestra.run.smithi092.stdout:360 2024-09-11T00:16:57.032 INFO:teuthology.orchestra.run.smithi092.stdout:360.out 2024-09-11T00:16:57.032 INFO:teuthology.orchestra.run.smithi092.stdout:361 2024-09-11T00:16:57.032 INFO:teuthology.orchestra.run.smithi092.stdout:361.out 2024-09-11T00:16:57.032 INFO:teuthology.orchestra.run.smithi092.stdout:362 2024-09-11T00:16:57.032 INFO:teuthology.orchestra.run.smithi092.stdout:362.out 2024-09-11T00:16:57.032 INFO:teuthology.orchestra.run.smithi092.stdout:371 2024-09-11T00:16:57.032 INFO:teuthology.orchestra.run.smithi092.stdout:371.out 2024-09-11T00:16:57.032 INFO:teuthology.orchestra.run.smithi092.stdout:372 2024-09-11T00:16:57.032 INFO:teuthology.orchestra.run.smithi092.stdout:372.out 2024-09-11T00:16:57.032 INFO:teuthology.orchestra.run.smithi092.stdout:373 2024-09-11T00:16:57.033 INFO:teuthology.orchestra.run.smithi092.stdout:373.out 2024-09-11T00:16:57.033 INFO:teuthology.orchestra.run.smithi092.stdout:374 2024-09-11T00:16:57.033 INFO:teuthology.orchestra.run.smithi092.stdout:374.out 2024-09-11T00:16:57.033 INFO:teuthology.orchestra.run.smithi092.stdout:375 2024-09-11T00:16:57.033 INFO:teuthology.orchestra.run.smithi092.stdout:375.out 2024-09-11T00:16:57.033 INFO:teuthology.orchestra.run.smithi092.stdout:376 2024-09-11T00:16:57.033 INFO:teuthology.orchestra.run.smithi092.stdout:376.out 2024-09-11T00:16:57.033 INFO:teuthology.orchestra.run.smithi092.stdout:377 2024-09-11T00:16:57.033 INFO:teuthology.orchestra.run.smithi092.stdout:377.out 2024-09-11T00:16:57.033 INFO:teuthology.orchestra.run.smithi092.stdout:378 2024-09-11T00:16:57.033 INFO:teuthology.orchestra.run.smithi092.stdout:378.out 2024-09-11T00:16:57.033 INFO:teuthology.orchestra.run.smithi092.stdout:379 2024-09-11T00:16:57.033 INFO:teuthology.orchestra.run.smithi092.stdout:379.out 2024-09-11T00:16:57.034 INFO:teuthology.orchestra.run.smithi092.stdout:380 2024-09-11T00:16:57.034 INFO:teuthology.orchestra.run.smithi092.stdout:380.out 2024-09-11T00:16:57.034 INFO:teuthology.orchestra.run.smithi092.stdout:381 2024-09-11T00:16:57.034 INFO:teuthology.orchestra.run.smithi092.stdout:381.out 2024-09-11T00:16:57.034 INFO:teuthology.orchestra.run.smithi092.stdout:382 2024-09-11T00:16:57.034 INFO:teuthology.orchestra.run.smithi092.stdout:382.out 2024-09-11T00:16:57.034 INFO:teuthology.orchestra.run.smithi092.stdout:383 2024-09-11T00:16:57.034 INFO:teuthology.orchestra.run.smithi092.stdout:383.out 2024-09-11T00:16:57.034 INFO:teuthology.orchestra.run.smithi092.stdout:384 2024-09-11T00:16:57.034 INFO:teuthology.orchestra.run.smithi092.stdout:384.out 2024-09-11T00:16:57.034 INFO:teuthology.orchestra.run.smithi092.stdout:385 2024-09-11T00:16:57.034 INFO:teuthology.orchestra.run.smithi092.stdout:385.out 2024-09-11T00:16:57.034 INFO:teuthology.orchestra.run.smithi092.stdout:386 2024-09-11T00:16:57.034 INFO:teuthology.orchestra.run.smithi092.stdout:386.out 2024-09-11T00:16:57.034 INFO:teuthology.orchestra.run.smithi092.stdout:387 2024-09-11T00:16:57.035 INFO:teuthology.orchestra.run.smithi092.stdout:387.out 2024-09-11T00:16:57.035 INFO:teuthology.orchestra.run.smithi092.stdout:388 2024-09-11T00:16:57.035 INFO:teuthology.orchestra.run.smithi092.stdout:388.out 2024-09-11T00:16:57.035 INFO:teuthology.orchestra.run.smithi092.stdout:389 2024-09-11T00:16:57.035 INFO:teuthology.orchestra.run.smithi092.stdout:389.out 2024-09-11T00:16:57.035 INFO:teuthology.orchestra.run.smithi092.stdout:390 2024-09-11T00:16:57.035 INFO:teuthology.orchestra.run.smithi092.stdout:390.out 2024-09-11T00:16:57.035 INFO:teuthology.orchestra.run.smithi092.stdout:391 2024-09-11T00:16:57.035 INFO:teuthology.orchestra.run.smithi092.stdout:391.out 2024-09-11T00:16:57.035 INFO:teuthology.orchestra.run.smithi092.stdout:392 2024-09-11T00:16:57.035 INFO:teuthology.orchestra.run.smithi092.stdout:392.out 2024-09-11T00:16:57.035 INFO:teuthology.orchestra.run.smithi092.stdout:393 2024-09-11T00:16:57.035 INFO:teuthology.orchestra.run.smithi092.stdout:393.out 2024-09-11T00:16:57.035 INFO:teuthology.orchestra.run.smithi092.stdout:394 2024-09-11T00:16:57.035 INFO:teuthology.orchestra.run.smithi092.stdout:394.out 2024-09-11T00:16:57.036 INFO:teuthology.orchestra.run.smithi092.stdout:395 2024-09-11T00:16:57.036 INFO:teuthology.orchestra.run.smithi092.stdout:395.out 2024-09-11T00:16:57.036 INFO:teuthology.orchestra.run.smithi092.stdout:396 2024-09-11T00:16:57.036 INFO:teuthology.orchestra.run.smithi092.stdout:396.out 2024-09-11T00:16:57.036 INFO:teuthology.orchestra.run.smithi092.stdout:397 2024-09-11T00:16:57.036 INFO:teuthology.orchestra.run.smithi092.stdout:397.out 2024-09-11T00:16:57.036 INFO:teuthology.orchestra.run.smithi092.stdout:398 2024-09-11T00:16:57.036 INFO:teuthology.orchestra.run.smithi092.stdout:398.out 2024-09-11T00:16:57.036 INFO:teuthology.orchestra.run.smithi092.stdout:399 2024-09-11T00:16:57.036 INFO:teuthology.orchestra.run.smithi092.stdout:399.out 2024-09-11T00:16:57.036 INFO:teuthology.orchestra.run.smithi092.stdout:400 2024-09-11T00:16:57.036 INFO:teuthology.orchestra.run.smithi092.stdout:400.out 2024-09-11T00:16:57.036 INFO:teuthology.orchestra.run.smithi092.stdout:401 2024-09-11T00:16:57.036 INFO:teuthology.orchestra.run.smithi092.stdout:401.out 2024-09-11T00:16:57.037 INFO:teuthology.orchestra.run.smithi092.stdout:402 2024-09-11T00:16:57.037 INFO:teuthology.orchestra.run.smithi092.stdout:402.out 2024-09-11T00:16:57.037 INFO:teuthology.orchestra.run.smithi092.stdout:403 2024-09-11T00:16:57.037 INFO:teuthology.orchestra.run.smithi092.stdout:403.out 2024-09-11T00:16:57.037 INFO:teuthology.orchestra.run.smithi092.stdout:404 2024-09-11T00:16:57.037 INFO:teuthology.orchestra.run.smithi092.stdout:404.out 2024-09-11T00:16:57.037 INFO:teuthology.orchestra.run.smithi092.stdout:405 2024-09-11T00:16:57.037 INFO:teuthology.orchestra.run.smithi092.stdout:405.out 2024-09-11T00:16:57.037 INFO:teuthology.orchestra.run.smithi092.stdout:406 2024-09-11T00:16:57.037 INFO:teuthology.orchestra.run.smithi092.stdout:406.out 2024-09-11T00:16:57.037 INFO:teuthology.orchestra.run.smithi092.stdout:407 2024-09-11T00:16:57.037 INFO:teuthology.orchestra.run.smithi092.stdout:407.out 2024-09-11T00:16:57.037 INFO:teuthology.orchestra.run.smithi092.stdout:408 2024-09-11T00:16:57.037 INFO:teuthology.orchestra.run.smithi092.stdout:408.out 2024-09-11T00:16:57.038 INFO:teuthology.orchestra.run.smithi092.stdout:409 2024-09-11T00:16:57.038 INFO:teuthology.orchestra.run.smithi092.stdout:409.out 2024-09-11T00:16:57.038 INFO:teuthology.orchestra.run.smithi092.stdout:410 2024-09-11T00:16:57.038 INFO:teuthology.orchestra.run.smithi092.stdout:410.out 2024-09-11T00:16:57.038 INFO:teuthology.orchestra.run.smithi092.stdout:411 2024-09-11T00:16:57.038 INFO:teuthology.orchestra.run.smithi092.stdout:411.out 2024-09-11T00:16:57.038 INFO:teuthology.orchestra.run.smithi092.stdout:412 2024-09-11T00:16:57.038 INFO:teuthology.orchestra.run.smithi092.stdout:412.out 2024-09-11T00:16:57.038 INFO:teuthology.orchestra.run.smithi092.stdout:413 2024-09-11T00:16:57.038 INFO:teuthology.orchestra.run.smithi092.stdout:413.out 2024-09-11T00:16:57.038 INFO:teuthology.orchestra.run.smithi092.stdout:414 2024-09-11T00:16:57.038 INFO:teuthology.orchestra.run.smithi092.stdout:414.out 2024-09-11T00:16:57.038 INFO:teuthology.orchestra.run.smithi092.stdout:415 2024-09-11T00:16:57.038 INFO:teuthology.orchestra.run.smithi092.stdout:415.out 2024-09-11T00:16:57.039 INFO:teuthology.orchestra.run.smithi092.stdout:416 2024-09-11T00:16:57.039 INFO:teuthology.orchestra.run.smithi092.stdout:416.out 2024-09-11T00:16:57.039 INFO:teuthology.orchestra.run.smithi092.stdout:417 2024-09-11T00:16:57.039 INFO:teuthology.orchestra.run.smithi092.stdout:417.out 2024-09-11T00:16:57.039 INFO:teuthology.orchestra.run.smithi092.stdout:418 2024-09-11T00:16:57.039 INFO:teuthology.orchestra.run.smithi092.stdout:418.out 2024-09-11T00:16:57.039 INFO:teuthology.orchestra.run.smithi092.stdout:419 2024-09-11T00:16:57.039 INFO:teuthology.orchestra.run.smithi092.stdout:419.out 2024-09-11T00:16:57.039 INFO:teuthology.orchestra.run.smithi092.stdout:420 2024-09-11T00:16:57.039 INFO:teuthology.orchestra.run.smithi092.stdout:420.out 2024-09-11T00:16:57.039 INFO:teuthology.orchestra.run.smithi092.stdout:421 2024-09-11T00:16:57.039 INFO:teuthology.orchestra.run.smithi092.stdout:421.out 2024-09-11T00:16:57.039 INFO:teuthology.orchestra.run.smithi092.stdout:422 2024-09-11T00:16:57.039 INFO:teuthology.orchestra.run.smithi092.stdout:422.out 2024-09-11T00:16:57.039 INFO:teuthology.orchestra.run.smithi092.stdout:423 2024-09-11T00:16:57.040 INFO:teuthology.orchestra.run.smithi092.stdout:423.out 2024-09-11T00:16:57.040 INFO:teuthology.orchestra.run.smithi092.stdout:424 2024-09-11T00:16:57.040 INFO:teuthology.orchestra.run.smithi092.stdout:424.out 2024-09-11T00:16:57.040 INFO:teuthology.orchestra.run.smithi092.stdout:425 2024-09-11T00:16:57.040 INFO:teuthology.orchestra.run.smithi092.stdout:425.out 2024-09-11T00:16:57.040 INFO:teuthology.orchestra.run.smithi092.stdout:426 2024-09-11T00:16:57.040 INFO:teuthology.orchestra.run.smithi092.stdout:426.out 2024-09-11T00:16:57.040 INFO:teuthology.orchestra.run.smithi092.stdout:427 2024-09-11T00:16:57.040 INFO:teuthology.orchestra.run.smithi092.stdout:427.out 2024-09-11T00:16:57.040 INFO:teuthology.orchestra.run.smithi092.stdout:428 2024-09-11T00:16:57.040 INFO:teuthology.orchestra.run.smithi092.stdout:428.out 2024-09-11T00:16:57.040 INFO:teuthology.orchestra.run.smithi092.stdout:429 2024-09-11T00:16:57.040 INFO:teuthology.orchestra.run.smithi092.stdout:429.out 2024-09-11T00:16:57.041 INFO:teuthology.orchestra.run.smithi092.stdout:430 2024-09-11T00:16:57.041 INFO:teuthology.orchestra.run.smithi092.stdout:430.out 2024-09-11T00:16:57.041 INFO:teuthology.orchestra.run.smithi092.stdout:431 2024-09-11T00:16:57.041 INFO:teuthology.orchestra.run.smithi092.stdout:431.out 2024-09-11T00:16:57.041 INFO:teuthology.orchestra.run.smithi092.stdout:432 2024-09-11T00:16:57.041 INFO:teuthology.orchestra.run.smithi092.stdout:432.out 2024-09-11T00:16:57.041 INFO:teuthology.orchestra.run.smithi092.stdout:433 2024-09-11T00:16:57.041 INFO:teuthology.orchestra.run.smithi092.stdout:433.out 2024-09-11T00:16:57.041 INFO:teuthology.orchestra.run.smithi092.stdout:434 2024-09-11T00:16:57.041 INFO:teuthology.orchestra.run.smithi092.stdout:434.out 2024-09-11T00:16:57.041 INFO:teuthology.orchestra.run.smithi092.stdout:435 2024-09-11T00:16:57.041 INFO:teuthology.orchestra.run.smithi092.stdout:435.out 2024-09-11T00:16:57.041 INFO:teuthology.orchestra.run.smithi092.stdout:436 2024-09-11T00:16:57.041 INFO:teuthology.orchestra.run.smithi092.stdout:436.out 2024-09-11T00:16:57.042 INFO:teuthology.orchestra.run.smithi092.stdout:437 2024-09-11T00:16:57.042 INFO:teuthology.orchestra.run.smithi092.stdout:437.out 2024-09-11T00:16:57.042 INFO:teuthology.orchestra.run.smithi092.stdout:438 2024-09-11T00:16:57.042 INFO:teuthology.orchestra.run.smithi092.stdout:438.out 2024-09-11T00:16:57.042 INFO:teuthology.orchestra.run.smithi092.stdout:439 2024-09-11T00:16:57.042 INFO:teuthology.orchestra.run.smithi092.stdout:439.out 2024-09-11T00:16:57.042 INFO:teuthology.orchestra.run.smithi092.stdout:440 2024-09-11T00:16:57.042 INFO:teuthology.orchestra.run.smithi092.stdout:440.out 2024-09-11T00:16:57.042 INFO:teuthology.orchestra.run.smithi092.stdout:441 2024-09-11T00:16:57.042 INFO:teuthology.orchestra.run.smithi092.stdout:441.out 2024-09-11T00:16:57.042 INFO:teuthology.orchestra.run.smithi092.stdout:442 2024-09-11T00:16:57.042 INFO:teuthology.orchestra.run.smithi092.stdout:442.out 2024-09-11T00:16:57.042 INFO:teuthology.orchestra.run.smithi092.stdout:443 2024-09-11T00:16:57.043 INFO:teuthology.orchestra.run.smithi092.stdout:443.out 2024-09-11T00:16:57.043 INFO:teuthology.orchestra.run.smithi092.stdout:444 2024-09-11T00:16:57.043 INFO:teuthology.orchestra.run.smithi092.stdout:444.out 2024-09-11T00:16:57.043 INFO:teuthology.orchestra.run.smithi092.stdout:445 2024-09-11T00:16:57.043 INFO:teuthology.orchestra.run.smithi092.stdout:445.out 2024-09-11T00:16:57.043 INFO:teuthology.orchestra.run.smithi092.stdout:446 2024-09-11T00:16:57.043 INFO:teuthology.orchestra.run.smithi092.stdout:446.out 2024-09-11T00:16:57.043 INFO:teuthology.orchestra.run.smithi092.stdout:447 2024-09-11T00:16:57.043 INFO:teuthology.orchestra.run.smithi092.stdout:447.out 2024-09-11T00:16:57.043 INFO:teuthology.orchestra.run.smithi092.stdout:448 2024-09-11T00:16:57.043 INFO:teuthology.orchestra.run.smithi092.stdout:448.out 2024-09-11T00:16:57.043 INFO:teuthology.orchestra.run.smithi092.stdout:449 2024-09-11T00:16:57.043 INFO:teuthology.orchestra.run.smithi092.stdout:449.out 2024-09-11T00:16:57.043 INFO:teuthology.orchestra.run.smithi092.stdout:450 2024-09-11T00:16:57.044 INFO:teuthology.orchestra.run.smithi092.stdout:450.out 2024-09-11T00:16:57.044 INFO:teuthology.orchestra.run.smithi092.stdout:451 2024-09-11T00:16:57.044 INFO:teuthology.orchestra.run.smithi092.stdout:451.out 2024-09-11T00:16:57.044 INFO:teuthology.orchestra.run.smithi092.stdout:452 2024-09-11T00:16:57.044 INFO:teuthology.orchestra.run.smithi092.stdout:452.out 2024-09-11T00:16:57.044 INFO:teuthology.orchestra.run.smithi092.stdout:453 2024-09-11T00:16:57.044 INFO:teuthology.orchestra.run.smithi092.stdout:453.out 2024-09-11T00:16:57.044 INFO:teuthology.orchestra.run.smithi092.stdout:454 2024-09-11T00:16:57.044 INFO:teuthology.orchestra.run.smithi092.stdout:454.out 2024-09-11T00:16:57.044 INFO:teuthology.orchestra.run.smithi092.stdout:455 2024-09-11T00:16:57.044 INFO:teuthology.orchestra.run.smithi092.stdout:455.out 2024-09-11T00:16:57.044 INFO:teuthology.orchestra.run.smithi092.stdout:456 2024-09-11T00:16:57.044 INFO:teuthology.orchestra.run.smithi092.stdout:456.out 2024-09-11T00:16:57.044 INFO:teuthology.orchestra.run.smithi092.stdout:457 2024-09-11T00:16:57.045 INFO:teuthology.orchestra.run.smithi092.stdout:457.out 2024-09-11T00:16:57.045 INFO:teuthology.orchestra.run.smithi092.stdout:458 2024-09-11T00:16:57.045 INFO:teuthology.orchestra.run.smithi092.stdout:458.out 2024-09-11T00:16:57.045 INFO:teuthology.orchestra.run.smithi092.stdout:459 2024-09-11T00:16:57.045 INFO:teuthology.orchestra.run.smithi092.stdout:459.out 2024-09-11T00:16:57.045 INFO:teuthology.orchestra.run.smithi092.stdout:460 2024-09-11T00:16:57.045 INFO:teuthology.orchestra.run.smithi092.stdout:460.out 2024-09-11T00:16:57.045 INFO:teuthology.orchestra.run.smithi092.stdout:461 2024-09-11T00:16:57.045 INFO:teuthology.orchestra.run.smithi092.stdout:461.out 2024-09-11T00:16:57.045 INFO:teuthology.orchestra.run.smithi092.stdout:462 2024-09-11T00:16:57.045 INFO:teuthology.orchestra.run.smithi092.stdout:462.out 2024-09-11T00:16:57.045 INFO:teuthology.orchestra.run.smithi092.stdout:463 2024-09-11T00:16:57.045 INFO:teuthology.orchestra.run.smithi092.stdout:463.out 2024-09-11T00:16:57.045 INFO:teuthology.orchestra.run.smithi092.stdout:464 2024-09-11T00:16:57.046 INFO:teuthology.orchestra.run.smithi092.stdout:464.out 2024-09-11T00:16:57.046 INFO:teuthology.orchestra.run.smithi092.stdout:465 2024-09-11T00:16:57.046 INFO:teuthology.orchestra.run.smithi092.stdout:465.out 2024-09-11T00:16:57.046 INFO:teuthology.orchestra.run.smithi092.stdout:466 2024-09-11T00:16:57.046 INFO:teuthology.orchestra.run.smithi092.stdout:466.out 2024-09-11T00:16:57.046 INFO:teuthology.orchestra.run.smithi092.stdout:467 2024-09-11T00:16:57.046 INFO:teuthology.orchestra.run.smithi092.stdout:467.out 2024-09-11T00:16:57.046 INFO:teuthology.orchestra.run.smithi092.stdout:468 2024-09-11T00:16:57.046 INFO:teuthology.orchestra.run.smithi092.stdout:468.out 2024-09-11T00:16:57.046 INFO:teuthology.orchestra.run.smithi092.stdout:469 2024-09-11T00:16:57.046 INFO:teuthology.orchestra.run.smithi092.stdout:469.out 2024-09-11T00:16:57.046 INFO:teuthology.orchestra.run.smithi092.stdout:470 2024-09-11T00:16:57.046 INFO:teuthology.orchestra.run.smithi092.stdout:470.out 2024-09-11T00:16:57.047 INFO:teuthology.orchestra.run.smithi092.stdout:471 2024-09-11T00:16:57.047 INFO:teuthology.orchestra.run.smithi092.stdout:471.out 2024-09-11T00:16:57.047 INFO:teuthology.orchestra.run.smithi092.stdout:472 2024-09-11T00:16:57.047 INFO:teuthology.orchestra.run.smithi092.stdout:472.out 2024-09-11T00:16:57.047 INFO:teuthology.orchestra.run.smithi092.stdout:473 2024-09-11T00:16:57.047 INFO:teuthology.orchestra.run.smithi092.stdout:473.out 2024-09-11T00:16:57.047 INFO:teuthology.orchestra.run.smithi092.stdout:474 2024-09-11T00:16:57.047 INFO:teuthology.orchestra.run.smithi092.stdout:474.out 2024-09-11T00:16:57.047 INFO:teuthology.orchestra.run.smithi092.stdout:475 2024-09-11T00:16:57.047 INFO:teuthology.orchestra.run.smithi092.stdout:475.out 2024-09-11T00:16:57.047 INFO:teuthology.orchestra.run.smithi092.stdout:476 2024-09-11T00:16:57.047 INFO:teuthology.orchestra.run.smithi092.stdout:476.out 2024-09-11T00:16:57.047 INFO:teuthology.orchestra.run.smithi092.stdout:477 2024-09-11T00:16:57.047 INFO:teuthology.orchestra.run.smithi092.stdout:477.out 2024-09-11T00:16:57.048 INFO:teuthology.orchestra.run.smithi092.stdout:478 2024-09-11T00:16:57.048 INFO:teuthology.orchestra.run.smithi092.stdout:478.out 2024-09-11T00:16:57.048 INFO:teuthology.orchestra.run.smithi092.stdout:479 2024-09-11T00:16:57.048 INFO:teuthology.orchestra.run.smithi092.stdout:479.out 2024-09-11T00:16:57.048 INFO:teuthology.orchestra.run.smithi092.stdout:480 2024-09-11T00:16:57.048 INFO:teuthology.orchestra.run.smithi092.stdout:480.out 2024-09-11T00:16:57.048 INFO:teuthology.orchestra.run.smithi092.stdout:481 2024-09-11T00:16:57.048 INFO:teuthology.orchestra.run.smithi092.stdout:481.out 2024-09-11T00:16:57.048 INFO:teuthology.orchestra.run.smithi092.stdout:482 2024-09-11T00:16:57.048 INFO:teuthology.orchestra.run.smithi092.stdout:482.out 2024-09-11T00:16:57.048 INFO:teuthology.orchestra.run.smithi092.stdout:483 2024-09-11T00:16:57.048 INFO:teuthology.orchestra.run.smithi092.stdout:483.out 2024-09-11T00:16:57.048 INFO:teuthology.orchestra.run.smithi092.stdout:484 2024-09-11T00:16:57.049 INFO:teuthology.orchestra.run.smithi092.stdout:484.out 2024-09-11T00:16:57.049 INFO:teuthology.orchestra.run.smithi092.stdout:485 2024-09-11T00:16:57.049 INFO:teuthology.orchestra.run.smithi092.stdout:485.out 2024-09-11T00:16:57.049 INFO:teuthology.orchestra.run.smithi092.stdout:486 2024-09-11T00:16:57.049 INFO:teuthology.orchestra.run.smithi092.stdout:486.out 2024-09-11T00:16:57.049 INFO:teuthology.orchestra.run.smithi092.stdout:487 2024-09-11T00:16:57.049 INFO:teuthology.orchestra.run.smithi092.stdout:487.out 2024-09-11T00:16:57.049 INFO:teuthology.orchestra.run.smithi092.stdout:488 2024-09-11T00:16:57.049 INFO:teuthology.orchestra.run.smithi092.stdout:488.out 2024-09-11T00:16:57.049 INFO:teuthology.orchestra.run.smithi092.stdout:489 2024-09-11T00:16:57.049 INFO:teuthology.orchestra.run.smithi092.stdout:489.out 2024-09-11T00:16:57.049 INFO:teuthology.orchestra.run.smithi092.stdout:490 2024-09-11T00:16:57.049 INFO:teuthology.orchestra.run.smithi092.stdout:490.out 2024-09-11T00:16:57.050 INFO:teuthology.orchestra.run.smithi092.stdout:491 2024-09-11T00:16:57.050 INFO:teuthology.orchestra.run.smithi092.stdout:491.out 2024-09-11T00:16:57.050 INFO:teuthology.orchestra.run.smithi092.stdout:492 2024-09-11T00:16:57.050 INFO:teuthology.orchestra.run.smithi092.stdout:492.out 2024-09-11T00:16:57.050 INFO:teuthology.orchestra.run.smithi092.stdout:493 2024-09-11T00:16:57.050 INFO:teuthology.orchestra.run.smithi092.stdout:493.out 2024-09-11T00:16:57.050 INFO:teuthology.orchestra.run.smithi092.stdout:494 2024-09-11T00:16:57.050 INFO:teuthology.orchestra.run.smithi092.stdout:494.out 2024-09-11T00:16:57.050 INFO:teuthology.orchestra.run.smithi092.stdout:495 2024-09-11T00:16:57.050 INFO:teuthology.orchestra.run.smithi092.stdout:495.out 2024-09-11T00:16:57.050 INFO:teuthology.orchestra.run.smithi092.stdout:496 2024-09-11T00:16:57.050 INFO:teuthology.orchestra.run.smithi092.stdout:496.out 2024-09-11T00:16:57.050 INFO:teuthology.orchestra.run.smithi092.stdout:497 2024-09-11T00:16:57.051 INFO:teuthology.orchestra.run.smithi092.stdout:497.out 2024-09-11T00:16:57.051 INFO:teuthology.orchestra.run.smithi092.stdout:498 2024-09-11T00:16:57.051 INFO:teuthology.orchestra.run.smithi092.stdout:498.out 2024-09-11T00:16:57.051 INFO:teuthology.orchestra.run.smithi092.stdout:499 2024-09-11T00:16:57.051 INFO:teuthology.orchestra.run.smithi092.stdout:499.out 2024-09-11T00:16:57.051 INFO:teuthology.orchestra.run.smithi092.stdout:500 2024-09-11T00:16:57.051 INFO:teuthology.orchestra.run.smithi092.stdout:500.out 2024-09-11T00:16:57.051 INFO:teuthology.orchestra.run.smithi092.stdout:501 2024-09-11T00:16:57.051 INFO:teuthology.orchestra.run.smithi092.stdout:501.out 2024-09-11T00:16:57.051 INFO:teuthology.orchestra.run.smithi092.stdout:502 2024-09-11T00:16:57.051 INFO:teuthology.orchestra.run.smithi092.stdout:502.out 2024-09-11T00:16:57.051 INFO:teuthology.orchestra.run.smithi092.stdout:503 2024-09-11T00:16:57.051 INFO:teuthology.orchestra.run.smithi092.stdout:503.out 2024-09-11T00:16:57.051 INFO:teuthology.orchestra.run.smithi092.stdout:504 2024-09-11T00:16:57.052 INFO:teuthology.orchestra.run.smithi092.stdout:504.out 2024-09-11T00:16:57.052 INFO:teuthology.orchestra.run.smithi092.stdout:505 2024-09-11T00:16:57.052 INFO:teuthology.orchestra.run.smithi092.stdout:505.out 2024-09-11T00:16:57.052 INFO:teuthology.orchestra.run.smithi092.stdout:506 2024-09-11T00:16:57.052 INFO:teuthology.orchestra.run.smithi092.stdout:506.out 2024-09-11T00:16:57.052 INFO:teuthology.orchestra.run.smithi092.stdout:507 2024-09-11T00:16:57.052 INFO:teuthology.orchestra.run.smithi092.stdout:507.out 2024-09-11T00:16:57.052 INFO:teuthology.orchestra.run.smithi092.stdout:508 2024-09-11T00:16:57.052 INFO:teuthology.orchestra.run.smithi092.stdout:508.out 2024-09-11T00:16:57.052 INFO:teuthology.orchestra.run.smithi092.stdout:509 2024-09-11T00:16:57.052 INFO:teuthology.orchestra.run.smithi092.stdout:509.out 2024-09-11T00:16:57.052 INFO:teuthology.orchestra.run.smithi092.stdout:510 2024-09-11T00:16:57.052 INFO:teuthology.orchestra.run.smithi092.stdout:510.out 2024-09-11T00:16:57.052 INFO:teuthology.orchestra.run.smithi092.stdout:511 2024-09-11T00:16:57.053 INFO:teuthology.orchestra.run.smithi092.stdout:511.out 2024-09-11T00:16:57.053 INFO:teuthology.orchestra.run.smithi092.stdout:512 2024-09-11T00:16:57.053 INFO:teuthology.orchestra.run.smithi092.stdout:512.out 2024-09-11T00:16:57.053 INFO:teuthology.orchestra.run.smithi092.stdout:513 2024-09-11T00:16:57.053 INFO:teuthology.orchestra.run.smithi092.stdout:513.out 2024-09-11T00:16:57.053 INFO:teuthology.orchestra.run.smithi092.stdout:514 2024-09-11T00:16:57.053 INFO:teuthology.orchestra.run.smithi092.stdout:514.out 2024-09-11T00:16:57.053 INFO:teuthology.orchestra.run.smithi092.stdout:515 2024-09-11T00:16:57.053 INFO:teuthology.orchestra.run.smithi092.stdout:515.out 2024-09-11T00:16:57.053 INFO:teuthology.orchestra.run.smithi092.stdout:516 2024-09-11T00:16:57.053 INFO:teuthology.orchestra.run.smithi092.stdout:516.out 2024-09-11T00:16:57.054 INFO:teuthology.orchestra.run.smithi092.stdout:517 2024-09-11T00:16:57.054 INFO:teuthology.orchestra.run.smithi092.stdout:517.out 2024-09-11T00:16:57.054 INFO:teuthology.orchestra.run.smithi092.stdout:518 2024-09-11T00:16:57.054 INFO:teuthology.orchestra.run.smithi092.stdout:518.out 2024-09-11T00:16:57.054 INFO:teuthology.orchestra.run.smithi092.stdout:519 2024-09-11T00:16:57.054 INFO:teuthology.orchestra.run.smithi092.stdout:519.out 2024-09-11T00:16:57.054 INFO:teuthology.orchestra.run.smithi092.stdout:520 2024-09-11T00:16:57.054 INFO:teuthology.orchestra.run.smithi092.stdout:520.out 2024-09-11T00:16:57.054 INFO:teuthology.orchestra.run.smithi092.stdout:521 2024-09-11T00:16:57.054 INFO:teuthology.orchestra.run.smithi092.stdout:521.out 2024-09-11T00:16:57.054 INFO:teuthology.orchestra.run.smithi092.stdout:522 2024-09-11T00:16:57.054 INFO:teuthology.orchestra.run.smithi092.stdout:522.out 2024-09-11T00:16:57.054 INFO:teuthology.orchestra.run.smithi092.stdout:523 2024-09-11T00:16:57.054 INFO:teuthology.orchestra.run.smithi092.stdout:523.out 2024-09-11T00:16:57.055 INFO:teuthology.orchestra.run.smithi092.stdout:524 2024-09-11T00:16:57.055 INFO:teuthology.orchestra.run.smithi092.stdout:524.out 2024-09-11T00:16:57.055 INFO:teuthology.orchestra.run.smithi092.stdout:525 2024-09-11T00:16:57.055 INFO:teuthology.orchestra.run.smithi092.stdout:525.out 2024-09-11T00:16:57.055 INFO:teuthology.orchestra.run.smithi092.stdout:526 2024-09-11T00:16:57.055 INFO:teuthology.orchestra.run.smithi092.stdout:526.out 2024-09-11T00:16:57.055 INFO:teuthology.orchestra.run.smithi092.stdout:527 2024-09-11T00:16:57.055 INFO:teuthology.orchestra.run.smithi092.stdout:527.out 2024-09-11T00:16:57.055 INFO:teuthology.orchestra.run.smithi092.stdout:528 2024-09-11T00:16:57.055 INFO:teuthology.orchestra.run.smithi092.stdout:528.out 2024-09-11T00:16:57.055 INFO:teuthology.orchestra.run.smithi092.stdout:529 2024-09-11T00:16:57.055 INFO:teuthology.orchestra.run.smithi092.stdout:529.out 2024-09-11T00:16:57.055 INFO:teuthology.orchestra.run.smithi092.stdout:530 2024-09-11T00:16:57.056 INFO:teuthology.orchestra.run.smithi092.stdout:530.out 2024-09-11T00:16:57.056 INFO:teuthology.orchestra.run.smithi092.stdout:531 2024-09-11T00:16:57.056 INFO:teuthology.orchestra.run.smithi092.stdout:531.out 2024-09-11T00:16:57.056 INFO:teuthology.orchestra.run.smithi092.stdout:532 2024-09-11T00:16:57.056 INFO:teuthology.orchestra.run.smithi092.stdout:532.out 2024-09-11T00:16:57.056 INFO:teuthology.orchestra.run.smithi092.stdout:533 2024-09-11T00:16:57.056 INFO:teuthology.orchestra.run.smithi092.stdout:533.out 2024-09-11T00:16:57.056 INFO:teuthology.orchestra.run.smithi092.stdout:534 2024-09-11T00:16:57.056 INFO:teuthology.orchestra.run.smithi092.stdout:534.out 2024-09-11T00:16:57.056 INFO:teuthology.orchestra.run.smithi092.stdout:535 2024-09-11T00:16:57.056 INFO:teuthology.orchestra.run.smithi092.stdout:535.out 2024-09-11T00:16:57.056 INFO:teuthology.orchestra.run.smithi092.stdout:536 2024-09-11T00:16:57.056 INFO:teuthology.orchestra.run.smithi092.stdout:536.out 2024-09-11T00:16:57.057 INFO:teuthology.orchestra.run.smithi092.stdout:537 2024-09-11T00:16:57.057 INFO:teuthology.orchestra.run.smithi092.stdout:537.out 2024-09-11T00:16:57.057 INFO:teuthology.orchestra.run.smithi092.stdout:538 2024-09-11T00:16:57.057 INFO:teuthology.orchestra.run.smithi092.stdout:538.out 2024-09-11T00:16:57.057 INFO:teuthology.orchestra.run.smithi092.stdout:539 2024-09-11T00:16:57.057 INFO:teuthology.orchestra.run.smithi092.stdout:539.out 2024-09-11T00:16:57.057 INFO:teuthology.orchestra.run.smithi092.stdout:540 2024-09-11T00:16:57.057 INFO:teuthology.orchestra.run.smithi092.stdout:540.out 2024-09-11T00:16:57.057 INFO:teuthology.orchestra.run.smithi092.stdout:541 2024-09-11T00:16:57.057 INFO:teuthology.orchestra.run.smithi092.stdout:541.out 2024-09-11T00:16:57.057 INFO:teuthology.orchestra.run.smithi092.stdout:542 2024-09-11T00:16:57.057 INFO:teuthology.orchestra.run.smithi092.stdout:542.out 2024-09-11T00:16:57.057 INFO:teuthology.orchestra.run.smithi092.stdout:543 2024-09-11T00:16:57.057 INFO:teuthology.orchestra.run.smithi092.stdout:543.out 2024-09-11T00:16:57.058 INFO:teuthology.orchestra.run.smithi092.stdout:544 2024-09-11T00:16:57.058 INFO:teuthology.orchestra.run.smithi092.stdout:544.out 2024-09-11T00:16:57.058 INFO:teuthology.orchestra.run.smithi092.stdout:545 2024-09-11T00:16:57.058 INFO:teuthology.orchestra.run.smithi092.stdout:545.out 2024-09-11T00:16:57.058 INFO:teuthology.orchestra.run.smithi092.stdout:546 2024-09-11T00:16:57.058 INFO:teuthology.orchestra.run.smithi092.stdout:546.out 2024-09-11T00:16:57.058 INFO:teuthology.orchestra.run.smithi092.stdout:547 2024-09-11T00:16:57.058 INFO:teuthology.orchestra.run.smithi092.stdout:547.out 2024-09-11T00:16:57.058 INFO:teuthology.orchestra.run.smithi092.stdout:548 2024-09-11T00:16:57.058 INFO:teuthology.orchestra.run.smithi092.stdout:548.out 2024-09-11T00:16:57.058 INFO:teuthology.orchestra.run.smithi092.stdout:549 2024-09-11T00:16:57.058 INFO:teuthology.orchestra.run.smithi092.stdout:549.out 2024-09-11T00:16:57.058 INFO:teuthology.orchestra.run.smithi092.stdout:550 2024-09-11T00:16:57.058 INFO:teuthology.orchestra.run.smithi092.stdout:550.out 2024-09-11T00:16:57.059 INFO:teuthology.orchestra.run.smithi092.stdout:551 2024-09-11T00:16:57.059 INFO:teuthology.orchestra.run.smithi092.stdout:551.out 2024-09-11T00:16:57.059 INFO:teuthology.orchestra.run.smithi092.stdout:552 2024-09-11T00:16:57.059 INFO:teuthology.orchestra.run.smithi092.stdout:552.out 2024-09-11T00:16:57.059 INFO:teuthology.orchestra.run.smithi092.stdout:553 2024-09-11T00:16:57.059 INFO:teuthology.orchestra.run.smithi092.stdout:553.out 2024-09-11T00:16:57.059 INFO:teuthology.orchestra.run.smithi092.stdout:554 2024-09-11T00:16:57.059 INFO:teuthology.orchestra.run.smithi092.stdout:554.out 2024-09-11T00:16:57.059 INFO:teuthology.orchestra.run.smithi092.stdout:555 2024-09-11T00:16:57.059 INFO:teuthology.orchestra.run.smithi092.stdout:555.out 2024-09-11T00:16:57.059 INFO:teuthology.orchestra.run.smithi092.stdout:556 2024-09-11T00:16:57.059 INFO:teuthology.orchestra.run.smithi092.stdout:556.out 2024-09-11T00:16:57.059 INFO:teuthology.orchestra.run.smithi092.stdout:557 2024-09-11T00:16:57.059 INFO:teuthology.orchestra.run.smithi092.stdout:557.out 2024-09-11T00:16:57.059 INFO:teuthology.orchestra.run.smithi092.stdout:558 2024-09-11T00:16:57.060 INFO:teuthology.orchestra.run.smithi092.stdout:558.out 2024-09-11T00:16:57.060 INFO:teuthology.orchestra.run.smithi092.stdout:559 2024-09-11T00:16:57.060 INFO:teuthology.orchestra.run.smithi092.stdout:559.out 2024-09-11T00:16:57.060 INFO:teuthology.orchestra.run.smithi092.stdout:560 2024-09-11T00:16:57.060 INFO:teuthology.orchestra.run.smithi092.stdout:560.out 2024-09-11T00:16:57.060 INFO:teuthology.orchestra.run.smithi092.stdout:561 2024-09-11T00:16:57.060 INFO:teuthology.orchestra.run.smithi092.stdout:561.out 2024-09-11T00:16:57.060 INFO:teuthology.orchestra.run.smithi092.stdout:562 2024-09-11T00:16:57.060 INFO:teuthology.orchestra.run.smithi092.stdout:562.out 2024-09-11T00:16:57.060 INFO:teuthology.orchestra.run.smithi092.stdout:563 2024-09-11T00:16:57.060 INFO:teuthology.orchestra.run.smithi092.stdout:563.out 2024-09-11T00:16:57.060 INFO:teuthology.orchestra.run.smithi092.stdout:564 2024-09-11T00:16:57.060 INFO:teuthology.orchestra.run.smithi092.stdout:564.out 2024-09-11T00:16:57.060 INFO:teuthology.orchestra.run.smithi092.stdout:565 2024-09-11T00:16:57.061 INFO:teuthology.orchestra.run.smithi092.stdout:565.out 2024-09-11T00:16:57.061 INFO:teuthology.orchestra.run.smithi092.stdout:566 2024-09-11T00:16:57.061 INFO:teuthology.orchestra.run.smithi092.stdout:566.out 2024-09-11T00:16:57.061 INFO:teuthology.orchestra.run.smithi092.stdout:567 2024-09-11T00:16:57.061 INFO:teuthology.orchestra.run.smithi092.stdout:567.out 2024-09-11T00:16:57.061 INFO:teuthology.orchestra.run.smithi092.stdout:568 2024-09-11T00:16:57.061 INFO:teuthology.orchestra.run.smithi092.stdout:568.out 2024-09-11T00:16:57.061 INFO:teuthology.orchestra.run.smithi092.stdout:569 2024-09-11T00:16:57.061 INFO:teuthology.orchestra.run.smithi092.stdout:569.out 2024-09-11T00:16:57.061 INFO:teuthology.orchestra.run.smithi092.stdout:570 2024-09-11T00:16:57.061 INFO:teuthology.orchestra.run.smithi092.stdout:570.out 2024-09-11T00:16:57.061 INFO:teuthology.orchestra.run.smithi092.stdout:571 2024-09-11T00:16:57.061 INFO:teuthology.orchestra.run.smithi092.stdout:571.out 2024-09-11T00:16:57.062 INFO:teuthology.orchestra.run.smithi092.stdout:572 2024-09-11T00:16:57.062 INFO:teuthology.orchestra.run.smithi092.stdout:572.out 2024-09-11T00:16:57.062 INFO:teuthology.orchestra.run.smithi092.stdout:573 2024-09-11T00:16:57.062 INFO:teuthology.orchestra.run.smithi092.stdout:573.out 2024-09-11T00:16:57.062 INFO:teuthology.orchestra.run.smithi092.stdout:574 2024-09-11T00:16:57.062 INFO:teuthology.orchestra.run.smithi092.stdout:574.out 2024-09-11T00:16:57.062 INFO:teuthology.orchestra.run.smithi092.stdout:575 2024-09-11T00:16:57.062 INFO:teuthology.orchestra.run.smithi092.stdout:575.out 2024-09-11T00:16:57.062 INFO:teuthology.orchestra.run.smithi092.stdout:576 2024-09-11T00:16:57.062 INFO:teuthology.orchestra.run.smithi092.stdout:576.out 2024-09-11T00:16:57.062 INFO:teuthology.orchestra.run.smithi092.stdout:577 2024-09-11T00:16:57.062 INFO:teuthology.orchestra.run.smithi092.stdout:577.out 2024-09-11T00:16:57.063 INFO:teuthology.orchestra.run.smithi092.stdout:578 2024-09-11T00:16:57.063 INFO:teuthology.orchestra.run.smithi092.stdout:578.out 2024-09-11T00:16:57.063 INFO:teuthology.orchestra.run.smithi092.stdout:579 2024-09-11T00:16:57.063 INFO:teuthology.orchestra.run.smithi092.stdout:579.out 2024-09-11T00:16:57.063 INFO:teuthology.orchestra.run.smithi092.stdout:580 2024-09-11T00:16:57.063 INFO:teuthology.orchestra.run.smithi092.stdout:580.out 2024-09-11T00:16:57.063 INFO:teuthology.orchestra.run.smithi092.stdout:581 2024-09-11T00:16:57.063 INFO:teuthology.orchestra.run.smithi092.stdout:581.out 2024-09-11T00:16:57.063 INFO:teuthology.orchestra.run.smithi092.stdout:582 2024-09-11T00:16:57.063 INFO:teuthology.orchestra.run.smithi092.stdout:582.out 2024-09-11T00:16:57.063 INFO:teuthology.orchestra.run.smithi092.stdout:583 2024-09-11T00:16:57.063 INFO:teuthology.orchestra.run.smithi092.stdout:583.out 2024-09-11T00:16:57.063 INFO:teuthology.orchestra.run.smithi092.stdout:584 2024-09-11T00:16:57.063 INFO:teuthology.orchestra.run.smithi092.stdout:584.out 2024-09-11T00:16:57.064 INFO:teuthology.orchestra.run.smithi092.stdout:585 2024-09-11T00:16:57.064 INFO:teuthology.orchestra.run.smithi092.stdout:585.out 2024-09-11T00:16:57.064 INFO:teuthology.orchestra.run.smithi092.stdout:586 2024-09-11T00:16:57.064 INFO:teuthology.orchestra.run.smithi092.stdout:586.out 2024-09-11T00:16:57.064 INFO:teuthology.orchestra.run.smithi092.stdout:587 2024-09-11T00:16:57.064 INFO:teuthology.orchestra.run.smithi092.stdout:587.out 2024-09-11T00:16:57.064 INFO:teuthology.orchestra.run.smithi092.stdout:588 2024-09-11T00:16:57.064 INFO:teuthology.orchestra.run.smithi092.stdout:588.out 2024-09-11T00:16:57.064 INFO:teuthology.orchestra.run.smithi092.stdout:589 2024-09-11T00:16:57.064 INFO:teuthology.orchestra.run.smithi092.stdout:589.out 2024-09-11T00:16:57.064 INFO:teuthology.orchestra.run.smithi092.stdout:590 2024-09-11T00:16:57.064 INFO:teuthology.orchestra.run.smithi092.stdout:590.out 2024-09-11T00:16:57.064 INFO:teuthology.orchestra.run.smithi092.stdout:591 2024-09-11T00:16:57.064 INFO:teuthology.orchestra.run.smithi092.stdout:591.out 2024-09-11T00:16:57.065 INFO:teuthology.orchestra.run.smithi092.stdout:592 2024-09-11T00:16:57.065 INFO:teuthology.orchestra.run.smithi092.stdout:592.out 2024-09-11T00:16:57.065 INFO:teuthology.orchestra.run.smithi092.stdout:593 2024-09-11T00:16:57.065 INFO:teuthology.orchestra.run.smithi092.stdout:593.out 2024-09-11T00:16:57.065 INFO:teuthology.orchestra.run.smithi092.stdout:594 2024-09-11T00:16:57.065 INFO:teuthology.orchestra.run.smithi092.stdout:594.out 2024-09-11T00:16:57.065 INFO:teuthology.orchestra.run.smithi092.stdout:595 2024-09-11T00:16:57.065 INFO:teuthology.orchestra.run.smithi092.stdout:595.out 2024-09-11T00:16:57.065 INFO:teuthology.orchestra.run.smithi092.stdout:596 2024-09-11T00:16:57.065 INFO:teuthology.orchestra.run.smithi092.stdout:596.out 2024-09-11T00:16:57.065 INFO:teuthology.orchestra.run.smithi092.stdout:597 2024-09-11T00:16:57.065 INFO:teuthology.orchestra.run.smithi092.stdout:597.out 2024-09-11T00:16:57.065 INFO:teuthology.orchestra.run.smithi092.stdout:598 2024-09-11T00:16:57.065 INFO:teuthology.orchestra.run.smithi092.stdout:598.out 2024-09-11T00:16:57.066 INFO:teuthology.orchestra.run.smithi092.stdout:599 2024-09-11T00:16:57.066 INFO:teuthology.orchestra.run.smithi092.stdout:599.out 2024-09-11T00:16:57.066 INFO:teuthology.orchestra.run.smithi092.stdout:600 2024-09-11T00:16:57.066 INFO:teuthology.orchestra.run.smithi092.stdout:600.out 2024-09-11T00:16:57.066 INFO:teuthology.orchestra.run.smithi092.stdout:601 2024-09-11T00:16:57.066 INFO:teuthology.orchestra.run.smithi092.stdout:601.out 2024-09-11T00:16:57.066 INFO:teuthology.orchestra.run.smithi092.stdout:602 2024-09-11T00:16:57.066 INFO:teuthology.orchestra.run.smithi092.stdout:602.out 2024-09-11T00:16:57.066 INFO:teuthology.orchestra.run.smithi092.stdout:603 2024-09-11T00:16:57.066 INFO:teuthology.orchestra.run.smithi092.stdout:603.out 2024-09-11T00:16:57.067 INFO:teuthology.orchestra.run.smithi092.stdout:604 2024-09-11T00:16:57.067 INFO:teuthology.orchestra.run.smithi092.stdout:604.out 2024-09-11T00:16:57.067 INFO:teuthology.orchestra.run.smithi092.stdout:605 2024-09-11T00:16:57.067 INFO:teuthology.orchestra.run.smithi092.stdout:605.out 2024-09-11T00:16:57.067 INFO:teuthology.orchestra.run.smithi092.stdout:606 2024-09-11T00:16:57.067 INFO:teuthology.orchestra.run.smithi092.stdout:606.out 2024-09-11T00:16:57.067 INFO:teuthology.orchestra.run.smithi092.stdout:607 2024-09-11T00:16:57.067 INFO:teuthology.orchestra.run.smithi092.stdout:607.out 2024-09-11T00:16:57.067 INFO:teuthology.orchestra.run.smithi092.stdout:608 2024-09-11T00:16:57.067 INFO:teuthology.orchestra.run.smithi092.stdout:608.out 2024-09-11T00:16:57.067 INFO:teuthology.orchestra.run.smithi092.stdout:609 2024-09-11T00:16:57.067 INFO:teuthology.orchestra.run.smithi092.stdout:609.out 2024-09-11T00:16:57.067 INFO:teuthology.orchestra.run.smithi092.stdout:610 2024-09-11T00:16:57.067 INFO:teuthology.orchestra.run.smithi092.stdout:610.out 2024-09-11T00:16:57.068 INFO:teuthology.orchestra.run.smithi092.stdout:611 2024-09-11T00:16:57.068 INFO:teuthology.orchestra.run.smithi092.stdout:611.out 2024-09-11T00:16:57.068 INFO:teuthology.orchestra.run.smithi092.stdout:612 2024-09-11T00:16:57.068 INFO:teuthology.orchestra.run.smithi092.stdout:612.out 2024-09-11T00:16:57.068 INFO:teuthology.orchestra.run.smithi092.stdout:613 2024-09-11T00:16:57.068 INFO:teuthology.orchestra.run.smithi092.stdout:613.out 2024-09-11T00:16:57.068 INFO:teuthology.orchestra.run.smithi092.stdout:614 2024-09-11T00:16:57.068 INFO:teuthology.orchestra.run.smithi092.stdout:614.out 2024-09-11T00:16:57.068 INFO:teuthology.orchestra.run.smithi092.stdout:615 2024-09-11T00:16:57.068 INFO:teuthology.orchestra.run.smithi092.stdout:615.out 2024-09-11T00:16:57.068 INFO:teuthology.orchestra.run.smithi092.stdout:616 2024-09-11T00:16:57.068 INFO:teuthology.orchestra.run.smithi092.stdout:616.out 2024-09-11T00:16:57.068 INFO:teuthology.orchestra.run.smithi092.stdout:617 2024-09-11T00:16:57.068 INFO:teuthology.orchestra.run.smithi092.stdout:617.out 2024-09-11T00:16:57.069 INFO:teuthology.orchestra.run.smithi092.stdout:618 2024-09-11T00:16:57.069 INFO:teuthology.orchestra.run.smithi092.stdout:618.out 2024-09-11T00:16:57.069 INFO:teuthology.orchestra.run.smithi092.stdout:619 2024-09-11T00:16:57.069 INFO:teuthology.orchestra.run.smithi092.stdout:619.out 2024-09-11T00:16:57.069 INFO:teuthology.orchestra.run.smithi092.stdout:620 2024-09-11T00:16:57.069 INFO:teuthology.orchestra.run.smithi092.stdout:620.out 2024-09-11T00:16:57.069 INFO:teuthology.orchestra.run.smithi092.stdout:621 2024-09-11T00:16:57.069 INFO:teuthology.orchestra.run.smithi092.stdout:621.out 2024-09-11T00:16:57.069 INFO:teuthology.orchestra.run.smithi092.stdout:622 2024-09-11T00:16:57.069 INFO:teuthology.orchestra.run.smithi092.stdout:622.out 2024-09-11T00:16:57.069 INFO:teuthology.orchestra.run.smithi092.stdout:623 2024-09-11T00:16:57.069 INFO:teuthology.orchestra.run.smithi092.stdout:623.out 2024-09-11T00:16:57.069 INFO:teuthology.orchestra.run.smithi092.stdout:624 2024-09-11T00:16:57.070 INFO:teuthology.orchestra.run.smithi092.stdout:624.out 2024-09-11T00:16:57.070 INFO:teuthology.orchestra.run.smithi092.stdout:625 2024-09-11T00:16:57.070 INFO:teuthology.orchestra.run.smithi092.stdout:625.out 2024-09-11T00:16:57.070 INFO:teuthology.orchestra.run.smithi092.stdout:626 2024-09-11T00:16:57.070 INFO:teuthology.orchestra.run.smithi092.stdout:626.out 2024-09-11T00:16:57.070 INFO:teuthology.orchestra.run.smithi092.stdout:627 2024-09-11T00:16:57.070 INFO:teuthology.orchestra.run.smithi092.stdout:627.out 2024-09-11T00:16:57.070 INFO:teuthology.orchestra.run.smithi092.stdout:628 2024-09-11T00:16:57.070 INFO:teuthology.orchestra.run.smithi092.stdout:628.out 2024-09-11T00:16:57.070 INFO:teuthology.orchestra.run.smithi092.stdout:629 2024-09-11T00:16:57.070 INFO:teuthology.orchestra.run.smithi092.stdout:629.out 2024-09-11T00:16:57.070 INFO:teuthology.orchestra.run.smithi092.stdout:630 2024-09-11T00:16:57.070 INFO:teuthology.orchestra.run.smithi092.stdout:630.out 2024-09-11T00:16:57.071 INFO:teuthology.orchestra.run.smithi092.stdout:631 2024-09-11T00:16:57.071 INFO:teuthology.orchestra.run.smithi092.stdout:631.out 2024-09-11T00:16:57.071 INFO:teuthology.orchestra.run.smithi092.stdout:632 2024-09-11T00:16:57.071 INFO:teuthology.orchestra.run.smithi092.stdout:632.out 2024-09-11T00:16:57.071 INFO:teuthology.orchestra.run.smithi092.stdout:633 2024-09-11T00:16:57.071 INFO:teuthology.orchestra.run.smithi092.stdout:633.out 2024-09-11T00:16:57.071 INFO:teuthology.orchestra.run.smithi092.stdout:634 2024-09-11T00:16:57.071 INFO:teuthology.orchestra.run.smithi092.stdout:634.out 2024-09-11T00:16:57.071 INFO:teuthology.orchestra.run.smithi092.stdout:635 2024-09-11T00:16:57.071 INFO:teuthology.orchestra.run.smithi092.stdout:635.out 2024-09-11T00:16:57.071 INFO:teuthology.orchestra.run.smithi092.stdout:636 2024-09-11T00:16:57.071 INFO:teuthology.orchestra.run.smithi092.stdout:636.out 2024-09-11T00:16:57.072 INFO:teuthology.orchestra.run.smithi092.stdout:637 2024-09-11T00:16:57.072 INFO:teuthology.orchestra.run.smithi092.stdout:637.out 2024-09-11T00:16:57.072 INFO:teuthology.orchestra.run.smithi092.stdout:638 2024-09-11T00:16:57.072 INFO:teuthology.orchestra.run.smithi092.stdout:638.out 2024-09-11T00:16:57.072 INFO:teuthology.orchestra.run.smithi092.stdout:639 2024-09-11T00:16:57.072 INFO:teuthology.orchestra.run.smithi092.stdout:639.out 2024-09-11T00:16:57.072 INFO:teuthology.orchestra.run.smithi092.stdout:640 2024-09-11T00:16:57.072 INFO:teuthology.orchestra.run.smithi092.stdout:640.out 2024-09-11T00:16:57.072 INFO:teuthology.orchestra.run.smithi092.stdout:641 2024-09-11T00:16:57.072 INFO:teuthology.orchestra.run.smithi092.stdout:641.out 2024-09-11T00:16:57.072 INFO:teuthology.orchestra.run.smithi092.stdout:642 2024-09-11T00:16:57.072 INFO:teuthology.orchestra.run.smithi092.stdout:642.out 2024-09-11T00:16:57.072 INFO:teuthology.orchestra.run.smithi092.stdout:643 2024-09-11T00:16:57.073 INFO:teuthology.orchestra.run.smithi092.stdout:643.out 2024-09-11T00:16:57.073 INFO:teuthology.orchestra.run.smithi092.stdout:644 2024-09-11T00:16:57.073 INFO:teuthology.orchestra.run.smithi092.stdout:644.out 2024-09-11T00:16:57.073 INFO:teuthology.orchestra.run.smithi092.stdout:645 2024-09-11T00:16:57.073 INFO:teuthology.orchestra.run.smithi092.stdout:645.out 2024-09-11T00:16:57.073 INFO:teuthology.orchestra.run.smithi092.stdout:646 2024-09-11T00:16:57.073 INFO:teuthology.orchestra.run.smithi092.stdout:646.out 2024-09-11T00:16:57.073 INFO:teuthology.orchestra.run.smithi092.stdout:647 2024-09-11T00:16:57.073 INFO:teuthology.orchestra.run.smithi092.stdout:647.out 2024-09-11T00:16:57.073 INFO:teuthology.orchestra.run.smithi092.stdout:648 2024-09-11T00:16:57.073 INFO:teuthology.orchestra.run.smithi092.stdout:648.out 2024-09-11T00:16:57.073 INFO:teuthology.orchestra.run.smithi092.stdout:649 2024-09-11T00:16:57.073 INFO:teuthology.orchestra.run.smithi092.stdout:649.out 2024-09-11T00:16:57.074 INFO:teuthology.orchestra.run.smithi092.stdout:650 2024-09-11T00:16:57.074 INFO:teuthology.orchestra.run.smithi092.stdout:650.out 2024-09-11T00:16:57.074 INFO:teuthology.orchestra.run.smithi092.stdout:651 2024-09-11T00:16:57.074 INFO:teuthology.orchestra.run.smithi092.stdout:651.out 2024-09-11T00:16:57.074 INFO:teuthology.orchestra.run.smithi092.stdout:652 2024-09-11T00:16:57.074 INFO:teuthology.orchestra.run.smithi092.stdout:652.out 2024-09-11T00:16:57.074 INFO:teuthology.orchestra.run.smithi092.stdout:653 2024-09-11T00:16:57.074 INFO:teuthology.orchestra.run.smithi092.stdout:653.out 2024-09-11T00:16:57.074 INFO:teuthology.orchestra.run.smithi092.stdout:654 2024-09-11T00:16:57.074 INFO:teuthology.orchestra.run.smithi092.stdout:654.out 2024-09-11T00:16:57.074 INFO:teuthology.orchestra.run.smithi092.stdout:655 2024-09-11T00:16:57.074 INFO:teuthology.orchestra.run.smithi092.stdout:655.out 2024-09-11T00:16:57.074 INFO:teuthology.orchestra.run.smithi092.stdout:656 2024-09-11T00:16:57.074 INFO:teuthology.orchestra.run.smithi092.stdout:656.out 2024-09-11T00:16:57.075 INFO:teuthology.orchestra.run.smithi092.stdout:657 2024-09-11T00:16:57.075 INFO:teuthology.orchestra.run.smithi092.stdout:657.out 2024-09-11T00:16:57.075 INFO:teuthology.orchestra.run.smithi092.stdout:658 2024-09-11T00:16:57.075 INFO:teuthology.orchestra.run.smithi092.stdout:658.out 2024-09-11T00:16:57.075 INFO:teuthology.orchestra.run.smithi092.stdout:659 2024-09-11T00:16:57.075 INFO:teuthology.orchestra.run.smithi092.stdout:659.out 2024-09-11T00:16:57.075 INFO:teuthology.orchestra.run.smithi092.stdout:660 2024-09-11T00:16:57.075 INFO:teuthology.orchestra.run.smithi092.stdout:660.out 2024-09-11T00:16:57.075 INFO:teuthology.orchestra.run.smithi092.stdout:661 2024-09-11T00:16:57.075 INFO:teuthology.orchestra.run.smithi092.stdout:661.out 2024-09-11T00:16:57.075 INFO:teuthology.orchestra.run.smithi092.stdout:662 2024-09-11T00:16:57.075 INFO:teuthology.orchestra.run.smithi092.stdout:662.out 2024-09-11T00:16:57.075 INFO:teuthology.orchestra.run.smithi092.stdout:663 2024-09-11T00:16:57.076 INFO:teuthology.orchestra.run.smithi092.stdout:663.out 2024-09-11T00:16:57.076 INFO:teuthology.orchestra.run.smithi092.stdout:664 2024-09-11T00:16:57.076 INFO:teuthology.orchestra.run.smithi092.stdout:664.out 2024-09-11T00:16:57.076 INFO:teuthology.orchestra.run.smithi092.stdout:665 2024-09-11T00:16:57.076 INFO:teuthology.orchestra.run.smithi092.stdout:665.out 2024-09-11T00:16:57.076 INFO:teuthology.orchestra.run.smithi092.stdout:666 2024-09-11T00:16:57.076 INFO:teuthology.orchestra.run.smithi092.stdout:666.out 2024-09-11T00:16:57.076 INFO:teuthology.orchestra.run.smithi092.stdout:667 2024-09-11T00:16:57.076 INFO:teuthology.orchestra.run.smithi092.stdout:667.out 2024-09-11T00:16:57.076 INFO:teuthology.orchestra.run.smithi092.stdout:668 2024-09-11T00:16:57.076 INFO:teuthology.orchestra.run.smithi092.stdout:668.out 2024-09-11T00:16:57.076 INFO:teuthology.orchestra.run.smithi092.stdout:669 2024-09-11T00:16:57.076 INFO:teuthology.orchestra.run.smithi092.stdout:669.out 2024-09-11T00:16:57.077 INFO:teuthology.orchestra.run.smithi092.stdout:670 2024-09-11T00:16:57.077 INFO:teuthology.orchestra.run.smithi092.stdout:670.out 2024-09-11T00:16:57.077 INFO:teuthology.orchestra.run.smithi092.stdout:671 2024-09-11T00:16:57.077 INFO:teuthology.orchestra.run.smithi092.stdout:671.out 2024-09-11T00:16:57.077 INFO:teuthology.orchestra.run.smithi092.stdout:672 2024-09-11T00:16:57.077 INFO:teuthology.orchestra.run.smithi092.stdout:672.out 2024-09-11T00:16:57.077 INFO:teuthology.orchestra.run.smithi092.stdout:673 2024-09-11T00:16:57.077 INFO:teuthology.orchestra.run.smithi092.stdout:673.out 2024-09-11T00:16:57.077 INFO:teuthology.orchestra.run.smithi092.stdout:674 2024-09-11T00:16:57.077 INFO:teuthology.orchestra.run.smithi092.stdout:674.out 2024-09-11T00:16:57.077 INFO:teuthology.orchestra.run.smithi092.stdout:675 2024-09-11T00:16:57.077 INFO:teuthology.orchestra.run.smithi092.stdout:675.out 2024-09-11T00:16:57.077 INFO:teuthology.orchestra.run.smithi092.stdout:676 2024-09-11T00:16:57.078 INFO:teuthology.orchestra.run.smithi092.stdout:676.out 2024-09-11T00:16:57.078 INFO:teuthology.orchestra.run.smithi092.stdout:677 2024-09-11T00:16:57.078 INFO:teuthology.orchestra.run.smithi092.stdout:677.out 2024-09-11T00:16:57.078 INFO:teuthology.orchestra.run.smithi092.stdout:678 2024-09-11T00:16:57.078 INFO:teuthology.orchestra.run.smithi092.stdout:678.out 2024-09-11T00:16:57.078 INFO:teuthology.orchestra.run.smithi092.stdout:679 2024-09-11T00:16:57.078 INFO:teuthology.orchestra.run.smithi092.stdout:679.out 2024-09-11T00:16:57.078 INFO:teuthology.orchestra.run.smithi092.stdout:680 2024-09-11T00:16:57.078 INFO:teuthology.orchestra.run.smithi092.stdout:680.out 2024-09-11T00:16:57.078 INFO:teuthology.orchestra.run.smithi092.stdout:681 2024-09-11T00:16:57.078 INFO:teuthology.orchestra.run.smithi092.stdout:681.out 2024-09-11T00:16:57.078 INFO:teuthology.orchestra.run.smithi092.stdout:682 2024-09-11T00:16:57.078 INFO:teuthology.orchestra.run.smithi092.stdout:682.out 2024-09-11T00:16:57.078 INFO:teuthology.orchestra.run.smithi092.stdout:683 2024-09-11T00:16:57.079 INFO:teuthology.orchestra.run.smithi092.stdout:683.out 2024-09-11T00:16:57.079 INFO:teuthology.orchestra.run.smithi092.stdout:684 2024-09-11T00:16:57.079 INFO:teuthology.orchestra.run.smithi092.stdout:684.out 2024-09-11T00:16:57.079 INFO:teuthology.orchestra.run.smithi092.stdout:685 2024-09-11T00:16:57.079 INFO:teuthology.orchestra.run.smithi092.stdout:685.out 2024-09-11T00:16:57.079 INFO:teuthology.orchestra.run.smithi092.stdout:686 2024-09-11T00:16:57.079 INFO:teuthology.orchestra.run.smithi092.stdout:686.out 2024-09-11T00:16:57.079 INFO:teuthology.orchestra.run.smithi092.stdout:687 2024-09-11T00:16:57.079 INFO:teuthology.orchestra.run.smithi092.stdout:687.out 2024-09-11T00:16:57.079 INFO:teuthology.orchestra.run.smithi092.stdout:688 2024-09-11T00:16:57.079 INFO:teuthology.orchestra.run.smithi092.stdout:688.out 2024-09-11T00:16:57.079 INFO:teuthology.orchestra.run.smithi092.stdout:689 2024-09-11T00:16:57.079 INFO:teuthology.orchestra.run.smithi092.stdout:689.out 2024-09-11T00:16:57.079 INFO:teuthology.orchestra.run.smithi092.stdout:690 2024-09-11T00:16:57.080 INFO:teuthology.orchestra.run.smithi092.stdout:690.out 2024-09-11T00:16:57.080 INFO:teuthology.orchestra.run.smithi092.stdout:691 2024-09-11T00:16:57.080 INFO:teuthology.orchestra.run.smithi092.stdout:691.out 2024-09-11T00:16:57.080 INFO:teuthology.orchestra.run.smithi092.stdout:692 2024-09-11T00:16:57.080 INFO:teuthology.orchestra.run.smithi092.stdout:692.out 2024-09-11T00:16:57.080 INFO:teuthology.orchestra.run.smithi092.stdout:693 2024-09-11T00:16:57.080 INFO:teuthology.orchestra.run.smithi092.stdout:693.out 2024-09-11T00:16:57.080 INFO:teuthology.orchestra.run.smithi092.stdout:694 2024-09-11T00:16:57.080 INFO:teuthology.orchestra.run.smithi092.stdout:694.out 2024-09-11T00:16:57.080 INFO:teuthology.orchestra.run.smithi092.stdout:695 2024-09-11T00:16:57.080 INFO:teuthology.orchestra.run.smithi092.stdout:695.out 2024-09-11T00:16:57.080 INFO:teuthology.orchestra.run.smithi092.stdout:696 2024-09-11T00:16:57.080 INFO:teuthology.orchestra.run.smithi092.stdout:696.out 2024-09-11T00:16:57.080 INFO:teuthology.orchestra.run.smithi092.stdout:697 2024-09-11T00:16:57.081 INFO:teuthology.orchestra.run.smithi092.stdout:697.out 2024-09-11T00:16:57.081 INFO:teuthology.orchestra.run.smithi092.stdout:698 2024-09-11T00:16:57.081 INFO:teuthology.orchestra.run.smithi092.stdout:698.out 2024-09-11T00:16:57.081 INFO:teuthology.orchestra.run.smithi092.stdout:699 2024-09-11T00:16:57.081 INFO:teuthology.orchestra.run.smithi092.stdout:699.out 2024-09-11T00:16:57.081 INFO:teuthology.orchestra.run.smithi092.stdout:700 2024-09-11T00:16:57.081 INFO:teuthology.orchestra.run.smithi092.stdout:700.out 2024-09-11T00:16:57.081 INFO:teuthology.orchestra.run.smithi092.stdout:701 2024-09-11T00:16:57.081 INFO:teuthology.orchestra.run.smithi092.stdout:701.out 2024-09-11T00:16:57.081 INFO:teuthology.orchestra.run.smithi092.stdout:702 2024-09-11T00:16:57.081 INFO:teuthology.orchestra.run.smithi092.stdout:702.out 2024-09-11T00:16:57.081 INFO:teuthology.orchestra.run.smithi092.stdout:703 2024-09-11T00:16:57.081 INFO:teuthology.orchestra.run.smithi092.stdout:703.out 2024-09-11T00:16:57.081 INFO:teuthology.orchestra.run.smithi092.stdout:704 2024-09-11T00:16:57.082 INFO:teuthology.orchestra.run.smithi092.stdout:704.out 2024-09-11T00:16:57.082 INFO:teuthology.orchestra.run.smithi092.stdout:705 2024-09-11T00:16:57.082 INFO:teuthology.orchestra.run.smithi092.stdout:705.out 2024-09-11T00:16:57.082 INFO:teuthology.orchestra.run.smithi092.stdout:706 2024-09-11T00:16:57.082 INFO:teuthology.orchestra.run.smithi092.stdout:706.out 2024-09-11T00:16:57.082 INFO:teuthology.orchestra.run.smithi092.stdout:707 2024-09-11T00:16:57.082 INFO:teuthology.orchestra.run.smithi092.stdout:707.out 2024-09-11T00:16:57.082 INFO:teuthology.orchestra.run.smithi092.stdout:708 2024-09-11T00:16:57.082 INFO:teuthology.orchestra.run.smithi092.stdout:708.out 2024-09-11T00:16:57.082 INFO:teuthology.orchestra.run.smithi092.stdout:709 2024-09-11T00:16:57.082 INFO:teuthology.orchestra.run.smithi092.stdout:709.out 2024-09-11T00:16:57.082 INFO:teuthology.orchestra.run.smithi092.stdout:710 2024-09-11T00:16:57.082 INFO:teuthology.orchestra.run.smithi092.stdout:710.out 2024-09-11T00:16:57.083 INFO:teuthology.orchestra.run.smithi092.stdout:711 2024-09-11T00:16:57.083 INFO:teuthology.orchestra.run.smithi092.stdout:711.out 2024-09-11T00:16:57.083 INFO:teuthology.orchestra.run.smithi092.stdout:712 2024-09-11T00:16:57.083 INFO:teuthology.orchestra.run.smithi092.stdout:712.out 2024-09-11T00:16:57.083 INFO:teuthology.orchestra.run.smithi092.stdout:713 2024-09-11T00:16:57.083 INFO:teuthology.orchestra.run.smithi092.stdout:713.out 2024-09-11T00:16:57.083 INFO:teuthology.orchestra.run.smithi092.stdout:714 2024-09-11T00:16:57.083 INFO:teuthology.orchestra.run.smithi092.stdout:714.out 2024-09-11T00:16:57.083 INFO:teuthology.orchestra.run.smithi092.stdout:715 2024-09-11T00:16:57.083 INFO:teuthology.orchestra.run.smithi092.stdout:715.out 2024-09-11T00:16:57.083 INFO:teuthology.orchestra.run.smithi092.stdout:716 2024-09-11T00:16:57.083 INFO:teuthology.orchestra.run.smithi092.stdout:716.out 2024-09-11T00:16:57.083 INFO:teuthology.orchestra.run.smithi092.stdout:717 2024-09-11T00:16:57.083 INFO:teuthology.orchestra.run.smithi092.stdout:717.out 2024-09-11T00:16:57.084 INFO:teuthology.orchestra.run.smithi092.stdout:718 2024-09-11T00:16:57.084 INFO:teuthology.orchestra.run.smithi092.stdout:718.out 2024-09-11T00:16:57.084 INFO:teuthology.orchestra.run.smithi092.stdout:719 2024-09-11T00:16:57.084 INFO:teuthology.orchestra.run.smithi092.stdout:719.out 2024-09-11T00:16:57.084 INFO:teuthology.orchestra.run.smithi092.stdout:720 2024-09-11T00:16:57.084 INFO:teuthology.orchestra.run.smithi092.stdout:720.out 2024-09-11T00:16:57.084 INFO:teuthology.orchestra.run.smithi092.stdout:721 2024-09-11T00:16:57.084 INFO:teuthology.orchestra.run.smithi092.stdout:721.out 2024-09-11T00:16:57.084 INFO:teuthology.orchestra.run.smithi092.stdout:722 2024-09-11T00:16:57.084 INFO:teuthology.orchestra.run.smithi092.stdout:722.out 2024-09-11T00:16:57.084 INFO:teuthology.orchestra.run.smithi092.stdout:723 2024-09-11T00:16:57.084 INFO:teuthology.orchestra.run.smithi092.stdout:723.out 2024-09-11T00:16:57.084 INFO:teuthology.orchestra.run.smithi092.stdout:724 2024-09-11T00:16:57.084 INFO:teuthology.orchestra.run.smithi092.stdout:724.out 2024-09-11T00:16:57.084 INFO:teuthology.orchestra.run.smithi092.stdout:725 2024-09-11T00:16:57.085 INFO:teuthology.orchestra.run.smithi092.stdout:725.out 2024-09-11T00:16:57.085 INFO:teuthology.orchestra.run.smithi092.stdout:726 2024-09-11T00:16:57.085 INFO:teuthology.orchestra.run.smithi092.stdout:726.out 2024-09-11T00:16:57.085 INFO:teuthology.orchestra.run.smithi092.stdout:727 2024-09-11T00:16:57.085 INFO:teuthology.orchestra.run.smithi092.stdout:727.out 2024-09-11T00:16:57.085 INFO:teuthology.orchestra.run.smithi092.stdout:728 2024-09-11T00:16:57.085 INFO:teuthology.orchestra.run.smithi092.stdout:728.out 2024-09-11T00:16:57.085 INFO:teuthology.orchestra.run.smithi092.stdout:729 2024-09-11T00:16:57.085 INFO:teuthology.orchestra.run.smithi092.stdout:729.out 2024-09-11T00:16:57.085 INFO:teuthology.orchestra.run.smithi092.stdout:730 2024-09-11T00:16:57.085 INFO:teuthology.orchestra.run.smithi092.stdout:730.out 2024-09-11T00:16:57.086 INFO:teuthology.orchestra.run.smithi092.stdout:731 2024-09-11T00:16:57.086 INFO:teuthology.orchestra.run.smithi092.stdout:731.out 2024-09-11T00:16:57.086 INFO:teuthology.orchestra.run.smithi092.stdout:732 2024-09-11T00:16:57.086 INFO:teuthology.orchestra.run.smithi092.stdout:732.out 2024-09-11T00:16:57.086 INFO:teuthology.orchestra.run.smithi092.stdout:733 2024-09-11T00:16:57.086 INFO:teuthology.orchestra.run.smithi092.stdout:733.out 2024-09-11T00:16:57.086 INFO:teuthology.orchestra.run.smithi092.stdout:734 2024-09-11T00:16:57.086 INFO:teuthology.orchestra.run.smithi092.stdout:734.out 2024-09-11T00:16:57.086 INFO:teuthology.orchestra.run.smithi092.stdout:735 2024-09-11T00:16:57.086 INFO:teuthology.orchestra.run.smithi092.stdout:735.out 2024-09-11T00:16:57.086 INFO:teuthology.orchestra.run.smithi092.stdout:736 2024-09-11T00:16:57.086 INFO:teuthology.orchestra.run.smithi092.stdout:736.out 2024-09-11T00:16:57.086 INFO:teuthology.orchestra.run.smithi092.stdout:737 2024-09-11T00:16:57.086 INFO:teuthology.orchestra.run.smithi092.stdout:737.out 2024-09-11T00:16:57.087 INFO:teuthology.orchestra.run.smithi092.stdout:738 2024-09-11T00:16:57.087 INFO:teuthology.orchestra.run.smithi092.stdout:738.out 2024-09-11T00:16:57.087 INFO:teuthology.orchestra.run.smithi092.stdout:739 2024-09-11T00:16:57.087 INFO:teuthology.orchestra.run.smithi092.stdout:739.out 2024-09-11T00:16:57.087 INFO:teuthology.orchestra.run.smithi092.stdout:740 2024-09-11T00:16:57.087 INFO:teuthology.orchestra.run.smithi092.stdout:740.out 2024-09-11T00:16:57.087 INFO:teuthology.orchestra.run.smithi092.stdout:741 2024-09-11T00:16:57.087 INFO:teuthology.orchestra.run.smithi092.stdout:741.out 2024-09-11T00:16:57.087 INFO:teuthology.orchestra.run.smithi092.stdout:742 2024-09-11T00:16:57.087 INFO:teuthology.orchestra.run.smithi092.stdout:742.out 2024-09-11T00:16:57.087 INFO:teuthology.orchestra.run.smithi092.stdout:743 2024-09-11T00:16:57.087 INFO:teuthology.orchestra.run.smithi092.stdout:743.out 2024-09-11T00:16:57.087 INFO:teuthology.orchestra.run.smithi092.stdout:744 2024-09-11T00:16:57.088 INFO:teuthology.orchestra.run.smithi092.stdout:744.out 2024-09-11T00:16:57.088 INFO:teuthology.orchestra.run.smithi092.stdout:745 2024-09-11T00:16:57.088 INFO:teuthology.orchestra.run.smithi092.stdout:745.out 2024-09-11T00:16:57.088 INFO:teuthology.orchestra.run.smithi092.stdout:746 2024-09-11T00:16:57.088 INFO:teuthology.orchestra.run.smithi092.stdout:746.out 2024-09-11T00:16:57.088 INFO:teuthology.orchestra.run.smithi092.stdout:747 2024-09-11T00:16:57.088 INFO:teuthology.orchestra.run.smithi092.stdout:747.out 2024-09-11T00:16:57.088 INFO:teuthology.orchestra.run.smithi092.stdout:748 2024-09-11T00:16:57.088 INFO:teuthology.orchestra.run.smithi092.stdout:748.out 2024-09-11T00:16:57.089 INFO:teuthology.orchestra.run.smithi092.stdout:749 2024-09-11T00:16:57.089 INFO:teuthology.orchestra.run.smithi092.stdout:749.out 2024-09-11T00:16:57.089 INFO:teuthology.orchestra.run.smithi092.stdout:750 2024-09-11T00:16:57.089 INFO:teuthology.orchestra.run.smithi092.stdout:750.out 2024-09-11T00:16:57.089 INFO:teuthology.orchestra.run.smithi092.stdout:751 2024-09-11T00:16:57.089 INFO:teuthology.orchestra.run.smithi092.stdout:751.out 2024-09-11T00:16:57.089 INFO:teuthology.orchestra.run.smithi092.stdout:752 2024-09-11T00:16:57.089 INFO:teuthology.orchestra.run.smithi092.stdout:752.out 2024-09-11T00:16:57.089 INFO:teuthology.orchestra.run.smithi092.stdout:753 2024-09-11T00:16:57.089 INFO:teuthology.orchestra.run.smithi092.stdout:753.out 2024-09-11T00:16:57.089 INFO:teuthology.orchestra.run.smithi092.stdout:754 2024-09-11T00:16:57.089 INFO:teuthology.orchestra.run.smithi092.stdout:754.out 2024-09-11T00:16:57.090 INFO:teuthology.orchestra.run.smithi092.stdout:755 2024-09-11T00:16:57.090 INFO:teuthology.orchestra.run.smithi092.stdout:755.out 2024-09-11T00:16:57.090 INFO:teuthology.orchestra.run.smithi092.stdout:group.list 2024-09-11T00:16:57.090 INFO:teuthology.orchestra.run.smithi092.stdout:Makefile 2024-09-11T00:16:57.090 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/001) 2024-09-11T00:16:57.282 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:16:57.286 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:16:57.286 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:16:57.287 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:16:57.287 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:17:02.584 INFO:teuthology.orchestra.run.smithi092.stdout:generic/001 5s 2024-09-11T00:17:02.590 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/001 2024-09-11T00:17:02.590 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:17:02.592 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:17:02.891 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:17:02.891 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/002) 2024-09-11T00:17:03.105 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:17:03.111 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:17:03.111 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:17:03.113 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:17:03.113 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:17:03.570 INFO:teuthology.orchestra.run.smithi092.stdout:generic/002 0s 2024-09-11T00:17:03.576 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/002 2024-09-11T00:17:03.576 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:17:03.578 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:17:03.620 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:17:03.621 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/003) 2024-09-11T00:17:03.791 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:17:03.795 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:17:03.795 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:17:03.796 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:17:03.796 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:17:03.995 INFO:teuthology.orchestra.run.smithi092.stdout:generic/003 [not run] atime not maintained by ceph 2024-09-11T00:17:04.000 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/003 2024-09-11T00:17:04.000 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/003 2024-09-11T00:17:04.000 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:17:04.002 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:17:04.012 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:17:04.012 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/004) 2024-09-11T00:17:04.183 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:17:04.187 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:17:04.187 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:17:04.189 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:17:04.189 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:17:04.391 INFO:teuthology.orchestra.run.smithi092.stdout:generic/004 [not run] O_TMPFILE is not supported 2024-09-11T00:17:04.396 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/004 2024-09-11T00:17:04.396 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/004 2024-09-11T00:17:04.396 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:17:04.398 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:17:04.409 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:17:04.409 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/005) 2024-09-11T00:17:04.579 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:17:04.583 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:17:04.583 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:17:04.584 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:17:04.585 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:17:04.934 INFO:teuthology.orchestra.run.smithi092.stdout:generic/005 0s 2024-09-11T00:17:04.940 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/005 2024-09-11T00:17:04.941 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:17:04.943 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:17:04.984 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:17:04.984 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/006) 2024-09-11T00:17:05.166 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:17:05.170 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:17:05.170 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:17:05.171 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:17:05.171 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:17:16.815 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T00:17:16.818 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T00:17:30.158 INFO:teuthology.orchestra.run.smithi092.stdout:generic/006 25s 2024-09-11T00:17:30.165 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/006 2024-09-11T00:17:30.165 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:17:30.167 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:17:30.259 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:17:30.259 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/007) 2024-09-11T00:17:30.655 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:17:30.659 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:17:30.659 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:17:30.660 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:17:30.660 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:17:47.097 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T00:17:47.100 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T00:18:17.154 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T00:18:17.157 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T00:18:21.799 INFO:teuthology.orchestra.run.smithi092.stdout:generic/007 51s 2024-09-11T00:18:21.958 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/007 2024-09-11T00:18:21.958 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:18:21.961 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:18:22.044 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:18:22.045 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/008) 2024-09-11T00:18:22.216 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:18:22.220 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:18:22.220 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:18:22.221 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:18:22.221 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:18:22.475 INFO:teuthology.orchestra.run.smithi092.stdout:generic/008 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2024-09-11T00:18:22.479 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/008 2024-09-11T00:18:22.479 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/008 2024-09-11T00:18:22.479 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:18:22.482 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:18:22.494 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:18:22.495 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/009) 2024-09-11T00:18:22.664 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:18:22.668 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:18:22.668 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:18:22.669 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:18:22.669 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:18:22.954 INFO:teuthology.orchestra.run.smithi092.stdout:generic/009 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2024-09-11T00:18:22.959 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/009 2024-09-11T00:18:22.959 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/009 2024-09-11T00:18:22.959 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:18:22.961 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:18:22.974 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:18:22.975 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/010) 2024-09-11T00:18:23.145 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:18:23.149 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:18:23.149 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:18:23.150 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:18:23.150 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:18:23.719 INFO:teuthology.orchestra.run.smithi092.stdout:generic/010 0s 2024-09-11T00:18:23.790 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/010 2024-09-11T00:18:23.790 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:18:23.793 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:18:23.839 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:18:23.839 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/011) 2024-09-11T00:18:24.018 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:18:24.022 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:18:24.023 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:18:24.023 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:18:24.024 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:18:47.375 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T00:18:47.378 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T00:18:51.851 INFO:teuthology.orchestra.run.smithi092.stdout:generic/011 27s 2024-09-11T00:18:51.860 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/011 2024-09-11T00:18:51.860 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:18:51.863 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:18:51.913 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:18:51.914 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/012) 2024-09-11T00:18:52.098 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:18:52.102 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:18:52.103 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:18:52.104 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:18:52.104 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:18:52.496 INFO:teuthology.orchestra.run.smithi092.stdout:generic/012 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-09-11T00:18:52.501 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/012 2024-09-11T00:18:52.501 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/012 2024-09-11T00:18:52.501 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:18:52.503 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:18:52.545 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:18:52.545 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/013) 2024-09-11T00:18:52.728 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:18:52.732 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:18:52.732 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:18:52.733 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:18:52.733 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:19:17.453 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T00:19:17.458 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T00:19:48.000 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T00:19:48.003 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T00:19:56.435 INFO:teuthology.orchestra.run.smithi092.stdout:generic/013 64s 2024-09-11T00:19:56.449 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/013 2024-09-11T00:19:56.449 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:19:56.453 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:19:56.489 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:19:56.489 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/014) 2024-09-11T00:19:56.729 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:19:56.734 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:19:56.735 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:19:56.736 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:19:56.736 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:19:57.063 INFO:teuthology.orchestra.run.smithi092.stdout:generic/014 [not run] Sparse files are not supported or do not work as expected 2024-09-11T00:19:57.069 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/014 2024-09-11T00:19:57.070 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/014 2024-09-11T00:19:57.070 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:19:57.072 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:19:57.091 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:19:57.091 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/015) 2024-09-11T00:19:57.345 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:19:57.352 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:19:57.352 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:19:57.354 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:19:57.354 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:19:57.630 INFO:teuthology.orchestra.run.smithi092.stdout:generic/015 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2024-09-11T00:19:57.637 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/015 2024-09-11T00:19:57.637 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/015 2024-09-11T00:19:57.637 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:19:57.640 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:19:57.658 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:19:57.658 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/016) 2024-09-11T00:19:57.903 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:19:57.909 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:19:57.910 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:19:57.911 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:19:57.911 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:19:58.288 INFO:teuthology.orchestra.run.smithi092.stdout:generic/016 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-09-11T00:19:58.295 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/016 2024-09-11T00:19:58.295 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/016 2024-09-11T00:19:58.296 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:19:58.299 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:19:58.340 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:19:58.341 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/017) 2024-09-11T00:19:58.620 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:19:58.625 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:19:58.625 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:19:58.626 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:19:58.626 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:19:58.919 INFO:teuthology.orchestra.run.smithi092.stdout:generic/017 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2024-09-11T00:19:58.927 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/017 2024-09-11T00:19:58.927 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/017 2024-09-11T00:19:58.927 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:19:58.930 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:19:58.948 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:19:58.948 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/018) 2024-09-11T00:19:59.185 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:19:59.191 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:19:59.191 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:19:59.193 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:19:59.193 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:19:59.551 INFO:teuthology.orchestra.run.smithi092.stdout:generic/018 [not run] defragmentation not supported for fstype "ceph" 2024-09-11T00:19:59.560 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/018 2024-09-11T00:19:59.560 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/018 2024-09-11T00:19:59.561 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:19:59.563 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:19:59.577 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:19:59.578 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/019) 2024-09-11T00:19:59.815 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:19:59.821 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:19:59.822 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:19:59.823 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:19:59.823 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:20:00.090 INFO:teuthology.orchestra.run.smithi092.stdout:generic/019 [not run] require 172.21.15.92:6789:/scratch to be valid block disk 2024-09-11T00:20:00.098 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/019 2024-09-11T00:20:00.098 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/019 2024-09-11T00:20:00.098 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:20:00.101 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:20:00.119 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:20:00.119 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/020) 2024-09-11T00:20:00.367 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:20:00.374 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:20:00.374 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:20:00.376 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:20:00.376 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:20:04.100 INFO:teuthology.orchestra.run.smithi092.stdout:generic/020 4s 2024-09-11T00:20:04.175 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/020 2024-09-11T00:20:04.175 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:20:04.178 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:20:04.222 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:20:04.222 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/021) 2024-09-11T00:20:04.522 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:20:04.528 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:20:04.528 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:20:04.530 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:20:04.530 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:20:04.930 INFO:teuthology.orchestra.run.smithi092.stdout:generic/021 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-09-11T00:20:04.937 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/021 2024-09-11T00:20:04.937 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/021 2024-09-11T00:20:04.937 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:20:04.940 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:20:04.972 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:20:04.972 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/022) 2024-09-11T00:20:05.269 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:20:05.275 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:20:05.276 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:20:05.277 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:20:05.277 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:20:05.666 INFO:teuthology.orchestra.run.smithi092.stdout:generic/022 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-09-11T00:20:05.673 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/022 2024-09-11T00:20:05.673 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/022 2024-09-11T00:20:05.673 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:20:05.677 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:20:05.712 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:20:05.713 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/023) 2024-09-11T00:20:06.023 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:20:06.028 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:20:06.029 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:20:06.030 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:20:06.030 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:20:07.314 INFO:teuthology.orchestra.run.smithi092.stdout:generic/023 1s 2024-09-11T00:20:07.364 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/023 2024-09-11T00:20:07.364 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:20:07.368 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:20:07.431 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:20:07.431 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/024) 2024-09-11T00:20:07.730 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:20:07.736 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:20:07.736 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:20:07.738 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:20:07.738 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:20:08.028 INFO:teuthology.orchestra.run.smithi092.stdout:generic/024 [not run] kernel doesn't support renameat2 syscall 2024-09-11T00:20:08.035 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/024 2024-09-11T00:20:08.035 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/024 2024-09-11T00:20:08.035 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:20:08.038 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:20:08.088 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:20:08.088 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/025) 2024-09-11T00:20:08.370 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:20:08.376 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:20:08.376 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:20:08.378 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:20:08.378 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:20:08.691 INFO:teuthology.orchestra.run.smithi092.stdout:generic/025 [not run] kernel doesn't support renameat2 syscall 2024-09-11T00:20:08.698 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/025 2024-09-11T00:20:08.698 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/025 2024-09-11T00:20:08.698 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:20:08.702 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:20:08.740 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:20:08.741 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/026) 2024-09-11T00:20:09.039 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:20:09.045 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:20:09.045 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:20:09.047 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:20:09.047 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:20:09.387 INFO:teuthology.orchestra.run.smithi092.stdout:generic/026 [not run] ceph does not define maximum ACL count 2024-09-11T00:20:09.393 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/026 2024-09-11T00:20:09.393 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/026 2024-09-11T00:20:09.393 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:20:09.437 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:20:09.457 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:20:09.457 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/027) 2024-09-11T00:20:09.739 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:20:09.744 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:20:09.744 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:20:09.746 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:20:09.746 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:20:10.029 INFO:teuthology.orchestra.run.smithi092.stdout:generic/027 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2024-09-11T00:20:10.036 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/027 2024-09-11T00:20:10.036 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/027 2024-09-11T00:20:10.036 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:20:10.039 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:20:10.056 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:20:10.057 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/028) 2024-09-11T00:20:10.299 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:20:10.305 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:20:10.305 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:20:10.307 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:20:10.307 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:20:15.603 INFO:teuthology.orchestra.run.smithi092.stdout:generic/028 5s 2024-09-11T00:20:15.611 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/028 2024-09-11T00:20:15.611 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:20:15.613 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:20:15.635 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:20:15.635 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/029) 2024-09-11T00:20:15.873 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:20:15.878 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:20:15.878 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:20:15.880 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:20:15.880 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:20:18.065 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T00:20:18.068 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T00:20:18.422 INFO:tasks.ceph.mds.c.smithi092.stderr:2024-09-11T00:20:18.421+0000 7f6970484640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 124589) UID: 0 2024-09-11T00:20:18.423 INFO:tasks.ceph.mds.a.smithi092.stderr:2024-09-11T00:20:18.421+0000 7fab43790640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 124589) UID: 0 2024-09-11T00:20:19.551 INFO:teuthology.orchestra.run.smithi092.stdout:generic/029 4s 2024-09-11T00:20:19.608 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/029 2024-09-11T00:20:19.608 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:20:19.613 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:20:19.624 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:20:19.624 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/030) 2024-09-11T00:20:19.897 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:20:19.902 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:20:19.903 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:20:19.904 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:20:19.904 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:20:21.496 INFO:teuthology.orchestra.run.smithi092.stdout:generic/030 1s 2024-09-11T00:20:21.508 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/030 2024-09-11T00:20:21.508 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:20:21.512 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:20:21.525 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:20:21.526 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/031) 2024-09-11T00:20:21.802 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:20:21.808 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:20:21.809 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:20:21.810 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:20:21.811 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:20:22.180 INFO:teuthology.orchestra.run.smithi092.stdout:generic/031 [not run] xfs_io fcollapse failed (old kernel/wrong fs?) 2024-09-11T00:20:22.187 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/031 2024-09-11T00:20:22.187 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/031 2024-09-11T00:20:22.187 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:20:22.190 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:20:22.212 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:20:22.213 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/032) 2024-09-11T00:20:22.479 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:20:22.486 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:20:22.486 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:20:22.487 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:20:22.488 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:20:22.788 INFO:teuthology.orchestra.run.smithi092.stdout:generic/032 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-09-11T00:20:22.795 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/032 2024-09-11T00:20:22.795 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/032 2024-09-11T00:20:22.795 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:20:22.798 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:20:22.818 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:20:22.818 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/033) 2024-09-11T00:20:23.073 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:20:23.078 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:20:23.078 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:20:23.080 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:20:23.080 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:20:23.445 INFO:teuthology.orchestra.run.smithi092.stdout:generic/033 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2024-09-11T00:20:23.453 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/033 2024-09-11T00:20:23.453 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/033 2024-09-11T00:20:23.453 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:20:23.457 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:20:23.479 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:20:23.479 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/034) 2024-09-11T00:20:23.739 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:20:23.744 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:20:23.744 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:20:23.746 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:20:23.746 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:20:24.084 INFO:teuthology.orchestra.run.smithi092.stdout:generic/034 [not run] require 172.21.15.92:6789:/scratch to be valid block disk 2024-09-11T00:20:24.091 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/034 2024-09-11T00:20:24.091 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/034 2024-09-11T00:20:24.091 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:20:24.095 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:20:24.111 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:20:24.112 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/035) 2024-09-11T00:20:24.391 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:20:24.397 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:20:24.398 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:20:24.399 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:20:24.399 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:20:24.773 INFO:teuthology.orchestra.run.smithi092.stdout:generic/035 0s 2024-09-11T00:20:24.781 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/035 2024-09-11T00:20:24.782 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:20:24.785 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:20:24.828 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:20:24.829 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/036) 2024-09-11T00:20:25.164 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:20:25.170 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:20:25.172 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:20:25.174 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:20:25.174 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:20:35.575 INFO:teuthology.orchestra.run.smithi092.stdout:generic/036 10s 2024-09-11T00:20:35.585 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/036 2024-09-11T00:20:35.585 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:20:35.587 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:20:35.620 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:20:35.621 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/037) 2024-09-11T00:20:35.978 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:20:35.984 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:20:35.985 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:20:35.987 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:20:35.987 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:20:40.946 INFO:teuthology.orchestra.run.smithi092.stdout:generic/037 4s 2024-09-11T00:20:40.955 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/037 2024-09-11T00:20:40.955 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:20:40.959 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:20:40.971 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:20:40.972 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/038) 2024-09-11T00:20:41.233 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:20:41.240 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:20:41.241 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:20:41.241 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:20:41.241 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:20:41.551 INFO:teuthology.orchestra.run.smithi092.stdout:generic/038 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-09-11T00:20:41.559 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/038 2024-09-11T00:20:41.559 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/038 2024-09-11T00:20:41.559 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:20:41.563 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:20:41.581 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:20:41.581 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/039) 2024-09-11T00:20:41.857 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:20:41.863 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:20:41.863 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:20:41.864 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:20:41.865 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:20:42.192 INFO:teuthology.orchestra.run.smithi092.stdout:generic/039 [not run] require 172.21.15.92:6789:/scratch to be valid block disk 2024-09-11T00:20:42.198 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/039 2024-09-11T00:20:42.199 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/039 2024-09-11T00:20:42.199 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:20:42.202 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:20:42.229 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:20:42.229 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/040) 2024-09-11T00:20:42.499 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:20:42.504 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:20:42.505 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:20:42.507 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:20:42.507 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:20:42.831 INFO:teuthology.orchestra.run.smithi092.stdout:generic/040 [not run] require 172.21.15.92:6789:/scratch to be valid block disk 2024-09-11T00:20:42.838 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/040 2024-09-11T00:20:42.838 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/040 2024-09-11T00:20:42.838 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:20:42.840 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:20:42.869 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:20:42.870 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/041) 2024-09-11T00:20:43.126 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:20:43.132 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:20:43.133 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:20:43.134 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:20:43.134 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:20:43.469 INFO:teuthology.orchestra.run.smithi092.stdout:generic/041 [not run] require 172.21.15.92:6789:/scratch to be valid block disk 2024-09-11T00:20:43.475 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/041 2024-09-11T00:20:43.476 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/041 2024-09-11T00:20:43.476 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:20:43.480 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:20:43.501 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:20:43.501 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/042) 2024-09-11T00:20:43.780 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:20:43.785 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:20:43.786 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:20:43.787 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:20:43.787 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:20:44.198 INFO:teuthology.orchestra.run.smithi092.stdout:generic/042 [not run] ceph does not support shutdown 2024-09-11T00:20:44.212 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/042 2024-09-11T00:20:44.212 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/042 2024-09-11T00:20:44.212 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:20:44.219 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:20:44.234 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:20:44.234 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/043) 2024-09-11T00:20:44.500 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:20:44.504 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:20:44.505 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:20:44.506 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:20:44.506 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:20:44.890 INFO:teuthology.orchestra.run.smithi092.stdout:generic/043 [not run] ceph does not support shutdown 2024-09-11T00:20:44.902 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/043 2024-09-11T00:20:44.902 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/043 2024-09-11T00:20:44.902 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:20:44.905 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:20:44.921 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:20:44.921 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/044) 2024-09-11T00:20:45.201 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:20:45.207 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:20:45.208 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:20:45.209 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:20:45.209 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:20:45.590 INFO:teuthology.orchestra.run.smithi092.stdout:generic/044 [not run] ceph does not support shutdown 2024-09-11T00:20:45.602 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/044 2024-09-11T00:20:45.602 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/044 2024-09-11T00:20:45.602 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:20:45.605 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:20:45.622 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:20:45.623 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/045) 2024-09-11T00:20:45.903 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:20:45.908 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:20:45.909 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:20:45.911 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:20:45.911 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:20:46.287 INFO:teuthology.orchestra.run.smithi092.stdout:generic/045 [not run] ceph does not support shutdown 2024-09-11T00:20:46.298 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/045 2024-09-11T00:20:46.299 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/045 2024-09-11T00:20:46.299 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:20:46.302 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:20:46.316 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:20:46.316 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/046) 2024-09-11T00:20:46.583 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:20:46.588 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:20:46.589 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:20:46.590 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:20:46.590 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:20:46.973 INFO:teuthology.orchestra.run.smithi092.stdout:generic/046 [not run] ceph does not support shutdown 2024-09-11T00:20:46.992 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/046 2024-09-11T00:20:46.992 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/046 2024-09-11T00:20:46.992 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:20:46.996 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:20:47.018 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:20:47.019 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/047) 2024-09-11T00:20:47.273 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:20:47.278 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:20:47.279 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:20:47.280 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:20:47.280 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:20:47.672 INFO:teuthology.orchestra.run.smithi092.stdout:generic/047 [not run] ceph does not support shutdown 2024-09-11T00:20:47.684 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/047 2024-09-11T00:20:47.684 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/047 2024-09-11T00:20:47.684 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:20:47.687 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:20:47.701 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:20:47.701 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/048) 2024-09-11T00:20:47.972 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:20:47.977 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:20:47.977 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:20:47.979 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:20:47.979 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:20:48.364 INFO:teuthology.orchestra.run.smithi092.stdout:generic/048 [not run] ceph does not support shutdown 2024-09-11T00:20:48.385 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/048 2024-09-11T00:20:48.385 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/048 2024-09-11T00:20:48.385 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:20:48.388 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:20:48.405 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:20:48.405 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/049) 2024-09-11T00:20:48.677 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:20:48.947 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:20:48.947 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:20:48.947 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:20:48.947 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:20:49.049 INFO:teuthology.orchestra.run.smithi092.stdout:generic/049 [not run] ceph does not support shutdown 2024-09-11T00:20:49.071 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/049 2024-09-11T00:20:49.072 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/049 2024-09-11T00:20:49.072 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:20:49.074 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:20:49.089 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:20:49.089 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/050) 2024-09-11T00:20:49.347 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:20:49.352 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:20:49.352 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:20:49.353 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:20:49.353 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:20:49.945 INFO:teuthology.orchestra.run.smithi092.stdout:generic/050 [not run] ceph does not support shutdown 2024-09-11T00:20:49.957 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/050 2024-09-11T00:20:49.957 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/050 2024-09-11T00:20:49.957 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:20:49.960 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:20:49.976 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:20:49.976 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/051) 2024-09-11T00:20:50.256 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:20:50.262 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:20:50.263 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:20:50.264 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:20:50.264 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:20:50.652 INFO:teuthology.orchestra.run.smithi092.stdout:generic/051 [not run] ceph does not support shutdown 2024-09-11T00:20:50.660 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/051 2024-09-11T00:20:50.660 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/051 2024-09-11T00:20:50.660 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:20:50.664 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:20:50.685 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:20:50.685 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/052) 2024-09-11T00:20:50.952 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:20:50.957 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:20:50.958 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:20:50.959 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:20:50.959 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:20:51.341 INFO:teuthology.orchestra.run.smithi092.stdout:generic/052 [not run] ceph does not support shutdown 2024-09-11T00:20:51.362 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/052 2024-09-11T00:20:51.362 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/052 2024-09-11T00:20:51.363 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:20:51.365 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:20:51.381 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:20:51.381 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/053) 2024-09-11T00:20:51.638 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:20:51.644 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:20:51.645 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:20:51.647 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:20:51.647 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:20:52.343 INFO:teuthology.orchestra.run.smithi092.stdout:generic/053 1s 2024-09-11T00:20:52.418 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/053 2024-09-11T00:20:52.418 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:20:52.421 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:20:52.444 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:20:52.444 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/054) 2024-09-11T00:20:52.723 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:20:52.729 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:20:52.730 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:20:52.732 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:20:52.732 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:20:53.151 INFO:teuthology.orchestra.run.smithi092.stdout:generic/054 [not run] ceph does not support shutdown 2024-09-11T00:20:53.170 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/054 2024-09-11T00:20:53.171 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/054 2024-09-11T00:20:53.171 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:20:53.174 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:20:53.190 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:20:53.190 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/055) 2024-09-11T00:20:53.464 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:20:53.469 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:20:53.469 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:20:53.470 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:20:53.470 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:20:53.864 INFO:teuthology.orchestra.run.smithi092.stdout:generic/055 [not run] ceph does not support shutdown 2024-09-11T00:20:53.887 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/055 2024-09-11T00:20:53.887 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/055 2024-09-11T00:20:53.887 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:20:53.891 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:20:53.909 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:20:53.909 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/056) 2024-09-11T00:20:54.184 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:20:54.190 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:20:54.191 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:20:54.192 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:20:54.192 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:20:54.522 INFO:teuthology.orchestra.run.smithi092.stdout:generic/056 [not run] require 172.21.15.92:6789:/scratch to be valid block disk 2024-09-11T00:20:54.528 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/056 2024-09-11T00:20:54.528 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/056 2024-09-11T00:20:54.528 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:20:54.532 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:20:54.563 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:20:54.563 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/057) 2024-09-11T00:20:54.850 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:20:54.856 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:20:54.857 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:20:54.858 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:20:54.858 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:20:55.183 INFO:teuthology.orchestra.run.smithi092.stdout:generic/057 [not run] require 172.21.15.92:6789:/scratch to be valid block disk 2024-09-11T00:20:55.190 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/057 2024-09-11T00:20:55.190 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/057 2024-09-11T00:20:55.190 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:20:55.193 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:20:55.214 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:20:55.215 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/058) 2024-09-11T00:20:55.480 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:20:55.486 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:20:55.486 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:20:55.488 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:20:55.488 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:20:55.907 INFO:teuthology.orchestra.run.smithi092.stdout:generic/058 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-09-11T00:20:55.916 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/058 2024-09-11T00:20:55.916 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/058 2024-09-11T00:20:55.916 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:20:55.920 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:20:55.961 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:20:55.962 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/059) 2024-09-11T00:20:56.330 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:20:56.336 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:20:56.336 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:20:56.337 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:20:56.337 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:20:56.637 INFO:teuthology.orchestra.run.smithi092.stdout:generic/059 [not run] require 172.21.15.92:6789:/scratch to be valid block disk 2024-09-11T00:20:56.644 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/059 2024-09-11T00:20:56.644 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/059 2024-09-11T00:20:56.644 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:20:56.648 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:20:56.673 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:20:56.674 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/060) 2024-09-11T00:20:56.931 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:20:56.940 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:20:56.940 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:20:56.942 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:20:56.942 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:20:57.351 INFO:teuthology.orchestra.run.smithi092.stdout:generic/060 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-09-11T00:20:57.357 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/060 2024-09-11T00:20:57.358 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/060 2024-09-11T00:20:57.358 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:20:57.361 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:20:57.409 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:20:57.409 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/061) 2024-09-11T00:20:57.762 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:20:57.767 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:20:57.769 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:20:57.770 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:20:57.771 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:20:58.163 INFO:teuthology.orchestra.run.smithi092.stdout:generic/061 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-09-11T00:20:58.170 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/061 2024-09-11T00:20:58.170 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/061 2024-09-11T00:20:58.170 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:20:58.173 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:20:58.201 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:20:58.202 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/062) 2024-09-11T00:20:58.578 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:20:58.586 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:20:58.587 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:20:58.589 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:20:58.589 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:21:00.386 INFO:teuthology.orchestra.run.smithi092.stdout:generic/062 2s 2024-09-11T00:21:00.398 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/062 2024-09-11T00:21:00.399 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:21:00.405 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:21:00.429 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:21:00.430 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/063) 2024-09-11T00:21:00.769 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:21:00.775 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:21:00.776 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:21:00.777 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:21:00.777 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:21:01.265 INFO:teuthology.orchestra.run.smithi092.stdout:generic/063 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-09-11T00:21:01.271 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/063 2024-09-11T00:21:01.271 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/063 2024-09-11T00:21:01.271 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:21:01.275 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:21:01.309 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:21:01.310 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/064) 2024-09-11T00:21:01.689 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:21:01.696 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:21:01.697 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:21:01.698 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:21:01.698 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:21:02.026 INFO:teuthology.orchestra.run.smithi092.stdout:generic/064 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2024-09-11T00:21:02.033 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/064 2024-09-11T00:21:02.033 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/064 2024-09-11T00:21:02.033 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:21:02.037 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:21:02.056 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:21:02.056 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/065) 2024-09-11T00:21:02.333 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:21:02.339 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:21:02.340 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:21:02.342 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:21:02.342 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:21:02.661 INFO:teuthology.orchestra.run.smithi092.stdout:generic/065 [not run] require 172.21.15.92:6789:/scratch to be valid block disk 2024-09-11T00:21:02.668 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/065 2024-09-11T00:21:02.668 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/065 2024-09-11T00:21:02.668 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:21:02.671 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:21:02.691 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:21:02.692 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/066) 2024-09-11T00:21:02.971 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:21:02.976 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:21:02.977 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:21:02.978 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:21:02.978 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:21:03.288 INFO:teuthology.orchestra.run.smithi092.stdout:generic/066 [not run] require 172.21.15.92:6789:/scratch to be valid block disk 2024-09-11T00:21:03.294 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/066 2024-09-11T00:21:03.295 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/066 2024-09-11T00:21:03.295 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:21:03.301 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:21:03.317 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:21:03.318 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/067) 2024-09-11T00:21:03.579 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:21:03.584 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:21:03.585 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:21:03.586 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:21:03.586 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:21:03.933 INFO:teuthology.orchestra.run.smithi092.stdout:generic/067 [not run] require 172.21.15.92:6789:/scratch to be valid block disk 2024-09-11T00:21:03.940 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/067 2024-09-11T00:21:03.940 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/067 2024-09-11T00:21:03.941 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:21:03.945 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:21:03.967 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:21:03.968 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/068) 2024-09-11T00:21:04.239 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:21:04.248 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:21:04.249 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:21:04.250 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:21:04.250 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:21:04.570 INFO:teuthology.orchestra.run.smithi092.stdout:generic/068 [not run] ceph does not support freezing 2024-09-11T00:21:04.577 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/068 2024-09-11T00:21:04.577 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/068 2024-09-11T00:21:04.577 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:21:04.582 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:21:04.599 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:21:04.600 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/069) 2024-09-11T00:21:04.872 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:21:04.879 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:21:04.880 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:21:04.881 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:21:04.881 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:21:11.855 INFO:teuthology.orchestra.run.smithi092.stdout:generic/069 7s 2024-09-11T00:21:11.867 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/069 2024-09-11T00:21:11.868 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:21:11.879 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:21:11.893 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:21:11.894 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/070) 2024-09-11T00:21:12.227 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:21:12.233 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:21:12.234 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:21:12.235 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:21:12.235 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:21:44.544 INFO:teuthology.orchestra.run.smithi092.stdout:generic/070 32s 2024-09-11T00:21:44.553 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/070 2024-09-11T00:21:44.554 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:21:44.557 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:21:44.664 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:21:44.664 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/071) 2024-09-11T00:21:45.056 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:21:45.061 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:21:45.061 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:21:45.063 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:21:45.063 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:21:45.355 INFO:teuthology.orchestra.run.smithi092.stdout:generic/071 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2024-09-11T00:21:45.362 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/071 2024-09-11T00:21:45.362 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/071 2024-09-11T00:21:45.363 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:21:45.366 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:21:45.383 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:21:45.384 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/072) 2024-09-11T00:21:45.654 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:21:45.659 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:21:45.660 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:21:45.663 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:21:45.663 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:21:46.036 INFO:teuthology.orchestra.run.smithi092.stdout:generic/072 [not run] xfs_io fcollapse failed (old kernel/wrong fs?) 2024-09-11T00:21:46.043 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/072 2024-09-11T00:21:46.043 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/072 2024-09-11T00:21:46.043 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:21:46.047 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:21:46.068 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:21:46.068 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/073) 2024-09-11T00:21:46.328 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:21:46.334 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:21:46.335 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:21:46.336 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:21:46.336 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:21:46.649 INFO:teuthology.orchestra.run.smithi092.stdout:generic/073 [not run] require 172.21.15.92:6789:/scratch to be valid block disk 2024-09-11T00:21:46.655 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/073 2024-09-11T00:21:46.655 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/073 2024-09-11T00:21:46.655 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:21:46.658 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:21:46.673 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:21:46.674 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/074) 2024-09-11T00:21:46.927 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:21:46.933 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:21:46.934 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:21:46.935 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:21:46.935 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:22:02.006 INFO:teuthology.orchestra.run.smithi092.stdout:generic/074 14s 2024-09-11T00:22:02.014 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/074 2024-09-11T00:22:02.015 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:22:02.020 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:22:03.206 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:22:03.206 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/075) 2024-09-11T00:22:03.608 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:22:03.613 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:22:03.614 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:22:03.615 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:22:03.615 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:22:24.825 INFO:teuthology.orchestra.run.smithi092.stdout:generic/075 21s 2024-09-11T00:22:24.836 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/075 2024-09-11T00:22:24.836 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:22:24.841 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:22:24.903 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:22:24.903 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/076) 2024-09-11T00:22:25.301 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:22:25.307 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:22:25.308 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:22:25.309 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:22:25.310 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:22:25.598 INFO:teuthology.orchestra.run.smithi092.stdout:generic/076 [not run] require 172.21.15.92:6789:/scratch to be local device 2024-09-11T00:22:25.604 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/076 2024-09-11T00:22:25.604 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/076 2024-09-11T00:22:25.604 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:22:25.607 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:22:25.621 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:22:25.621 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/077) 2024-09-11T00:22:25.875 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:22:25.880 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:22:25.880 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:22:25.881 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:22:25.881 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:22:27.012 INFO:teuthology.orchestra.run.smithi092.stdout:generic/077 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2024-09-11T00:22:27.018 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/077 2024-09-11T00:22:27.019 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/077 2024-09-11T00:22:27.019 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:22:27.021 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:22:27.066 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:22:27.066 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/078) 2024-09-11T00:22:27.495 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:22:27.501 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:22:27.502 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:22:27.503 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:22:27.503 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:22:27.833 INFO:teuthology.orchestra.run.smithi092.stdout:generic/078 [not run] kernel doesn't support renameat2 syscall 2024-09-11T00:22:27.839 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/078 2024-09-11T00:22:27.839 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/078 2024-09-11T00:22:27.839 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:22:27.842 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:22:27.885 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:22:27.885 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/079) 2024-09-11T00:22:28.322 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:22:28.327 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:22:28.327 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:22:28.329 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:22:28.329 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:22:28.668 INFO:teuthology.orchestra.run.smithi092.stdout:generic/079 [not run] file system doesn't support chattr +ia 2024-09-11T00:22:28.673 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/079 2024-09-11T00:22:28.673 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/079 2024-09-11T00:22:28.674 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:22:28.676 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:22:28.702 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:22:28.702 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/080) 2024-09-11T00:22:28.961 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:22:28.969 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:22:28.969 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:22:28.970 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:22:28.970 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:22:31.336 INFO:teuthology.orchestra.run.smithi092.stdout:generic/080 2s 2024-09-11T00:22:31.346 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/080 2024-09-11T00:22:31.346 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:22:31.349 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:22:31.381 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:22:31.381 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/081) 2024-09-11T00:22:31.657 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:22:31.663 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:22:31.663 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:22:31.664 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:22:31.665 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:22:31.986 INFO:teuthology.orchestra.run.smithi092.stdout:generic/081 [not run] require 172.21.15.92:6789:/scratch to be valid block disk 2024-09-11T00:22:31.992 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/081 2024-09-11T00:22:31.992 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/081 2024-09-11T00:22:31.993 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:22:31.995 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:22:32.010 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:22:32.010 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/082) 2024-09-11T00:22:32.284 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:22:32.290 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:22:32.290 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:22:32.291 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:22:32.291 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:22:32.600 INFO:teuthology.orchestra.run.smithi092.stdout:generic/082 [not run] disk quotas not supported by this filesystem type: ceph 2024-09-11T00:22:32.607 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/082 2024-09-11T00:22:32.607 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/082 2024-09-11T00:22:32.607 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:22:32.610 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:22:32.630 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:22:32.630 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/083) 2024-09-11T00:22:32.891 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:22:32.897 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:22:32.897 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:22:32.898 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:22:32.899 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:22:33.219 INFO:teuthology.orchestra.run.smithi092.stdout:generic/083 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2024-09-11T00:22:33.225 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/083 2024-09-11T00:22:33.225 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/083 2024-09-11T00:22:33.225 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:22:33.228 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:22:33.244 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:22:33.244 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/084) 2024-09-11T00:22:33.507 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:22:33.512 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:22:33.512 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:22:33.513 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:22:33.513 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:22:39.143 INFO:teuthology.orchestra.run.smithi092.stdout:generic/084 6s 2024-09-11T00:22:39.308 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/084 2024-09-11T00:22:39.309 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:22:39.312 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:22:39.325 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:22:39.326 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/085) 2024-09-11T00:22:39.576 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:22:39.582 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:22:39.582 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:22:39.583 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:22:39.583 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:22:39.879 INFO:teuthology.orchestra.run.smithi092.stdout:generic/085 [not run] require 172.21.15.92:6789:/scratch to be valid block disk 2024-09-11T00:22:39.886 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/085 2024-09-11T00:22:39.887 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/085 2024-09-11T00:22:39.887 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:22:39.889 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:22:39.918 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:22:39.918 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/086) 2024-09-11T00:22:40.203 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:22:40.207 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:22:40.208 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:22:40.209 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:22:40.209 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:22:40.509 INFO:teuthology.orchestra.run.smithi092.stdout:generic/086 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-09-11T00:22:40.515 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/086 2024-09-11T00:22:40.515 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/086 2024-09-11T00:22:40.515 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:22:40.519 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:22:40.537 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:22:40.537 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/087) 2024-09-11T00:22:40.797 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:22:40.802 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:22:40.803 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:22:40.804 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:22:40.805 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:22:41.225 INFO:teuthology.orchestra.run.smithi092.stdout:generic/087 1s 2024-09-11T00:22:41.250 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/087 2024-09-11T00:22:41.251 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:22:41.253 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:22:41.308 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:22:41.308 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/088) 2024-09-11T00:22:41.732 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:22:41.737 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:22:41.737 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:22:41.738 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:22:41.738 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:22:42.099 INFO:teuthology.orchestra.run.smithi092.stdout:generic/088 1s 2024-09-11T00:22:42.146 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/088 2024-09-11T00:22:42.146 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:22:42.150 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:22:42.192 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:22:42.193 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/089) 2024-09-11T00:22:42.580 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:22:42.586 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:22:42.590 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:22:42.591 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:22:42.591 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:23:23.572 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T00:23:23.576 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T00:23:54.068 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T00:23:54.072 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T00:24:24.379 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T00:24:24.382 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T00:24:54.441 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T00:24:54.447 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T00:25:24.865 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T00:25:24.869 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T00:25:54.948 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T00:25:54.951 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T00:26:25.086 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T00:26:25.090 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T00:26:25.282 INFO:tasks.ceph.mds.a.smithi092.stderr:2024-09-11T00:26:25.280+0000 7fab43790640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 168788) UID: 0 2024-09-11T00:26:25.283 INFO:tasks.ceph.mds.c.smithi092.stderr:2024-09-11T00:26:25.280+0000 7f6970484640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 168788) UID: 0 2024-09-11T00:29:29.090 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T00:29:29.097 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T00:29:29.379 INFO:tasks.ceph.mds.c.smithi092.stderr:2024-09-11T00:29:29.377+0000 7f6970484640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 170826) UID: 0 2024-09-11T00:29:29.380 INFO:tasks.ceph.mds.a.smithi092.stderr:2024-09-11T00:29:29.378+0000 7fab43790640 -1 Fail to open '/proc/170826/cmdline' error = (2) No such file or directory 2024-09-11T00:29:29.380 INFO:tasks.ceph.mds.a.smithi092.stderr:2024-09-11T00:29:29.378+0000 7fab43790640 -1 received signal: Hangup from (PID: 170826) UID: 0 2024-09-11T00:30:59.739 INFO:teuthology.orchestra.run.smithi092.stdout:generic/089 497s 2024-09-11T00:31:00.092 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/089 2024-09-11T00:31:00.092 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:31:00.094 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:31:00.403 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:31:00.404 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/090) 2024-09-11T00:31:01.141 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:31:01.145 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:31:01.145 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:31:01.146 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:31:01.147 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:31:01.411 INFO:teuthology.orchestra.run.smithi092.stdout:generic/090 [not run] require 172.21.15.92:6789:/scratch to be valid block disk 2024-09-11T00:31:01.415 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/090 2024-09-11T00:31:01.416 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/090 2024-09-11T00:31:01.416 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:31:01.418 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:31:01.433 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:31:01.433 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/091) 2024-09-11T00:31:01.610 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:31:01.614 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:31:01.614 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:31:01.615 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:31:01.615 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:32:19.830 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T00:32:19.833 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T00:32:41.574 INFO:teuthology.orchestra.run.smithi092.stdout:generic/091 100s 2024-09-11T00:32:41.609 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/091 2024-09-11T00:32:41.609 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:32:41.612 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:32:41.670 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:32:41.671 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/092) 2024-09-11T00:32:42.038 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:32:42.042 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:32:42.043 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:32:42.043 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:32:42.044 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:32:42.263 INFO:teuthology.orchestra.run.smithi092.stdout:generic/092 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-09-11T00:32:42.268 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/092 2024-09-11T00:32:42.268 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/092 2024-09-11T00:32:42.268 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:32:42.271 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:32:42.285 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:32:42.285 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/093) 2024-09-11T00:32:42.462 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:32:42.466 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:32:42.466 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:32:42.467 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:32:42.468 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:32:43.008 INFO:teuthology.orchestra.run.smithi092.stdout:generic/093 1s 2024-09-11T00:32:43.014 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/093 2024-09-11T00:32:43.014 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:32:43.017 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:32:43.072 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:32:43.072 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/094) 2024-09-11T00:32:43.474 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:32:43.478 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:32:43.479 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:32:43.480 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:32:43.480 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:32:43.732 INFO:teuthology.orchestra.run.smithi092.stdout:generic/094 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2024-09-11T00:32:43.737 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/094 2024-09-11T00:32:43.737 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/094 2024-09-11T00:32:43.737 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:32:43.739 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:32:43.797 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:32:43.797 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/095) 2024-09-11T00:32:44.195 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:32:44.199 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:32:44.199 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:32:44.200 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:32:44.201 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:32:50.056 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T00:32:50.059 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T00:32:54.136 INFO:teuthology.orchestra.run.smithi092.stdout:generic/095 10s 2024-09-11T00:32:54.148 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/095 2024-09-11T00:32:54.149 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:32:54.152 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:32:54.172 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:32:54.172 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/096) 2024-09-11T00:32:54.389 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:32:54.393 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:32:54.393 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:32:54.394 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:32:54.394 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:32:54.674 INFO:teuthology.orchestra.run.smithi092.stdout:generic/096 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2024-09-11T00:32:54.678 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/096 2024-09-11T00:32:54.678 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/096 2024-09-11T00:32:54.678 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:32:54.681 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:32:54.696 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:32:54.696 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/097) 2024-09-11T00:32:54.880 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:32:54.884 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:32:54.884 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:32:54.885 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:32:54.885 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:32:55.509 INFO:teuthology.orchestra.run.smithi092.stdout:generic/097 1s 2024-09-11T00:32:55.516 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/097 2024-09-11T00:32:55.516 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:32:55.518 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:32:55.535 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:32:55.535 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/098) 2024-09-11T00:32:55.721 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:32:55.725 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:32:55.726 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:32:55.727 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:32:55.727 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:32:56.834 INFO:teuthology.orchestra.run.smithi092.stdout:generic/098 1s 2024-09-11T00:32:56.840 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/098 2024-09-11T00:32:56.840 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:32:56.842 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:32:56.851 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:32:56.851 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/099) 2024-09-11T00:32:57.024 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:32:57.028 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:32:57.028 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:32:57.029 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:32:57.030 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:32:57.804 INFO:teuthology.orchestra.run.smithi092.stdout:generic/099 0s 2024-09-11T00:32:57.810 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/099 2024-09-11T00:32:57.810 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:32:57.813 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:32:57.879 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:32:57.879 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/100) 2024-09-11T00:32:58.272 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:32:58.276 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:32:58.276 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:32:58.277 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:32:58.277 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:33:08.874 INFO:teuthology.orchestra.run.smithi092.stdout:generic/100 10s 2024-09-11T00:33:08.880 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/100 2024-09-11T00:33:08.880 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:33:08.882 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:33:11.750 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:33:11.751 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/101) 2024-09-11T00:33:12.058 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:33:12.062 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:33:12.063 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:33:12.064 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:33:12.064 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:33:12.282 INFO:teuthology.orchestra.run.smithi092.stdout:generic/101 [not run] require 172.21.15.92:6789:/scratch to be valid block disk 2024-09-11T00:33:12.287 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/101 2024-09-11T00:33:12.287 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/101 2024-09-11T00:33:12.287 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:33:12.290 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:33:12.300 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:33:12.300 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/102) 2024-09-11T00:33:12.471 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:33:12.474 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:33:12.475 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:33:12.476 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:33:12.476 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:33:12.679 INFO:teuthology.orchestra.run.smithi092.stdout:generic/102 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2024-09-11T00:33:12.684 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/102 2024-09-11T00:33:12.684 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/102 2024-09-11T00:33:12.684 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:33:12.687 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:33:12.698 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:33:12.698 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/103) 2024-09-11T00:33:12.878 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:33:12.882 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:33:12.882 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:33:12.883 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:33:12.883 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:33:13.113 INFO:teuthology.orchestra.run.smithi092.stdout:generic/103 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-09-11T00:33:13.118 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/103 2024-09-11T00:33:13.118 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/103 2024-09-11T00:33:13.118 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:33:13.121 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:33:13.166 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:33:13.166 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/104) 2024-09-11T00:33:13.561 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:33:13.565 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:33:13.565 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:33:13.566 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:33:13.566 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:33:13.785 INFO:teuthology.orchestra.run.smithi092.stdout:generic/104 [not run] require 172.21.15.92:6789:/scratch to be valid block disk 2024-09-11T00:33:13.790 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/104 2024-09-11T00:33:13.790 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/104 2024-09-11T00:33:13.791 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:33:13.793 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:33:13.806 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:33:13.806 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/105) 2024-09-11T00:33:13.978 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:33:13.982 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:33:13.982 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:33:13.983 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:33:13.983 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:33:14.414 INFO:teuthology.orchestra.run.smithi092.stdout:generic/105 0s 2024-09-11T00:33:14.442 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/105 2024-09-11T00:33:14.442 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:33:14.452 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:33:14.468 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:33:14.469 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/106) 2024-09-11T00:33:14.786 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:33:14.790 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:33:14.790 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:33:14.792 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:33:14.792 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:33:15.022 INFO:teuthology.orchestra.run.smithi092.stdout:generic/106 [not run] require 172.21.15.92:6789:/scratch to be valid block disk 2024-09-11T00:33:15.026 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/106 2024-09-11T00:33:15.026 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/106 2024-09-11T00:33:15.027 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:33:15.029 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:33:15.042 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:33:15.042 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/107) 2024-09-11T00:33:15.220 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:33:15.226 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:33:15.226 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:33:15.228 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:33:15.228 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:33:15.482 INFO:teuthology.orchestra.run.smithi092.stdout:generic/107 [not run] require 172.21.15.92:6789:/scratch to be valid block disk 2024-09-11T00:33:15.487 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/107 2024-09-11T00:33:15.487 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/107 2024-09-11T00:33:15.487 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:33:15.490 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:33:15.504 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:33:15.504 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/108) 2024-09-11T00:33:15.673 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:33:15.725 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:33:15.725 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:33:15.725 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:33:15.725 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:33:16.038 INFO:teuthology.orchestra.run.smithi092.stdout:generic/108 [not run] require 172.21.15.92:6789:/scratch to be valid block disk 2024-09-11T00:33:16.042 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/108 2024-09-11T00:33:16.042 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/108 2024-09-11T00:33:16.042 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:33:16.045 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:33:16.056 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:33:16.057 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/109) 2024-09-11T00:33:16.247 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:33:16.251 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:33:16.251 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:33:16.252 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:33:16.252 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:33:20.117 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T00:33:20.120 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T00:33:26.538 INFO:teuthology.orchestra.run.smithi092.stdout:generic/109 10s 2024-09-11T00:33:26.545 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/109 2024-09-11T00:33:26.545 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:33:26.547 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:33:26.557 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:33:26.557 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/110) 2024-09-11T00:33:27.319 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:33:27.325 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:33:27.325 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:33:27.325 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:33:27.326 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:33:44.630 INFO:teuthology.orchestra.run.smithi092.stdout:generic/110 [not run] Reflink not supported by test filesystem type: ceph 2024-09-11T00:33:44.635 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/110 2024-09-11T00:33:44.635 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/110 2024-09-11T00:33:44.635 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:33:44.637 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:33:44.698 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:33:44.698 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/111) 2024-09-11T00:33:45.198 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:33:45.207 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:33:45.209 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:33:45.212 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:33:45.212 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:33:45.779 INFO:teuthology.orchestra.run.smithi092.stdout:generic/111 [not run] Reflink not supported by test filesystem type: ceph 2024-09-11T00:33:45.784 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/111 2024-09-11T00:33:45.784 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/111 2024-09-11T00:33:45.784 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:33:45.786 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:33:45.840 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:33:45.840 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/112) 2024-09-11T00:33:46.239 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:33:46.243 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:33:46.244 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:33:46.245 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:33:46.245 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:33:50.537 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T00:33:50.540 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T00:34:01.809 INFO:teuthology.orchestra.run.smithi092.stdout:generic/112 15s 2024-09-11T00:34:01.815 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/112 2024-09-11T00:34:01.815 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:34:01.818 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:34:01.875 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:34:01.876 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/113) 2024-09-11T00:34:02.265 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:34:02.269 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:34:02.269 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:34:02.272 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:34:02.272 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:34:17.211 INFO:teuthology.orchestra.run.smithi092.stdout:generic/113 15s 2024-09-11T00:34:17.217 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/113 2024-09-11T00:34:17.217 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:34:17.220 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:34:17.270 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:34:17.271 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/114) 2024-09-11T00:34:17.661 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:34:17.665 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:34:17.665 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:34:17.666 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:34:17.666 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:34:17.981 INFO:teuthology.orchestra.run.smithi092.stdout:generic/114 [not run] Sparse files are not supported or do not work as expected 2024-09-11T00:34:17.989 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/114 2024-09-11T00:34:17.989 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/114 2024-09-11T00:34:17.989 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:34:17.998 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:34:18.044 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:34:18.044 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/115) 2024-09-11T00:34:18.220 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:34:18.224 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:34:18.224 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:34:18.225 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:34:18.225 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:34:18.462 INFO:teuthology.orchestra.run.smithi092.stdout:generic/115 [not run] Reflink not supported by test filesystem type: ceph 2024-09-11T00:34:18.467 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/115 2024-09-11T00:34:18.467 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/115 2024-09-11T00:34:18.467 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:34:18.469 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:34:18.530 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:34:18.530 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/116) 2024-09-11T00:34:18.935 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:34:18.939 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:34:18.939 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:34:18.940 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:34:18.940 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:34:19.180 INFO:teuthology.orchestra.run.smithi092.stdout:generic/116 [not run] Reflink not supported by test filesystem type: ceph 2024-09-11T00:34:19.185 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/116 2024-09-11T00:34:19.185 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/116 2024-09-11T00:34:19.185 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:34:19.187 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:34:19.246 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:34:19.246 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/117) 2024-09-11T00:34:19.642 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:34:19.646 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:34:19.647 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:34:19.647 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:34:19.648 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:34:20.609 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T00:34:20.613 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T00:34:35.575 INFO:teuthology.orchestra.run.smithi092.stdout:generic/117 16s 2024-09-11T00:34:35.587 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/117 2024-09-11T00:34:35.587 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:34:35.593 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:34:35.604 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:34:35.605 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/118) 2024-09-11T00:34:35.784 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:34:35.788 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:34:35.789 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:34:35.790 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:34:35.790 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:34:36.388 INFO:teuthology.orchestra.run.smithi092.stdout:generic/118 [not run] Reflink not supported by test filesystem type: ceph 2024-09-11T00:34:36.392 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/118 2024-09-11T00:34:36.393 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/118 2024-09-11T00:34:36.393 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:34:36.395 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:34:36.459 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:34:36.459 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/119) 2024-09-11T00:34:36.841 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:34:36.844 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:34:36.845 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:34:36.846 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:34:36.846 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:34:37.165 INFO:teuthology.orchestra.run.smithi092.stdout:generic/119 [not run] Reflink not supported by test filesystem type: ceph 2024-09-11T00:34:37.170 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/119 2024-09-11T00:34:37.170 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/119 2024-09-11T00:34:37.170 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:34:37.173 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:34:37.231 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:34:37.231 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/120) 2024-09-11T00:34:37.611 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:34:37.616 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:34:37.616 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:34:37.617 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:34:37.617 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:34:37.822 INFO:teuthology.orchestra.run.smithi092.stdout:generic/120 [not run] atime not maintained by ceph 2024-09-11T00:34:37.827 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/120 2024-09-11T00:34:37.827 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/120 2024-09-11T00:34:37.827 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:34:37.829 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:34:37.842 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:34:37.842 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/121) 2024-09-11T00:34:38.020 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:34:38.024 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:34:38.024 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:34:38.025 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:34:38.025 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:34:38.262 INFO:teuthology.orchestra.run.smithi092.stdout:generic/121 [not run] Dedupe not supported by test filesystem type: ceph 2024-09-11T00:34:38.267 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/121 2024-09-11T00:34:38.267 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/121 2024-09-11T00:34:38.267 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:34:38.270 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:34:38.342 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:34:38.342 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/122) 2024-09-11T00:34:38.727 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:34:38.731 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:34:38.731 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:34:38.732 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:34:38.732 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:34:38.970 INFO:teuthology.orchestra.run.smithi092.stdout:generic/122 [not run] Dedupe not supported by test filesystem type: ceph 2024-09-11T00:34:38.975 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/122 2024-09-11T00:34:38.975 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/122 2024-09-11T00:34:38.975 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:34:38.977 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:34:39.029 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:34:39.029 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/123) 2024-09-11T00:34:39.430 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:34:39.434 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:34:39.435 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:34:39.436 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:34:39.436 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:34:39.932 INFO:teuthology.orchestra.run.smithi092.stdout:generic/123 0s 2024-09-11T00:34:39.938 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/123 2024-09-11T00:34:39.938 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:34:39.940 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:34:40.008 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:34:40.008 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/124) 2024-09-11T00:34:40.383 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:34:40.386 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:34:40.387 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:34:40.388 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:34:40.388 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:34:42.286 INFO:teuthology.orchestra.run.smithi092.stdout:generic/124 2s 2024-09-11T00:34:42.305 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/124 2024-09-11T00:34:42.305 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:34:42.317 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:34:42.730 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:34:42.730 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/125) 2024-09-11T00:34:43.244 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:34:43.248 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:34:43.248 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:34:43.249 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:34:43.249 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:34:51.290 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T00:34:51.293 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T00:35:21.812 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T00:35:21.815 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T00:35:44.655 INFO:teuthology.orchestra.run.smithi092.stdout:generic/125 61s 2024-09-11T00:35:44.662 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/125 2024-09-11T00:35:44.662 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:35:44.665 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:35:44.713 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:35:44.714 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/126) 2024-09-11T00:35:45.128 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:35:45.132 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:35:45.132 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:35:45.133 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:35:45.133 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:35:45.531 INFO:teuthology.orchestra.run.smithi092.stdout:generic/126 0s 2024-09-11T00:35:45.537 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/126 2024-09-11T00:35:45.537 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:35:45.539 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:35:45.614 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:35:45.614 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/127) 2024-09-11T00:35:46.082 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:35:46.086 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:35:46.087 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:35:46.088 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:35:46.088 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:35:51.880 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T00:35:51.884 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T00:36:22.001 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T00:36:22.004 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T00:36:52.340 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T00:36:52.344 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T00:37:22.394 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T00:37:22.398 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T00:37:52.555 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T00:37:52.559 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T00:38:22.661 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T00:38:22.664 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T00:38:52.833 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T00:38:52.837 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T00:39:22.892 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T00:39:22.895 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T00:39:53.279 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T00:39:53.282 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T00:40:23.333 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T00:40:23.336 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T00:40:53.509 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T00:40:53.513 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T00:41:23.690 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T00:41:23.694 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T00:41:23.723 INFO:tasks.ceph.mds.a.smithi092.stderr:2024-09-11T00:41:23.721+0000 7fab43790640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 204988) UID: 0 2024-09-11T00:41:23.723 INFO:tasks.ceph.mds.c.smithi092.stderr:2024-09-11T00:41:23.721+0000 7f6970484640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 204988) UID: 0 2024-09-11T00:43:58.094 INFO:teuthology.orchestra.run.smithi092.stdout:generic/127 492s 2024-09-11T00:43:58.099 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/127 2024-09-11T00:43:58.099 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:43:58.102 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:43:58.161 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:43:58.162 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/128) 2024-09-11T00:43:58.545 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:43:58.549 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:43:58.549 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:43:58.550 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:43:58.550 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:43:58.737 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T00:43:58.739 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T00:44:01.033 INFO:teuthology.orchestra.run.smithi092.stdout:generic/128 3s 2024-09-11T00:44:01.079 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/128 2024-09-11T00:44:01.079 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:44:01.082 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:44:01.091 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:44:01.091 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/129) 2024-09-11T00:44:01.268 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:44:01.272 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:44:01.272 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:44:01.273 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:44:01.273 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:44:01.538 INFO:teuthology.orchestra.run.smithi092.stdout:generic/129 [not run] Sparse files are not supported or do not work as expected 2024-09-11T00:44:01.543 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/129 2024-09-11T00:44:01.543 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/129 2024-09-11T00:44:01.543 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:44:01.546 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:44:01.563 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:44:01.563 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/130) 2024-09-11T00:44:01.742 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:44:01.746 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:44:01.746 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:44:01.747 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:44:01.747 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:44:01.963 INFO:teuthology.orchestra.run.smithi092.stdout:generic/130 [not run] Sparse files are not supported or do not work as expected 2024-09-11T00:44:01.968 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/130 2024-09-11T00:44:01.968 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/130 2024-09-11T00:44:01.968 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:44:01.970 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:44:01.990 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:44:01.990 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/131) 2024-09-11T00:44:02.175 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:44:02.179 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:44:02.179 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:44:02.180 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:44:02.181 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:44:03.533 INFO:teuthology.orchestra.run.smithi092.stdout:generic/131 1s 2024-09-11T00:44:03.540 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/131 2024-09-11T00:44:03.540 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:44:03.542 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:44:03.600 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:44:03.600 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/132) 2024-09-11T00:44:04.004 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:44:04.008 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:44:04.008 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:44:04.009 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:44:04.010 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:44:15.662 INFO:teuthology.orchestra.run.smithi092.stdout:generic/132 11s 2024-09-11T00:44:15.668 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/132 2024-09-11T00:44:15.668 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:44:15.671 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:44:15.680 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:44:15.680 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/133) 2024-09-11T00:44:15.856 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:44:15.860 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:44:15.861 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:44:15.861 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:44:15.862 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:44:29.057 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T00:44:29.059 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T00:44:59.287 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T00:44:59.291 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T00:45:29.442 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T00:45:29.445 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T00:45:59.504 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T00:45:59.507 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T00:46:29.652 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T00:46:29.655 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T00:46:59.780 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T00:46:59.783 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T00:47:29.952 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T00:47:29.955 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T00:47:49.033 INFO:teuthology.orchestra.run.smithi092.stdout:generic/133 214s 2024-09-11T00:47:49.037 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/133 2024-09-11T00:47:49.037 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:47:49.040 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:47:49.086 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:47:49.086 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/134) 2024-09-11T00:47:49.531 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:47:49.535 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:47:49.535 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:47:49.536 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:47:49.537 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:47:49.829 INFO:teuthology.orchestra.run.smithi092.stdout:generic/134 [not run] Reflink not supported by test filesystem type: ceph 2024-09-11T00:47:49.834 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/134 2024-09-11T00:47:49.834 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/134 2024-09-11T00:47:49.834 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:47:49.836 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:47:49.904 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:47:49.904 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/135) 2024-09-11T00:47:50.295 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:47:50.299 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:47:50.299 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:47:50.300 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:47:50.301 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:47:51.076 INFO:teuthology.orchestra.run.smithi092.stdout:generic/135 1s 2024-09-11T00:47:51.083 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/135 2024-09-11T00:47:51.083 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:47:51.085 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:47:51.094 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:47:51.094 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/136) 2024-09-11T00:47:51.268 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:47:51.272 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:47:51.272 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:47:51.273 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:47:51.273 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:47:51.514 INFO:teuthology.orchestra.run.smithi092.stdout:generic/136 [not run] Dedupe not supported by test filesystem type: ceph 2024-09-11T00:47:51.519 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/136 2024-09-11T00:47:51.519 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/136 2024-09-11T00:47:51.519 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:47:51.521 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:47:51.578 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:47:51.579 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/137) 2024-09-11T00:47:51.966 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:47:51.970 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:47:51.970 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:47:51.971 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:47:51.971 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:47:52.208 INFO:teuthology.orchestra.run.smithi092.stdout:generic/137 [not run] Reflink not supported by test filesystem type: ceph 2024-09-11T00:47:52.213 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/137 2024-09-11T00:47:52.213 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/137 2024-09-11T00:47:52.213 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:47:52.215 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:47:52.265 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:47:52.265 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/138) 2024-09-11T00:47:52.680 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:47:52.683 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:47:52.684 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:47:52.685 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:47:52.685 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:47:52.926 INFO:teuthology.orchestra.run.smithi092.stdout:generic/138 [not run] Reflink not supported by test filesystem type: ceph 2024-09-11T00:47:52.931 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/138 2024-09-11T00:47:52.931 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/138 2024-09-11T00:47:52.931 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:47:52.933 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:47:52.993 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:47:52.993 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/139) 2024-09-11T00:47:53.405 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:47:53.409 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:47:53.409 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:47:53.410 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:47:53.410 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:47:53.649 INFO:teuthology.orchestra.run.smithi092.stdout:generic/139 [not run] Reflink not supported by test filesystem type: ceph 2024-09-11T00:47:53.654 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/139 2024-09-11T00:47:53.654 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/139 2024-09-11T00:47:53.654 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:47:53.657 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:47:53.706 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:47:53.706 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/140) 2024-09-11T00:47:54.101 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:47:54.105 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:47:54.106 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:47:54.107 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:47:54.107 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:47:54.342 INFO:teuthology.orchestra.run.smithi092.stdout:generic/140 [not run] Reflink not supported by test filesystem type: ceph 2024-09-11T00:47:54.348 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/140 2024-09-11T00:47:54.348 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/140 2024-09-11T00:47:54.348 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:47:54.349 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:47:54.415 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:47:54.416 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/141) 2024-09-11T00:47:54.804 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:47:54.808 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:47:54.809 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:47:54.810 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:47:54.810 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:47:55.129 INFO:teuthology.orchestra.run.smithi092.stdout:generic/141 1s 2024-09-11T00:47:55.135 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/141 2024-09-11T00:47:55.135 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:47:55.138 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:47:55.147 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:47:55.147 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/142) 2024-09-11T00:47:55.331 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:47:55.335 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:47:55.335 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:47:55.336 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:47:55.336 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:47:55.574 INFO:teuthology.orchestra.run.smithi092.stdout:generic/142 [not run] Reflink not supported by test filesystem type: ceph 2024-09-11T00:47:55.579 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/142 2024-09-11T00:47:55.579 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/142 2024-09-11T00:47:55.579 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:47:55.581 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:47:55.642 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:47:55.643 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/143) 2024-09-11T00:47:56.026 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:47:56.030 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:47:56.031 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:47:56.032 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:47:56.032 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:47:56.272 INFO:teuthology.orchestra.run.smithi092.stdout:generic/143 [not run] Reflink not supported by test filesystem type: ceph 2024-09-11T00:47:56.276 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/143 2024-09-11T00:47:56.276 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/143 2024-09-11T00:47:56.277 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:47:56.279 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:47:56.321 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:47:56.321 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/144) 2024-09-11T00:47:56.746 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:47:56.750 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:47:56.750 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:47:56.751 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:47:56.751 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:47:56.990 INFO:teuthology.orchestra.run.smithi092.stdout:generic/144 [not run] Reflink not supported by test filesystem type: ceph 2024-09-11T00:47:56.995 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/144 2024-09-11T00:47:56.996 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/144 2024-09-11T00:47:56.996 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:47:56.998 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:47:57.055 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:47:57.055 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/145) 2024-09-11T00:47:57.469 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:47:57.473 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:47:57.473 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:47:57.474 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:47:57.474 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:47:57.719 INFO:teuthology.orchestra.run.smithi092.stdout:generic/145 [not run] Reflink not supported by test filesystem type: ceph 2024-09-11T00:47:57.724 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/145 2024-09-11T00:47:57.724 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/145 2024-09-11T00:47:57.724 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:47:57.726 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:47:57.772 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:47:57.772 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/146) 2024-09-11T00:47:58.188 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:47:58.192 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:47:58.192 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:47:58.193 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:47:58.193 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:47:58.428 INFO:teuthology.orchestra.run.smithi092.stdout:generic/146 [not run] Reflink not supported by test filesystem type: ceph 2024-09-11T00:47:58.433 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/146 2024-09-11T00:47:58.433 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/146 2024-09-11T00:47:58.434 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:47:58.435 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:47:58.490 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:47:58.490 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/147) 2024-09-11T00:47:58.889 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:47:58.893 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:47:58.893 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:47:58.894 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:47:58.894 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:47:59.130 INFO:teuthology.orchestra.run.smithi092.stdout:generic/147 [not run] Reflink not supported by test filesystem type: ceph 2024-09-11T00:47:59.134 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/147 2024-09-11T00:47:59.135 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/147 2024-09-11T00:47:59.135 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:47:59.137 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:47:59.181 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:47:59.181 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/148) 2024-09-11T00:47:59.577 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:47:59.581 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:47:59.581 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:47:59.582 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:47:59.582 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:47:59.824 INFO:teuthology.orchestra.run.smithi092.stdout:generic/148 [not run] Reflink not supported by test filesystem type: ceph 2024-09-11T00:47:59.828 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/148 2024-09-11T00:47:59.828 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/148 2024-09-11T00:47:59.828 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:47:59.831 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:47:59.887 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:47:59.888 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/149) 2024-09-11T00:48:00.306 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:48:00.310 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:48:00.311 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:48:00.312 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:48:00.312 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:48:00.339 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T00:48:00.349 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T00:48:00.544 INFO:teuthology.orchestra.run.smithi092.stdout:generic/149 [not run] Reflink not supported by test filesystem type: ceph 2024-09-11T00:48:00.549 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/149 2024-09-11T00:48:00.549 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/149 2024-09-11T00:48:00.549 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:48:00.551 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:48:00.591 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:48:00.591 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/150) 2024-09-11T00:48:00.987 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:48:00.991 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:48:00.991 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:48:00.992 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:48:00.992 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:48:01.229 INFO:teuthology.orchestra.run.smithi092.stdout:generic/150 [not run] Reflink not supported by test filesystem type: ceph 2024-09-11T00:48:01.234 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/150 2024-09-11T00:48:01.234 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/150 2024-09-11T00:48:01.234 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:48:01.237 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:48:01.300 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:48:01.301 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/151) 2024-09-11T00:48:01.695 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:48:01.699 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:48:01.699 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:48:01.700 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:48:01.700 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:48:01.935 INFO:teuthology.orchestra.run.smithi092.stdout:generic/151 [not run] Reflink not supported by test filesystem type: ceph 2024-09-11T00:48:01.939 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/151 2024-09-11T00:48:01.940 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/151 2024-09-11T00:48:01.940 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:48:01.942 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:48:02.021 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:48:02.021 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/152) 2024-09-11T00:48:02.398 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:48:02.402 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:48:02.402 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:48:02.403 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:48:02.403 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:48:02.640 INFO:teuthology.orchestra.run.smithi092.stdout:generic/152 [not run] Reflink not supported by test filesystem type: ceph 2024-09-11T00:48:02.645 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/152 2024-09-11T00:48:02.645 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/152 2024-09-11T00:48:02.645 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:48:02.647 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:48:02.712 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:48:02.712 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/153) 2024-09-11T00:48:03.115 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:48:03.119 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:48:03.119 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:48:03.120 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:48:03.121 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:48:03.354 INFO:teuthology.orchestra.run.smithi092.stdout:generic/153 [not run] Reflink not supported by test filesystem type: ceph 2024-09-11T00:48:03.359 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/153 2024-09-11T00:48:03.359 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/153 2024-09-11T00:48:03.360 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:48:03.362 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:48:03.419 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:48:03.419 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/154) 2024-09-11T00:48:03.813 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:48:03.816 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:48:03.817 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:48:03.818 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:48:03.818 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:48:04.061 INFO:teuthology.orchestra.run.smithi092.stdout:generic/154 [not run] Reflink not supported by test filesystem type: ceph 2024-09-11T00:48:04.066 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/154 2024-09-11T00:48:04.066 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/154 2024-09-11T00:48:04.066 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:48:04.069 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:48:04.126 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:48:04.126 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/155) 2024-09-11T00:48:04.543 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:48:04.547 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:48:04.547 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:48:04.548 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:48:04.548 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:48:04.786 INFO:teuthology.orchestra.run.smithi092.stdout:generic/155 [not run] Reflink not supported by test filesystem type: ceph 2024-09-11T00:48:04.791 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/155 2024-09-11T00:48:04.791 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/155 2024-09-11T00:48:04.792 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:48:04.794 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:48:04.845 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:48:04.845 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/156) 2024-09-11T00:48:05.254 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:48:05.258 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:48:05.258 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:48:05.259 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:48:05.259 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:48:05.500 INFO:teuthology.orchestra.run.smithi092.stdout:generic/156 [not run] Reflink not supported by test filesystem type: ceph 2024-09-11T00:48:05.505 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/156 2024-09-11T00:48:05.505 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/156 2024-09-11T00:48:05.505 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:48:05.507 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:48:05.568 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:48:05.569 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/157) 2024-09-11T00:48:05.971 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:48:05.975 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:48:05.975 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:48:05.976 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:48:05.976 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:48:06.216 INFO:teuthology.orchestra.run.smithi092.stdout:generic/157 [not run] Reflink not supported by test filesystem type: ceph 2024-09-11T00:48:06.221 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/157 2024-09-11T00:48:06.221 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/157 2024-09-11T00:48:06.221 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:48:06.223 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:48:06.297 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:48:06.297 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/158) 2024-09-11T00:48:06.684 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:48:06.688 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:48:06.689 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:48:06.689 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:48:06.690 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:48:06.921 INFO:teuthology.orchestra.run.smithi092.stdout:generic/158 [not run] Dedupe not supported by test filesystem type: ceph 2024-09-11T00:48:06.926 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/158 2024-09-11T00:48:06.926 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/158 2024-09-11T00:48:06.926 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:48:06.929 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:48:06.977 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:48:06.977 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/159) 2024-09-11T00:48:07.404 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:48:07.408 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:48:07.408 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:48:07.409 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:48:07.409 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:48:07.650 INFO:teuthology.orchestra.run.smithi092.stdout:generic/159 [not run] file system doesn't support chattr +i 2024-09-11T00:48:07.655 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/159 2024-09-11T00:48:07.655 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/159 2024-09-11T00:48:07.655 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:48:07.657 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:48:07.683 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:48:07.684 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/160) 2024-09-11T00:48:07.857 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:48:07.861 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:48:07.861 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:48:07.862 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:48:07.862 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:48:08.099 INFO:teuthology.orchestra.run.smithi092.stdout:generic/160 [not run] file system doesn't support chattr +i 2024-09-11T00:48:08.103 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/160 2024-09-11T00:48:08.104 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/160 2024-09-11T00:48:08.104 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:48:08.106 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:48:08.123 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:48:08.123 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/161) 2024-09-11T00:48:08.304 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:48:08.307 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:48:08.308 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:48:08.309 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:48:08.309 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:48:08.661 INFO:teuthology.orchestra.run.smithi092.stdout:generic/161 [not run] Reflink not supported by scratch filesystem type: ceph 2024-09-11T00:48:08.672 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/161 2024-09-11T00:48:08.672 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/161 2024-09-11T00:48:08.672 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:48:08.676 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:48:08.983 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:48:08.983 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/162) 2024-09-11T00:48:09.164 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:48:09.168 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:48:09.168 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:48:09.169 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:48:09.169 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:48:09.483 INFO:teuthology.orchestra.run.smithi092.stdout:generic/162 [not run] Dedupe not supported by scratch filesystem type: ceph 2024-09-11T00:48:09.530 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/162 2024-09-11T00:48:09.531 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/162 2024-09-11T00:48:09.531 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:48:09.540 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:48:09.826 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:48:09.826 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/163) 2024-09-11T00:48:10.008 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:48:10.012 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:48:10.012 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:48:10.013 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:48:10.013 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:48:10.323 INFO:teuthology.orchestra.run.smithi092.stdout:generic/163 [not run] Dedupe not supported by scratch filesystem type: ceph 2024-09-11T00:48:10.413 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/163 2024-09-11T00:48:10.413 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/163 2024-09-11T00:48:10.413 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:48:10.416 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:48:10.602 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:48:10.602 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/164) 2024-09-11T00:48:10.834 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:48:10.838 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:48:10.838 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:48:10.839 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:48:10.839 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:48:11.196 INFO:teuthology.orchestra.run.smithi092.stdout:generic/164 [not run] Reflink not supported by scratch filesystem type: ceph 2024-09-11T00:48:11.207 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/164 2024-09-11T00:48:11.207 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/164 2024-09-11T00:48:11.207 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:48:11.210 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:48:11.485 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:48:11.485 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/165) 2024-09-11T00:48:11.662 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:48:11.667 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:48:11.667 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:48:11.668 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:48:11.668 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:48:12.031 INFO:teuthology.orchestra.run.smithi092.stdout:generic/165 [not run] Reflink not supported by scratch filesystem type: ceph 2024-09-11T00:48:12.041 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/165 2024-09-11T00:48:12.041 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/165 2024-09-11T00:48:12.041 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:48:12.051 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:48:12.306 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:48:12.307 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/166) 2024-09-11T00:48:12.491 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:48:12.495 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:48:12.495 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:48:12.496 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:48:12.496 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:48:12.859 INFO:teuthology.orchestra.run.smithi092.stdout:generic/166 [not run] Reflink not supported by scratch filesystem type: ceph 2024-09-11T00:48:12.870 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/166 2024-09-11T00:48:12.870 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/166 2024-09-11T00:48:12.871 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:48:12.876 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:48:13.137 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:48:13.137 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/167) 2024-09-11T00:48:13.318 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:48:13.322 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:48:13.322 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:48:13.323 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:48:13.323 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:48:13.680 INFO:teuthology.orchestra.run.smithi092.stdout:generic/167 [not run] Reflink not supported by scratch filesystem type: ceph 2024-09-11T00:48:13.694 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/167 2024-09-11T00:48:13.694 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/167 2024-09-11T00:48:13.694 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:48:13.696 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:48:13.944 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:48:13.944 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/168) 2024-09-11T00:48:14.139 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:48:14.143 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:48:14.144 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:48:14.145 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:48:14.145 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:48:14.514 INFO:teuthology.orchestra.run.smithi092.stdout:generic/168 [not run] Reflink not supported by scratch filesystem type: ceph 2024-09-11T00:48:14.524 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/168 2024-09-11T00:48:14.524 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/168 2024-09-11T00:48:14.524 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:48:14.529 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:48:14.772 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:48:14.773 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/169) 2024-09-11T00:48:14.958 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:48:14.962 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:48:14.963 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:48:14.963 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:48:14.964 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:48:15.388 INFO:teuthology.orchestra.run.smithi092.stdout:generic/169 0s 2024-09-11T00:48:15.394 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/169 2024-09-11T00:48:15.394 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:48:15.397 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:48:15.405 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:48:15.405 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/170) 2024-09-11T00:48:15.580 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:48:15.584 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:48:15.584 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:48:15.585 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:48:15.585 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:48:15.952 INFO:teuthology.orchestra.run.smithi092.stdout:generic/170 [not run] Reflink not supported by scratch filesystem type: ceph 2024-09-11T00:48:15.972 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/170 2024-09-11T00:48:15.973 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/170 2024-09-11T00:48:15.973 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:48:15.980 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:48:16.262 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:48:16.262 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/171) 2024-09-11T00:48:16.443 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:48:16.447 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:48:16.447 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:48:16.448 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:48:16.448 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:48:16.823 INFO:teuthology.orchestra.run.smithi092.stdout:generic/171 [not run] Reflink not supported by scratch filesystem type: ceph 2024-09-11T00:48:16.829 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/171 2024-09-11T00:48:16.830 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/171 2024-09-11T00:48:16.830 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:48:16.835 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:48:17.143 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:48:17.143 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/172) 2024-09-11T00:48:17.329 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:48:17.333 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:48:17.334 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:48:17.334 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:48:17.335 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:48:17.702 INFO:teuthology.orchestra.run.smithi092.stdout:generic/172 [not run] Reflink not supported by scratch filesystem type: ceph 2024-09-11T00:48:17.718 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/172 2024-09-11T00:48:17.718 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/172 2024-09-11T00:48:17.718 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:48:17.720 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:48:17.958 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:48:17.958 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/173) 2024-09-11T00:48:18.152 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:48:18.156 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:48:18.156 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:48:18.157 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:48:18.157 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:48:18.532 INFO:teuthology.orchestra.run.smithi092.stdout:generic/173 [not run] Reflink not supported by scratch filesystem type: ceph 2024-09-11T00:48:18.538 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/173 2024-09-11T00:48:18.538 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/173 2024-09-11T00:48:18.538 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:48:18.541 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:48:18.823 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:48:18.824 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/174) 2024-09-11T00:48:19.015 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:48:19.019 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:48:19.019 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:48:19.020 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:48:19.020 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:48:19.372 INFO:teuthology.orchestra.run.smithi092.stdout:generic/174 [not run] Reflink not supported by scratch filesystem type: ceph 2024-09-11T00:48:19.390 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/174 2024-09-11T00:48:19.390 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/174 2024-09-11T00:48:19.390 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:48:19.394 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:48:19.691 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:48:19.691 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/175) 2024-09-11T00:48:19.869 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:48:19.873 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:48:19.873 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:48:19.874 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:48:19.874 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:48:20.223 INFO:teuthology.orchestra.run.smithi092.stdout:generic/175 [not run] Reflink not supported by scratch filesystem type: ceph 2024-09-11T00:48:20.236 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/175 2024-09-11T00:48:20.236 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/175 2024-09-11T00:48:20.236 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:48:20.243 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:48:20.533 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:48:20.534 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/176) 2024-09-11T00:48:20.708 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:48:20.712 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:48:20.712 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:48:20.713 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:48:20.713 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:48:21.076 INFO:teuthology.orchestra.run.smithi092.stdout:generic/176 [not run] Reflink not supported by scratch filesystem type: ceph 2024-09-11T00:48:21.092 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/176 2024-09-11T00:48:21.092 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/176 2024-09-11T00:48:21.092 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:48:21.098 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:48:21.324 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:48:21.324 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/177) 2024-09-11T00:48:21.526 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:48:21.530 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:48:21.530 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:48:21.531 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:48:21.531 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:48:21.886 INFO:teuthology.orchestra.run.smithi092.stdout:generic/177 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2024-09-11T00:48:21.891 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/177 2024-09-11T00:48:21.891 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/177 2024-09-11T00:48:21.891 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:48:21.894 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:48:21.953 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:48:21.953 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/178) 2024-09-11T00:48:22.372 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:48:22.376 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:48:22.376 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:48:22.377 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:48:22.377 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:48:22.617 INFO:teuthology.orchestra.run.smithi092.stdout:generic/178 [not run] Reflink not supported by test filesystem type: ceph 2024-09-11T00:48:22.621 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/178 2024-09-11T00:48:22.621 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/178 2024-09-11T00:48:22.622 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:48:22.624 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:48:22.681 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:48:22.682 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/179) 2024-09-11T00:48:23.079 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:48:23.083 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:48:23.083 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:48:23.084 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:48:23.084 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:48:23.322 INFO:teuthology.orchestra.run.smithi092.stdout:generic/179 [not run] Reflink not supported by test filesystem type: ceph 2024-09-11T00:48:23.327 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/179 2024-09-11T00:48:23.327 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/179 2024-09-11T00:48:23.327 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:48:23.329 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:48:23.400 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:48:23.401 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/180) 2024-09-11T00:48:23.778 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:48:23.786 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:48:23.786 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:48:23.786 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:48:23.786 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:48:24.018 INFO:teuthology.orchestra.run.smithi092.stdout:generic/180 [not run] Reflink not supported by test filesystem type: ceph 2024-09-11T00:48:24.023 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/180 2024-09-11T00:48:24.023 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/180 2024-09-11T00:48:24.023 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:48:24.026 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:48:24.091 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:48:24.091 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/181) 2024-09-11T00:48:24.492 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:48:24.496 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:48:24.496 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:48:24.497 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:48:24.498 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:48:24.737 INFO:teuthology.orchestra.run.smithi092.stdout:generic/181 [not run] Reflink not supported by test filesystem type: ceph 2024-09-11T00:48:24.742 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/181 2024-09-11T00:48:24.742 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/181 2024-09-11T00:48:24.742 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:48:24.745 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:48:24.798 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:48:24.798 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/182) 2024-09-11T00:48:25.193 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:48:25.197 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:48:25.198 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:48:25.199 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:48:25.199 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:48:25.434 INFO:teuthology.orchestra.run.smithi092.stdout:generic/182 [not run] Dedupe not supported by test filesystem type: ceph 2024-09-11T00:48:25.439 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/182 2024-09-11T00:48:25.439 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/182 2024-09-11T00:48:25.439 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:48:25.441 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:48:25.504 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:48:25.504 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/183) 2024-09-11T00:48:25.897 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:48:25.901 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:48:25.901 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:48:25.902 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:48:25.902 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:48:26.266 INFO:teuthology.orchestra.run.smithi092.stdout:generic/183 [not run] Reflink not supported by scratch filesystem type: ceph 2024-09-11T00:48:26.276 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/183 2024-09-11T00:48:26.276 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/183 2024-09-11T00:48:26.276 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:48:26.281 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:48:26.564 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:48:26.565 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/184) 2024-09-11T00:48:26.741 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:48:26.745 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:48:26.746 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:48:26.747 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:48:26.747 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:48:26.995 INFO:teuthology.orchestra.run.smithi092.stdout:generic/184 0s 2024-09-11T00:48:27.001 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/184 2024-09-11T00:48:27.001 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:48:27.004 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:48:27.019 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:48:27.019 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/185) 2024-09-11T00:48:27.204 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:48:27.208 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:48:27.209 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:48:27.210 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:48:27.210 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:48:27.553 INFO:teuthology.orchestra.run.smithi092.stdout:generic/185 [not run] Reflink not supported by scratch filesystem type: ceph 2024-09-11T00:48:27.566 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/185 2024-09-11T00:48:27.566 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/185 2024-09-11T00:48:27.566 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:48:27.568 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:48:27.847 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:48:27.847 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/186) 2024-09-11T00:48:28.026 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:48:28.030 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:48:28.030 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:48:28.031 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:48:28.031 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:48:28.404 INFO:teuthology.orchestra.run.smithi092.stdout:generic/186 [not run] Reflink not supported by scratch filesystem type: ceph 2024-09-11T00:48:28.413 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/186 2024-09-11T00:48:28.413 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/186 2024-09-11T00:48:28.413 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:48:28.417 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:48:28.713 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:48:28.713 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/187) 2024-09-11T00:48:28.884 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:48:28.888 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:48:28.888 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:48:28.889 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:48:28.889 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:48:29.261 INFO:teuthology.orchestra.run.smithi092.stdout:generic/187 [not run] Reflink not supported by scratch filesystem type: ceph 2024-09-11T00:48:29.279 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/187 2024-09-11T00:48:29.280 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/187 2024-09-11T00:48:29.280 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:48:29.282 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:48:29.502 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:48:29.502 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/188) 2024-09-11T00:48:29.704 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:48:29.708 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:48:29.709 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:48:29.710 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:48:29.710 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:48:30.079 INFO:teuthology.orchestra.run.smithi092.stdout:generic/188 [not run] Reflink not supported by scratch filesystem type: ceph 2024-09-11T00:48:30.091 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/188 2024-09-11T00:48:30.091 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/188 2024-09-11T00:48:30.091 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:48:30.093 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:48:30.352 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:48:30.353 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/189) 2024-09-11T00:48:30.531 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:48:30.535 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:48:30.535 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:48:30.536 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:48:30.536 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:48:30.679 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T00:48:30.682 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T00:48:30.894 INFO:teuthology.orchestra.run.smithi092.stdout:generic/189 [not run] Reflink not supported by scratch filesystem type: ceph 2024-09-11T00:48:30.906 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/189 2024-09-11T00:48:30.906 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/189 2024-09-11T00:48:30.906 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:48:30.914 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:48:31.230 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:48:31.230 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/190) 2024-09-11T00:48:31.407 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:48:31.411 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:48:31.411 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:48:31.412 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:48:31.412 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:48:31.758 INFO:teuthology.orchestra.run.smithi092.stdout:generic/190 [not run] Reflink not supported by scratch filesystem type: ceph 2024-09-11T00:48:31.768 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/190 2024-09-11T00:48:31.769 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/190 2024-09-11T00:48:31.769 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:48:31.777 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:48:32.018 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:48:32.018 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/191) 2024-09-11T00:48:32.213 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:48:32.217 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:48:32.217 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:48:32.218 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:48:32.218 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:48:32.563 INFO:teuthology.orchestra.run.smithi092.stdout:generic/191 [not run] Reflink not supported by scratch filesystem type: ceph 2024-09-11T00:48:32.572 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/191 2024-09-11T00:48:32.573 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/191 2024-09-11T00:48:32.573 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:48:32.578 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:48:32.846 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:48:32.846 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/192) 2024-09-11T00:48:33.030 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:48:33.034 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:48:33.034 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:48:33.035 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:48:33.035 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:48:33.251 INFO:teuthology.orchestra.run.smithi092.stdout:generic/192 [not run] atime not maintained by ceph 2024-09-11T00:48:33.256 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/192 2024-09-11T00:48:33.256 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/192 2024-09-11T00:48:33.256 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:48:33.258 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:48:33.273 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:48:33.273 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/193) 2024-09-11T00:48:33.458 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:48:33.462 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:48:33.462 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:48:33.463 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:48:33.463 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:48:34.353 INFO:teuthology.orchestra.run.smithi092.stdout:generic/193 1s 2024-09-11T00:48:34.360 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/193 2024-09-11T00:48:34.360 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:48:34.362 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:48:34.419 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:48:34.419 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/194) 2024-09-11T00:48:34.807 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:48:34.811 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:48:34.811 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:48:34.812 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:48:34.812 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:48:35.168 INFO:teuthology.orchestra.run.smithi092.stdout:generic/194 [not run] Reflink not supported by scratch filesystem type: ceph 2024-09-11T00:48:35.182 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/194 2024-09-11T00:48:35.182 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/194 2024-09-11T00:48:35.182 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:48:35.187 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:48:35.450 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:48:35.451 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/195) 2024-09-11T00:48:35.633 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:48:35.637 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:48:35.637 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:48:35.638 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:48:35.638 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:48:35.992 INFO:teuthology.orchestra.run.smithi092.stdout:generic/195 [not run] Reflink not supported by scratch filesystem type: ceph 2024-09-11T00:48:36.001 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/195 2024-09-11T00:48:36.001 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/195 2024-09-11T00:48:36.001 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:48:36.005 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:48:36.303 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:48:36.303 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/196) 2024-09-11T00:48:36.481 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:48:36.482 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:48:36.483 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:48:36.483 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:48:36.483 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:48:36.863 INFO:teuthology.orchestra.run.smithi092.stdout:generic/196 [not run] Reflink not supported by scratch filesystem type: ceph 2024-09-11T00:48:36.871 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/196 2024-09-11T00:48:36.871 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/196 2024-09-11T00:48:36.871 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:48:36.875 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:48:37.138 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:48:37.138 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/197) 2024-09-11T00:48:37.317 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:48:37.321 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:48:37.322 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:48:37.323 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:48:37.323 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:48:37.691 INFO:teuthology.orchestra.run.smithi092.stdout:generic/197 [not run] Reflink not supported by scratch filesystem type: ceph 2024-09-11T00:48:37.699 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/197 2024-09-11T00:48:37.699 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/197 2024-09-11T00:48:37.700 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:48:37.703 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:48:37.917 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:48:37.917 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/198) 2024-09-11T00:48:38.119 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:48:38.123 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:48:38.123 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:48:38.124 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:48:38.125 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:48:38.757 INFO:teuthology.orchestra.run.smithi092.stdout:generic/198 0s 2024-09-11T00:48:38.763 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/198 2024-09-11T00:48:38.763 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:48:38.766 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:48:38.821 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:48:38.822 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/199) 2024-09-11T00:48:39.242 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:48:39.249 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:48:39.249 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:48:39.251 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:48:39.251 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:48:39.621 INFO:teuthology.orchestra.run.smithi092.stdout:generic/199 [not run] Reflink not supported by scratch filesystem type: ceph 2024-09-11T00:48:39.630 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/199 2024-09-11T00:48:39.630 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/199 2024-09-11T00:48:39.631 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:48:39.635 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:48:39.894 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:48:39.894 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/200) 2024-09-11T00:48:40.087 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:48:40.091 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:48:40.091 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:48:40.092 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:48:40.092 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:48:40.443 INFO:teuthology.orchestra.run.smithi092.stdout:generic/200 [not run] Reflink not supported by scratch filesystem type: ceph 2024-09-11T00:48:40.454 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/200 2024-09-11T00:48:40.454 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/200 2024-09-11T00:48:40.454 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:48:40.465 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:48:40.715 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:48:40.716 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/201) 2024-09-11T00:48:40.908 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:48:40.911 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:48:40.912 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:48:40.913 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:48:40.913 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:48:41.272 INFO:teuthology.orchestra.run.smithi092.stdout:generic/201 [not run] Reflink not supported by scratch filesystem type: ceph 2024-09-11T00:48:41.282 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/201 2024-09-11T00:48:41.282 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/201 2024-09-11T00:48:41.282 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:48:41.287 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:48:41.537 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:48:41.537 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/202) 2024-09-11T00:48:41.723 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:48:41.727 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:48:41.727 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:48:41.728 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:48:41.728 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:48:42.094 INFO:teuthology.orchestra.run.smithi092.stdout:generic/202 [not run] Reflink not supported by scratch filesystem type: ceph 2024-09-11T00:48:42.107 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/202 2024-09-11T00:48:42.107 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/202 2024-09-11T00:48:42.107 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:48:42.119 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:48:42.340 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:48:42.341 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/203) 2024-09-11T00:48:42.536 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:48:42.540 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:48:42.540 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:48:42.541 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:48:42.541 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:48:42.910 INFO:teuthology.orchestra.run.smithi092.stdout:generic/203 [not run] Reflink not supported by scratch filesystem type: ceph 2024-09-11T00:48:42.918 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/203 2024-09-11T00:48:42.919 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/203 2024-09-11T00:48:42.919 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:48:42.921 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:48:43.109 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:48:43.110 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/204) 2024-09-11T00:48:43.332 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:48:43.336 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:48:43.336 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:48:43.337 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:48:43.337 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:48:44.843 INFO:teuthology.orchestra.run.smithi092.stdout:generic/204 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2024-09-11T00:48:44.849 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/204 2024-09-11T00:48:44.849 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/204 2024-09-11T00:48:44.849 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:48:44.852 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:48:44.871 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:48:44.872 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/205) 2024-09-11T00:48:45.077 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:48:45.081 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:48:45.081 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:48:45.082 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:48:45.082 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:48:45.447 INFO:teuthology.orchestra.run.smithi092.stdout:generic/205 [not run] Reflink not supported by scratch filesystem type: ceph 2024-09-11T00:48:45.455 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/205 2024-09-11T00:48:45.455 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/205 2024-09-11T00:48:45.455 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:48:45.458 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:48:45.711 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:48:45.711 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/206) 2024-09-11T00:48:45.895 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:48:45.899 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:48:45.900 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:48:45.900 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:48:45.901 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:48:46.246 INFO:teuthology.orchestra.run.smithi092.stdout:generic/206 [not run] Reflink not supported by scratch filesystem type: ceph 2024-09-11T00:48:46.254 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/206 2024-09-11T00:48:46.255 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/206 2024-09-11T00:48:46.255 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:48:46.260 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:48:46.539 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:48:46.540 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/207) 2024-09-11T00:48:46.720 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:48:46.724 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:48:46.724 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:48:46.725 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:48:46.725 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:48:52.981 INFO:teuthology.orchestra.run.smithi092.stdout:generic/207 6s 2024-09-11T00:48:52.988 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/207 2024-09-11T00:48:52.988 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:48:52.990 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:48:53.039 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:48:53.039 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/208) 2024-09-11T00:48:53.444 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:48:53.447 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:48:53.448 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:48:53.449 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:48:53.449 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:49:01.105 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T00:49:01.108 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T00:49:31.378 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T00:49:31.382 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T00:50:01.626 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T00:50:01.629 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T00:50:01.681 INFO:tasks.ceph.osd.6.smithi145.stderr:2024-09-11T00:50:01.679+0000 7f12741b6640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 47257) UID: 0 2024-09-11T00:50:01.681 INFO:tasks.ceph.osd.5.smithi145.stderr:2024-09-11T00:50:01.679+0000 7f3a08302640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 47257) UID: 0 2024-09-11T00:50:01.682 INFO:tasks.ceph.osd.7.smithi145.stderr:2024-09-11T00:50:01.679+0000 7f246f6c7640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 47257) UID: 0 2024-09-11T00:50:01.682 INFO:tasks.ceph.osd.4.smithi145.stderr:2024-09-11T00:50:01.680+0000 7f87e7126640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 47257) UID: 0 2024-09-11T00:52:13.785 INFO:teuthology.orchestra.run.smithi092.stdout:generic/208 200s 2024-09-11T00:52:13.790 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/208 2024-09-11T00:52:13.790 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:52:13.792 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:52:13.845 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:52:13.846 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/209) 2024-09-11T00:52:14.222 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:52:14.226 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:52:14.226 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:52:14.227 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:52:14.227 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:52:47.458 INFO:teuthology.orchestra.run.smithi092.stdout:generic/209 33s 2024-09-11T00:52:47.464 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/209 2024-09-11T00:52:47.464 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:52:47.467 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:52:47.514 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:52:47.514 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/210) 2024-09-11T00:52:47.928 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:52:47.932 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:52:47.932 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:52:47.933 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:52:47.934 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:52:48.237 INFO:teuthology.orchestra.run.smithi092.stdout:generic/210 0s 2024-09-11T00:52:48.243 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/210 2024-09-11T00:52:48.243 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:52:48.246 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:52:48.300 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:52:48.301 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/211) 2024-09-11T00:52:48.696 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:52:48.700 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:52:48.701 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:52:48.702 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:52:48.702 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:52:49.126 INFO:teuthology.orchestra.run.smithi092.stdout:generic/211 1s 2024-09-11T00:52:49.132 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/211 2024-09-11T00:52:49.132 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:52:49.134 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:52:49.152 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:52:49.152 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/212) 2024-09-11T00:52:49.331 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:52:49.335 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:52:49.335 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:52:49.336 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:52:49.336 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:52:49.634 INFO:teuthology.orchestra.run.smithi092.stdout:generic/212 0s 2024-09-11T00:52:49.640 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/212 2024-09-11T00:52:49.640 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:52:49.643 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:52:49.660 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:52:49.661 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/213) 2024-09-11T00:52:49.845 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:52:49.849 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:52:49.849 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:52:49.850 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:52:49.850 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:52:50.074 INFO:teuthology.orchestra.run.smithi092.stdout:generic/213 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-09-11T00:52:50.079 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/213 2024-09-11T00:52:50.079 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/213 2024-09-11T00:52:50.079 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:52:50.082 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:52:50.094 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:52:50.095 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/214) 2024-09-11T00:52:50.276 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:52:50.280 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:52:50.280 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:52:50.281 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:52:50.281 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:52:50.508 INFO:teuthology.orchestra.run.smithi092.stdout:generic/214 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-09-11T00:52:50.513 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/214 2024-09-11T00:52:50.513 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/214 2024-09-11T00:52:50.513 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:52:50.515 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:52:50.528 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:52:50.529 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/215) 2024-09-11T00:52:50.702 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:52:50.707 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:52:50.707 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:52:50.708 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:52:50.708 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:52:52.977 INFO:teuthology.orchestra.run.smithi092.stdout:generic/215 2s 2024-09-11T00:52:52.985 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/215 2024-09-11T00:52:52.985 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:52:52.988 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:52:53.022 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:52:53.022 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/216) 2024-09-11T00:52:53.204 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:52:53.208 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:52:53.208 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:52:53.209 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:52:53.209 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:52:53.553 INFO:teuthology.orchestra.run.smithi092.stdout:generic/216 [not run] Reflink not supported by scratch filesystem type: ceph 2024-09-11T00:52:53.563 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/216 2024-09-11T00:52:53.563 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/216 2024-09-11T00:52:53.563 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:52:53.575 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:52:53.883 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:52:53.884 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/217) 2024-09-11T00:52:54.063 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:52:54.067 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:52:54.067 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:52:54.068 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:52:54.068 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:52:54.439 INFO:teuthology.orchestra.run.smithi092.stdout:generic/217 [not run] Reflink not supported by scratch filesystem type: ceph 2024-09-11T00:52:54.446 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/217 2024-09-11T00:52:54.446 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/217 2024-09-11T00:52:54.446 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:52:54.454 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:52:54.749 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:52:54.750 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/218) 2024-09-11T00:52:54.926 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:52:54.930 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:52:54.930 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:52:54.931 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:52:54.931 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:52:55.308 INFO:teuthology.orchestra.run.smithi092.stdout:generic/218 [not run] Reflink not supported by scratch filesystem type: ceph 2024-09-11T00:52:55.315 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/218 2024-09-11T00:52:55.315 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/218 2024-09-11T00:52:55.315 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:52:55.320 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:52:55.614 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:52:55.614 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/219) 2024-09-11T00:52:55.810 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:52:55.814 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:52:55.814 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:52:55.815 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:52:55.815 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:52:56.027 INFO:teuthology.orchestra.run.smithi092.stdout:generic/219 [not run] disk quotas not supported by this filesystem type: ceph 2024-09-11T00:52:56.032 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/219 2024-09-11T00:52:56.032 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/219 2024-09-11T00:52:56.032 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:52:56.034 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:52:56.047 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:52:56.048 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/220) 2024-09-11T00:52:56.220 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:52:56.224 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:52:56.224 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:52:56.225 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:52:56.225 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:52:56.575 INFO:teuthology.orchestra.run.smithi092.stdout:generic/220 [not run] Reflink not supported by scratch filesystem type: ceph 2024-09-11T00:52:56.582 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/220 2024-09-11T00:52:56.582 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/220 2024-09-11T00:52:56.583 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:52:56.589 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:52:56.888 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:52:56.888 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/221) 2024-09-11T00:52:57.070 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:52:57.074 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:52:57.074 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:52:57.075 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:52:57.075 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:52:58.311 INFO:teuthology.orchestra.run.smithi092.stdout:generic/221 1s 2024-09-11T00:52:58.343 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/221 2024-09-11T00:52:58.343 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:52:58.345 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:52:58.367 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:52:58.367 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/222) 2024-09-11T00:52:58.552 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:52:58.556 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:52:58.556 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:52:58.557 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:52:58.557 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:52:58.909 INFO:teuthology.orchestra.run.smithi092.stdout:generic/222 [not run] Reflink not supported by scratch filesystem type: ceph 2024-09-11T00:52:58.921 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/222 2024-09-11T00:52:58.921 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/222 2024-09-11T00:52:58.921 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:52:58.928 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:52:59.156 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:52:59.157 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/223) 2024-09-11T00:52:59.356 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:52:59.360 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:52:59.360 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:52:59.361 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:52:59.361 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:52:59.583 INFO:teuthology.orchestra.run.smithi092.stdout:generic/223 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-09-11T00:52:59.588 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/223 2024-09-11T00:52:59.588 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/223 2024-09-11T00:52:59.589 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:52:59.591 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:52:59.606 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:52:59.607 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/224) 2024-09-11T00:52:59.787 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:52:59.791 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:52:59.791 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:52:59.792 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:52:59.792 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:52:59.997 INFO:teuthology.orchestra.run.smithi092.stdout:generic/224 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2024-09-11T00:53:00.001 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/224 2024-09-11T00:53:00.001 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/224 2024-09-11T00:53:00.001 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:53:00.004 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:53:00.017 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:53:00.017 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/225) 2024-09-11T00:53:00.196 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:53:00.200 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:53:00.200 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:53:00.201 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:53:00.201 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:53:00.450 INFO:teuthology.orchestra.run.smithi092.stdout:generic/225 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2024-09-11T00:53:00.455 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/225 2024-09-11T00:53:00.455 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/225 2024-09-11T00:53:00.455 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:53:00.457 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:53:00.519 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:53:00.520 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/226) 2024-09-11T00:53:00.890 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:53:00.894 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:53:00.894 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:53:00.895 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:53:00.895 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:53:01.135 INFO:teuthology.orchestra.run.smithi092.stdout:generic/226 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2024-09-11T00:53:01.140 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/226 2024-09-11T00:53:01.140 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/226 2024-09-11T00:53:01.140 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:53:01.142 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:53:01.158 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:53:01.159 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/227) 2024-09-11T00:53:01.343 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:53:01.347 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:53:01.347 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:53:01.348 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:53:01.348 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:53:01.691 INFO:teuthology.orchestra.run.smithi092.stdout:generic/227 [not run] Reflink not supported by scratch filesystem type: ceph 2024-09-11T00:53:01.699 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/227 2024-09-11T00:53:01.699 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/227 2024-09-11T00:53:01.699 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:53:01.701 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:53:01.888 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:53:01.889 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/228) 2024-09-11T00:53:02.122 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:53:02.126 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:53:02.126 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:53:02.127 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:53:02.127 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:53:02.376 INFO:teuthology.orchestra.run.smithi092.stdout:generic/228 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-09-11T00:53:02.381 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/228 2024-09-11T00:53:02.381 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/228 2024-09-11T00:53:02.381 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:53:02.383 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:53:02.396 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:53:02.396 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/229) 2024-09-11T00:53:02.579 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:53:02.583 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:53:02.583 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:53:02.584 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:53:02.584 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:53:02.927 INFO:teuthology.orchestra.run.smithi092.stdout:generic/229 [not run] Reflink not supported by scratch filesystem type: ceph 2024-09-11T00:53:02.938 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/229 2024-09-11T00:53:02.938 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/229 2024-09-11T00:53:02.938 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:53:02.947 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:53:03.197 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:53:03.198 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/230) 2024-09-11T00:53:03.383 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:53:03.387 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:53:03.387 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:53:03.388 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:53:03.388 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:53:03.604 INFO:teuthology.orchestra.run.smithi092.stdout:generic/230 [not run] disk quotas not supported by this filesystem type: ceph 2024-09-11T00:53:03.609 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/230 2024-09-11T00:53:03.609 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/230 2024-09-11T00:53:03.609 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:53:03.612 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:53:03.624 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:53:03.624 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/231) 2024-09-11T00:53:03.808 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:53:03.812 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:53:03.812 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:53:03.813 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:53:03.813 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:53:04.026 INFO:teuthology.orchestra.run.smithi092.stdout:generic/231 [not run] disk quotas not supported by this filesystem type: ceph 2024-09-11T00:53:04.032 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/231 2024-09-11T00:53:04.032 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/231 2024-09-11T00:53:04.032 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:53:04.034 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:53:04.067 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:53:04.067 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/232) 2024-09-11T00:53:04.253 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:53:04.257 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:53:04.257 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:53:04.258 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:53:04.258 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:53:04.472 INFO:teuthology.orchestra.run.smithi092.stdout:generic/232 [not run] disk quotas not supported by this filesystem type: ceph 2024-09-11T00:53:04.477 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/232 2024-09-11T00:53:04.477 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/232 2024-09-11T00:53:04.478 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:53:04.479 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:53:04.492 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:53:04.492 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/233) 2024-09-11T00:53:04.674 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:53:04.678 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:53:04.678 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:53:04.679 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:53:04.679 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:53:04.885 INFO:teuthology.orchestra.run.smithi092.stdout:generic/233 [not run] disk quotas not supported by this filesystem type: ceph 2024-09-11T00:53:04.890 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/233 2024-09-11T00:53:04.890 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/233 2024-09-11T00:53:04.890 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:53:04.892 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:53:04.904 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:53:04.905 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/234) 2024-09-11T00:53:05.086 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:53:05.090 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:53:05.091 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:53:05.091 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:53:05.092 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:53:05.308 INFO:teuthology.orchestra.run.smithi092.stdout:generic/234 [not run] disk quotas not supported by this filesystem type: ceph 2024-09-11T00:53:05.312 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/234 2024-09-11T00:53:05.313 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/234 2024-09-11T00:53:05.313 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:53:05.315 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:53:05.329 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:53:05.329 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/235) 2024-09-11T00:53:05.508 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:53:05.512 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:53:05.512 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:53:05.513 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:53:05.513 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:53:05.713 INFO:teuthology.orchestra.run.smithi092.stdout:generic/235 [not run] disk quotas not supported by this filesystem type: ceph 2024-09-11T00:53:05.718 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/235 2024-09-11T00:53:05.718 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/235 2024-09-11T00:53:05.718 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:53:05.721 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:53:05.747 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:53:05.748 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/236) 2024-09-11T00:53:05.927 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:53:05.931 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:53:05.931 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:53:05.932 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:53:05.932 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:53:07.215 INFO:teuthology.orchestra.run.smithi092.stdout:generic/236 1s 2024-09-11T00:53:07.221 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/236 2024-09-11T00:53:07.221 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:53:07.224 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:53:07.285 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:53:07.285 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/237) 2024-09-11T00:53:07.676 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:53:07.680 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:53:07.680 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:53:07.681 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:53:07.681 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:53:07.971 INFO:teuthology.orchestra.run.smithi092.stdout:generic/237 0s 2024-09-11T00:53:07.977 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/237 2024-09-11T00:53:07.977 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:53:07.979 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:53:08.033 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:53:08.034 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/238) 2024-09-11T00:53:08.428 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:53:08.432 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:53:08.432 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:53:08.433 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:53:08.433 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:53:08.799 INFO:teuthology.orchestra.run.smithi092.stdout:generic/238 [not run] Reflink not supported by scratch filesystem type: ceph 2024-09-11T00:53:08.808 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/238 2024-09-11T00:53:08.808 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/238 2024-09-11T00:53:08.808 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:53:08.812 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:53:09.057 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:53:09.057 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/239) 2024-09-11T00:53:09.245 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:53:09.249 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:53:09.250 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:53:09.251 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:53:09.251 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:53:09.483 INFO:teuthology.orchestra.run.smithi092.stdout:generic/239 [not run] Sparse files are not supported or do not work as expected 2024-09-11T00:53:09.488 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/239 2024-09-11T00:53:09.488 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/239 2024-09-11T00:53:09.488 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:53:09.490 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:53:09.512 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:53:09.512 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/240) 2024-09-11T00:53:09.695 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:53:09.699 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:53:09.699 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:53:09.700 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:53:09.700 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:53:09.931 INFO:teuthology.orchestra.run.smithi092.stdout:generic/240 [not run] Sparse files are not supported or do not work as expected 2024-09-11T00:53:09.936 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/240 2024-09-11T00:53:09.936 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/240 2024-09-11T00:53:09.936 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:53:09.938 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:53:09.960 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:53:09.961 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/241) 2024-09-11T00:53:10.143 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:53:10.147 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:53:10.147 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:53:10.148 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:53:10.148 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:53:25.691 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T00:53:25.693 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T00:53:25.723 INFO:tasks.ceph.osd.5.smithi145.stderr:2024-09-11T00:53:25.722+0000 7f3a08302640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 47326) UID: 0 2024-09-11T00:53:25.724 INFO:tasks.ceph.osd.6.smithi145.stderr:2024-09-11T00:53:25.722+0000 7f12741b6640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 47326) UID: 0 2024-09-11T00:53:25.724 INFO:tasks.ceph.osd.7.smithi145.stderr:2024-09-11T00:53:25.722+0000 7f246f6c7640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 47326) UID: 0 2024-09-11T00:53:25.724 INFO:tasks.ceph.osd.4.smithi145.stderr:2024-09-11T00:53:25.722+0000 7f87e7126640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 47326) UID: 0 2024-09-11T00:53:25.725 INFO:tasks.ceph.osd.2.smithi092.stderr:2024-09-11T00:53:25.722+0000 7f645a187640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 259287) UID: 0 2024-09-11T00:53:25.725 INFO:tasks.ceph.osd.0.smithi092.stderr:2024-09-11T00:53:25.722+0000 7f828912d640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 259287) UID: 0 2024-09-11T00:53:25.725 INFO:tasks.ceph.osd.1.smithi092.stderr:2024-09-11T00:53:25.722+0000 7f1c30424640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 259287) UID: 0 2024-09-11T00:53:25.726 INFO:tasks.ceph.osd.3.smithi092.stderr:2024-09-11T00:53:25.722+0000 7fc700ebf640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 259287) UID: 0 2024-09-11T00:54:23.206 INFO:teuthology.orchestra.run.smithi092.stdout:generic/241 73s 2024-09-11T00:54:23.212 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/241 2024-09-11T00:54:23.212 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:54:23.215 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:54:23.926 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:54:23.927 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/242) 2024-09-11T00:54:24.334 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:54:24.337 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:54:24.338 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:54:24.339 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:54:24.339 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:54:24.928 INFO:teuthology.orchestra.run.smithi092.stdout:generic/242 [not run] Reflink not supported by scratch filesystem type: ceph 2024-09-11T00:54:24.943 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/242 2024-09-11T00:54:24.943 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/242 2024-09-11T00:54:24.943 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:54:24.955 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:54:25.299 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:54:25.300 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/243) 2024-09-11T00:54:25.643 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:54:25.649 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:54:25.651 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:54:25.652 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:54:25.652 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:54:26.100 INFO:teuthology.orchestra.run.smithi092.stdout:generic/243 [not run] Reflink not supported by scratch filesystem type: ceph 2024-09-11T00:54:26.108 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/243 2024-09-11T00:54:26.108 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/243 2024-09-11T00:54:26.109 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:54:26.119 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:54:26.395 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:54:26.395 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/244) 2024-09-11T00:54:26.602 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:54:26.606 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:54:26.607 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:54:26.608 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:54:26.608 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:54:26.813 INFO:teuthology.orchestra.run.smithi092.stdout:generic/244 [not run] disk quotas not supported by this filesystem type: ceph 2024-09-11T00:54:26.818 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/244 2024-09-11T00:54:26.818 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/244 2024-09-11T00:54:26.818 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:54:26.821 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:54:26.835 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:54:26.835 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/245) 2024-09-11T00:54:27.017 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:54:27.021 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:54:27.021 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:54:27.022 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:54:27.022 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:54:27.292 INFO:teuthology.orchestra.run.smithi092.stdout:generic/245 0s 2024-09-11T00:54:27.298 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/245 2024-09-11T00:54:27.298 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:54:27.301 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:54:27.358 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:54:27.358 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/246) 2024-09-11T00:54:27.777 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:54:27.781 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:54:27.781 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:54:27.782 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:54:27.782 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:54:28.027 INFO:teuthology.orchestra.run.smithi092.stdout:generic/246 1s 2024-09-11T00:54:28.055 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/246 2024-09-11T00:54:28.055 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:54:28.057 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:54:28.128 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:54:28.128 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/247) 2024-09-11T00:54:28.525 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:54:28.529 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:54:28.530 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:54:28.530 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:54:28.531 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:54:39.004 INFO:teuthology.orchestra.run.smithi092.stdout:generic/247 10s 2024-09-11T00:54:39.010 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/247 2024-09-11T00:54:39.010 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:54:39.013 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:54:39.021 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:54:39.021 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/248) 2024-09-11T00:54:39.209 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:54:39.213 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:54:39.213 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:54:39.214 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:54:39.214 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:54:39.453 INFO:teuthology.orchestra.run.smithi092.stdout:generic/248 0s 2024-09-11T00:54:39.459 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/248 2024-09-11T00:54:39.459 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:54:39.461 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:54:39.481 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:54:39.482 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/249) 2024-09-11T00:54:39.661 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:54:39.665 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:54:39.665 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:54:39.666 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:54:39.667 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:54:40.100 INFO:teuthology.orchestra.run.smithi092.stdout:generic/249 1s 2024-09-11T00:54:40.106 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/249 2024-09-11T00:54:40.106 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:54:40.108 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:54:40.173 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:54:40.174 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/250) 2024-09-11T00:54:40.594 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:54:40.597 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:54:40.598 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:54:40.599 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:54:40.599 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:54:40.851 INFO:teuthology.orchestra.run.smithi092.stdout:generic/250 [not run] require 172.21.15.92:6789:/scratch to be valid block disk 2024-09-11T00:54:40.856 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/250 2024-09-11T00:54:40.856 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/250 2024-09-11T00:54:40.856 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:54:40.858 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:54:40.873 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:54:40.873 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/251) 2024-09-11T00:54:41.050 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:54:41.054 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:54:41.055 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:54:41.055 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:54:41.055 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:54:41.341 INFO:teuthology.orchestra.run.smithi092.stdout:generic/251 [not run] FITRIM not supported on /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:54:41.349 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/251 2024-09-11T00:54:41.350 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/251 2024-09-11T00:54:41.350 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:54:41.352 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:54:41.364 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:54:41.364 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/252) 2024-09-11T00:54:41.537 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:54:41.541 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:54:41.541 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:54:41.542 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:54:41.542 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:54:41.769 INFO:teuthology.orchestra.run.smithi092.stdout:generic/252 [not run] require 172.21.15.92:6789:/scratch to be valid block disk 2024-09-11T00:54:41.774 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/252 2024-09-11T00:54:41.774 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/252 2024-09-11T00:54:41.774 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:54:41.776 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:54:41.788 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:54:41.789 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/253) 2024-09-11T00:54:41.964 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:54:41.968 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:54:41.969 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:54:41.970 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:54:41.970 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:54:42.323 INFO:teuthology.orchestra.run.smithi092.stdout:generic/253 [not run] Reflink not supported by scratch filesystem type: ceph 2024-09-11T00:54:42.333 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/253 2024-09-11T00:54:42.333 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/253 2024-09-11T00:54:42.333 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:54:42.337 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:54:42.637 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:54:42.638 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/254) 2024-09-11T00:54:42.831 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:54:42.835 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:54:42.835 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:54:42.836 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:54:42.836 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:54:43.205 INFO:teuthology.orchestra.run.smithi092.stdout:generic/254 [not run] Reflink not supported by scratch filesystem type: ceph 2024-09-11T00:54:43.218 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/254 2024-09-11T00:54:43.218 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/254 2024-09-11T00:54:43.219 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:54:43.231 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:54:43.508 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:54:43.508 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/255) 2024-09-11T00:54:43.699 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:54:43.704 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:54:43.704 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:54:43.705 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:54:43.705 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:54:44.013 INFO:teuthology.orchestra.run.smithi092.stdout:generic/255 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-09-11T00:54:44.017 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/255 2024-09-11T00:54:44.017 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/255 2024-09-11T00:54:44.017 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:54:44.020 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:54:44.067 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:54:44.067 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/256) 2024-09-11T00:54:44.485 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:54:44.489 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:54:44.490 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:54:44.491 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:54:44.491 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:54:45.087 INFO:teuthology.orchestra.run.smithi092.stdout:generic/256 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2024-09-11T00:54:45.092 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/256 2024-09-11T00:54:45.093 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/256 2024-09-11T00:54:45.093 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:54:45.094 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:54:45.112 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:54:45.112 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/257) 2024-09-11T00:54:45.301 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:54:45.305 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:54:45.305 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:54:45.306 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:54:45.306 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:54:46.128 INFO:teuthology.orchestra.run.smithi092.stdout:generic/257 1s 2024-09-11T00:54:46.184 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/257 2024-09-11T00:54:46.184 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:54:46.186 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:54:46.244 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:54:46.244 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/258) 2024-09-11T00:54:46.649 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:54:46.653 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:54:46.654 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:54:46.654 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:54:46.654 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:54:46.950 INFO:teuthology.orchestra.run.smithi092.stdout:generic/258 [not run] ceph does not support negative timestamps 2024-09-11T00:54:46.955 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/258 2024-09-11T00:54:46.955 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/258 2024-09-11T00:54:46.955 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:54:46.957 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:54:46.981 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:54:46.982 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/259) 2024-09-11T00:54:47.163 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:54:47.166 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:54:47.167 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:54:47.168 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:54:47.168 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:54:47.543 INFO:teuthology.orchestra.run.smithi092.stdout:generic/259 [not run] Reflink not supported by scratch filesystem type: ceph 2024-09-11T00:54:47.555 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/259 2024-09-11T00:54:47.555 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/259 2024-09-11T00:54:47.556 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:54:47.566 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:54:47.839 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:54:47.839 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/260) 2024-09-11T00:54:48.026 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:54:48.029 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:54:48.030 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:54:48.031 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:54:48.031 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:54:48.347 INFO:teuthology.orchestra.run.smithi092.stdout:generic/260 [not run] FITRIM not supported on /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:54:48.355 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/260 2024-09-11T00:54:48.356 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/260 2024-09-11T00:54:48.356 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:54:48.358 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:54:48.369 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:54:48.370 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/261) 2024-09-11T00:54:48.542 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:54:48.545 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:54:48.546 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:54:48.547 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:54:48.547 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:54:48.906 INFO:teuthology.orchestra.run.smithi092.stdout:generic/261 [not run] Reflink not supported by scratch filesystem type: ceph 2024-09-11T00:54:48.916 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/261 2024-09-11T00:54:48.916 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/261 2024-09-11T00:54:48.916 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:54:48.925 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:54:49.180 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:54:49.180 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/262) 2024-09-11T00:54:49.381 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:54:49.385 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:54:49.385 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:54:49.386 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:54:49.386 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:54:49.737 INFO:teuthology.orchestra.run.smithi092.stdout:generic/262 [not run] Reflink not supported by scratch filesystem type: ceph 2024-09-11T00:54:49.748 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/262 2024-09-11T00:54:49.748 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/262 2024-09-11T00:54:49.749 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:54:49.752 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:54:50.046 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:54:50.046 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/263) 2024-09-11T00:54:50.235 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:54:50.239 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:54:50.239 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:54:50.240 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:54:50.240 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:55:27.707 INFO:teuthology.orchestra.run.smithi092.stdout:generic/263 37s 2024-09-11T00:55:27.713 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/263 2024-09-11T00:55:27.713 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:55:27.716 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:55:27.779 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:55:27.779 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/264) 2024-09-11T00:55:28.206 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:55:28.210 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:55:28.210 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:55:28.211 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:55:28.211 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:55:28.610 INFO:teuthology.orchestra.run.smithi092.stdout:generic/264 [not run] Reflink not supported by scratch filesystem type: ceph 2024-09-11T00:55:28.623 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/264 2024-09-11T00:55:28.623 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/264 2024-09-11T00:55:28.623 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:55:28.627 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:55:28.953 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:55:28.953 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/265) 2024-09-11T00:55:29.136 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:55:29.140 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:55:29.140 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:55:29.141 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:55:29.141 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:55:29.554 INFO:teuthology.orchestra.run.smithi092.stdout:generic/265 [not run] Reflink not supported by scratch filesystem type: ceph 2024-09-11T00:55:29.567 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/265 2024-09-11T00:55:29.567 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/265 2024-09-11T00:55:29.567 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:55:29.570 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:55:29.884 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:55:29.884 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/266) 2024-09-11T00:55:30.062 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:55:30.066 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:55:30.066 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:55:30.067 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:55:30.067 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:55:30.471 INFO:teuthology.orchestra.run.smithi092.stdout:generic/266 [not run] Reflink not supported by scratch filesystem type: ceph 2024-09-11T00:55:30.482 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/266 2024-09-11T00:55:30.482 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/266 2024-09-11T00:55:30.482 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:55:30.496 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:55:30.773 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:55:30.773 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/267) 2024-09-11T00:55:30.971 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:55:30.975 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:55:30.975 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:55:30.977 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:55:30.977 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:55:31.369 INFO:teuthology.orchestra.run.smithi092.stdout:generic/267 [not run] Reflink not supported by scratch filesystem type: ceph 2024-09-11T00:55:31.382 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/267 2024-09-11T00:55:31.382 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/267 2024-09-11T00:55:31.382 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:55:31.387 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:55:31.724 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:55:31.725 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/268) 2024-09-11T00:55:31.906 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:55:31.910 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:55:31.910 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:55:31.911 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:55:31.911 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:55:32.319 INFO:teuthology.orchestra.run.smithi092.stdout:generic/268 [not run] Reflink not supported by scratch filesystem type: ceph 2024-09-11T00:55:32.328 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/268 2024-09-11T00:55:32.328 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/268 2024-09-11T00:55:32.328 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:55:32.333 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:55:32.676 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:55:32.677 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/269) 2024-09-11T00:55:32.852 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:55:32.855 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:55:32.856 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:55:32.857 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:55:32.857 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:55:33.068 INFO:teuthology.orchestra.run.smithi092.stdout:generic/269 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2024-09-11T00:55:33.073 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/269 2024-09-11T00:55:33.073 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/269 2024-09-11T00:55:33.073 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:55:33.076 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:55:33.089 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:55:33.090 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/270) 2024-09-11T00:55:33.279 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:55:33.283 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:55:33.283 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:55:33.285 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:55:33.285 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:55:33.491 INFO:teuthology.orchestra.run.smithi092.stdout:generic/270 [not run] disk quotas not supported by this filesystem type: ceph 2024-09-11T00:55:33.495 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/270 2024-09-11T00:55:33.495 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/270 2024-09-11T00:55:33.496 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:55:33.498 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:55:33.522 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:55:33.588 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/271) 2024-09-11T00:55:33.772 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:55:33.775 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:55:33.776 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:55:33.777 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:55:33.777 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:55:34.173 INFO:teuthology.orchestra.run.smithi092.stdout:generic/271 [not run] Reflink not supported by scratch filesystem type: ceph 2024-09-11T00:55:34.182 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/271 2024-09-11T00:55:34.182 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/271 2024-09-11T00:55:34.182 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:55:34.188 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:55:34.427 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:55:34.427 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/272) 2024-09-11T00:55:34.612 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:55:34.616 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:55:34.616 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:55:34.617 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:55:34.617 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:55:35.027 INFO:teuthology.orchestra.run.smithi092.stdout:generic/272 [not run] Reflink not supported by scratch filesystem type: ceph 2024-09-11T00:55:35.036 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/272 2024-09-11T00:55:35.036 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/272 2024-09-11T00:55:35.036 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:55:35.038 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:55:35.389 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:55:35.389 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/273) 2024-09-11T00:55:35.564 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:55:35.568 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:55:35.568 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:55:35.569 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:55:35.569 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:55:35.795 INFO:teuthology.orchestra.run.smithi092.stdout:generic/273 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2024-09-11T00:55:35.800 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/273 2024-09-11T00:55:35.800 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/273 2024-09-11T00:55:35.800 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:55:35.802 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:55:35.820 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:55:35.820 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/274) 2024-09-11T00:55:36.006 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:55:36.013 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:55:36.013 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:55:36.014 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:55:36.014 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:55:36.232 INFO:teuthology.orchestra.run.smithi092.stdout:generic/274 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2024-09-11T00:55:36.237 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/274 2024-09-11T00:55:36.237 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/274 2024-09-11T00:55:36.237 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:55:36.239 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:55:36.258 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:55:36.258 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/275) 2024-09-11T00:55:36.456 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:55:36.460 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:55:36.460 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:55:36.461 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:55:36.461 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:55:36.670 INFO:teuthology.orchestra.run.smithi092.stdout:generic/275 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2024-09-11T00:55:36.674 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/275 2024-09-11T00:55:36.674 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/275 2024-09-11T00:55:36.675 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:55:36.677 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:55:36.691 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:55:36.691 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/276) 2024-09-11T00:55:36.879 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:55:36.883 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:55:36.883 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:55:36.884 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:55:36.884 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:55:37.303 INFO:teuthology.orchestra.run.smithi092.stdout:generic/276 [not run] Reflink not supported by scratch filesystem type: ceph 2024-09-11T00:55:37.316 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/276 2024-09-11T00:55:37.316 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/276 2024-09-11T00:55:37.316 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:55:37.321 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:55:37.623 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:55:37.623 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/277) 2024-09-11T00:55:37.803 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:55:37.807 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:55:37.807 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:55:37.808 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:55:37.809 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:55:38.063 INFO:teuthology.orchestra.run.smithi092.stdout:generic/277 [not run] file system doesn't support chattr +A 2024-09-11T00:55:38.068 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/277 2024-09-11T00:55:38.068 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/277 2024-09-11T00:55:38.068 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:55:38.070 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:55:38.091 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:55:38.091 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/278) 2024-09-11T00:55:38.269 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:55:38.273 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:55:38.273 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:55:38.274 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:55:38.274 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:55:38.647 INFO:teuthology.orchestra.run.smithi092.stdout:generic/278 [not run] Reflink not supported by scratch filesystem type: ceph 2024-09-11T00:55:38.657 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/278 2024-09-11T00:55:38.657 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/278 2024-09-11T00:55:38.658 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:55:38.664 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:55:38.987 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:55:38.987 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/279) 2024-09-11T00:55:39.176 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:55:39.180 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:55:39.180 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:55:39.181 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:55:39.181 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:55:39.592 INFO:teuthology.orchestra.run.smithi092.stdout:generic/279 [not run] Reflink not supported by scratch filesystem type: ceph 2024-09-11T00:55:39.608 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/279 2024-09-11T00:55:39.608 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/279 2024-09-11T00:55:39.608 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:55:39.612 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:55:39.923 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:55:39.923 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/280) 2024-09-11T00:55:40.114 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:55:40.118 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:55:40.118 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:55:40.119 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:55:40.119 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:55:40.363 INFO:teuthology.orchestra.run.smithi092.stdout:generic/280 [not run] disk quotas not supported by this filesystem type: ceph 2024-09-11T00:55:40.369 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/280 2024-09-11T00:55:40.369 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/280 2024-09-11T00:55:40.369 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:55:40.371 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:55:40.385 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:55:40.385 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/281) 2024-09-11T00:55:40.563 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:55:40.566 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:55:40.567 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:55:40.568 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:55:40.568 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:55:40.981 INFO:teuthology.orchestra.run.smithi092.stdout:generic/281 [not run] Reflink not supported by scratch filesystem type: ceph 2024-09-11T00:55:41.001 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/281 2024-09-11T00:55:41.001 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/281 2024-09-11T00:55:41.001 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:55:41.009 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:55:41.295 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:55:41.296 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/282) 2024-09-11T00:55:41.470 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:55:41.474 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:55:41.474 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:55:41.475 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:55:41.475 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:55:41.898 INFO:teuthology.orchestra.run.smithi092.stdout:generic/282 [not run] Reflink not supported by scratch filesystem type: ceph 2024-09-11T00:55:41.914 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/282 2024-09-11T00:55:41.914 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/282 2024-09-11T00:55:41.914 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:55:41.921 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:55:42.231 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:55:42.232 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/283) 2024-09-11T00:55:42.417 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:55:42.421 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:55:42.421 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:55:42.422 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:55:42.422 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:55:42.831 INFO:teuthology.orchestra.run.smithi092.stdout:generic/283 [not run] Reflink not supported by scratch filesystem type: ceph 2024-09-11T00:55:42.842 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/283 2024-09-11T00:55:42.843 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/283 2024-09-11T00:55:42.843 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:55:42.854 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:55:43.159 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:55:43.160 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/284) 2024-09-11T00:55:43.342 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:55:43.346 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:55:43.347 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:55:43.348 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:55:43.348 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:55:43.744 INFO:teuthology.orchestra.run.smithi092.stdout:generic/284 [not run] Reflink not supported by scratch filesystem type: ceph 2024-09-11T00:55:43.751 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/284 2024-09-11T00:55:43.751 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/284 2024-09-11T00:55:43.751 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:55:43.758 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:55:44.115 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:55:44.115 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/285) 2024-09-11T00:55:44.307 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:55:44.311 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:55:44.312 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:55:44.313 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:55:44.313 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:55:45.699 INFO:teuthology.orchestra.run.smithi092.stdout:generic/285 1s 2024-09-11T00:55:45.705 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/285 2024-09-11T00:55:45.705 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:55:45.707 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:55:45.942 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:55:45.942 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/286) 2024-09-11T00:55:46.395 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:55:46.399 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:55:46.399 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:55:46.400 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:55:46.400 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:55:46.616 INFO:teuthology.orchestra.run.smithi092.stdout:generic/286 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-09-11T00:55:46.621 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/286 2024-09-11T00:55:46.621 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/286 2024-09-11T00:55:46.621 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:55:46.623 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:55:46.643 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:55:46.643 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/287) 2024-09-11T00:55:46.837 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:55:46.845 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:55:46.845 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:55:46.847 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:55:46.847 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:55:47.349 INFO:teuthology.orchestra.run.smithi092.stdout:generic/287 [not run] Reflink not supported by scratch filesystem type: ceph 2024-09-11T00:55:47.360 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/287 2024-09-11T00:55:47.360 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/287 2024-09-11T00:55:47.360 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:55:47.367 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:55:47.700 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:55:47.700 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/288) 2024-09-11T00:55:47.934 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:55:47.939 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:55:47.939 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:55:47.941 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:55:47.941 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:55:48.400 INFO:teuthology.orchestra.run.smithi092.stdout:generic/288 [not run] FITRIM not supported on /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:55:48.423 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/288 2024-09-11T00:55:48.424 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/288 2024-09-11T00:55:48.424 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:55:48.427 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:55:48.451 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:55:48.451 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/289) 2024-09-11T00:55:48.717 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:55:48.722 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:55:48.723 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:55:48.725 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:55:48.725 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:55:49.238 INFO:teuthology.orchestra.run.smithi092.stdout:generic/289 [not run] Reflink not supported by scratch filesystem type: ceph 2024-09-11T00:55:49.245 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/289 2024-09-11T00:55:49.246 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/289 2024-09-11T00:55:49.246 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:55:49.252 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:55:49.540 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:55:49.540 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/290) 2024-09-11T00:55:49.799 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:55:49.804 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:55:49.805 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:55:49.806 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:55:49.806 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:55:50.398 INFO:teuthology.orchestra.run.smithi092.stdout:generic/290 [not run] Reflink not supported by scratch filesystem type: ceph 2024-09-11T00:55:50.409 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/290 2024-09-11T00:55:50.409 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/290 2024-09-11T00:55:50.409 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:55:50.417 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:55:50.729 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:55:50.729 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/291) 2024-09-11T00:55:50.980 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:55:50.985 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:55:50.985 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:55:50.987 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:55:50.987 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:55:51.516 INFO:teuthology.orchestra.run.smithi092.stdout:generic/291 [not run] Reflink not supported by scratch filesystem type: ceph 2024-09-11T00:55:51.526 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/291 2024-09-11T00:55:51.526 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/291 2024-09-11T00:55:51.526 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:55:51.532 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:55:51.811 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:55:51.811 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/292) 2024-09-11T00:55:52.070 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:55:52.080 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:55:52.080 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:55:52.082 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:55:52.082 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:55:52.630 INFO:teuthology.orchestra.run.smithi092.stdout:generic/292 [not run] Reflink not supported by scratch filesystem type: ceph 2024-09-11T00:55:52.637 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/292 2024-09-11T00:55:52.638 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/292 2024-09-11T00:55:52.638 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:55:52.641 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:55:52.939 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:55:52.939 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/293) 2024-09-11T00:55:53.148 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:55:53.152 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:55:53.152 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:55:53.153 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:55:53.153 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:55:53.525 INFO:teuthology.orchestra.run.smithi092.stdout:generic/293 [not run] Reflink not supported by scratch filesystem type: ceph 2024-09-11T00:55:53.544 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/293 2024-09-11T00:55:53.544 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/293 2024-09-11T00:55:53.544 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:55:53.550 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:55:53.794 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:55:53.794 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/294) 2024-09-11T00:55:54.002 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:55:54.006 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:55:54.006 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:55:54.007 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:55:54.007 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:55:54.492 INFO:teuthology.orchestra.run.smithi092.stdout:generic/294 0s 2024-09-11T00:55:54.505 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/294 2024-09-11T00:55:54.505 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:55:54.511 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:55:54.533 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:55:54.533 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/295) 2024-09-11T00:55:54.893 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:55:54.897 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:55:54.897 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:55:54.898 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:55:54.898 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:55:55.286 INFO:teuthology.orchestra.run.smithi092.stdout:generic/295 [not run] Reflink not supported by scratch filesystem type: ceph 2024-09-11T00:55:55.294 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/295 2024-09-11T00:55:55.294 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/295 2024-09-11T00:55:55.294 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:55:55.297 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:55:55.625 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:55:55.626 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/296) 2024-09-11T00:55:55.808 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:55:55.811 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:55:55.812 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:55:55.813 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:55:55.813 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:55:56.205 INFO:teuthology.orchestra.run.smithi092.stdout:generic/296 [not run] Reflink not supported by scratch filesystem type: ceph 2024-09-11T00:55:56.221 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/296 2024-09-11T00:55:56.221 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/296 2024-09-11T00:55:56.221 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:55:56.234 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:55:56.475 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:55:56.475 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/297) 2024-09-11T00:55:56.681 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:55:56.684 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:55:56.685 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:55:56.685 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:55:56.686 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:55:57.076 INFO:teuthology.orchestra.run.smithi092.stdout:generic/297 [not run] Reflink not supported by scratch filesystem type: ceph 2024-09-11T00:55:57.092 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/297 2024-09-11T00:55:57.092 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/297 2024-09-11T00:55:57.092 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:55:57.109 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:55:57.263 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:55:57.263 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/298) 2024-09-11T00:55:57.544 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:55:57.548 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:55:57.548 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:55:57.549 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:55:57.549 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:55:57.922 INFO:teuthology.orchestra.run.smithi092.stdout:generic/298 [not run] Reflink not supported by scratch filesystem type: ceph 2024-09-11T00:55:57.929 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/298 2024-09-11T00:55:57.929 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/298 2024-09-11T00:55:57.929 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:55:57.934 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:55:58.258 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:55:58.258 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/299) 2024-09-11T00:55:58.441 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:55:58.445 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:55:58.445 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:55:58.446 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:55:58.446 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:55:58.719 INFO:teuthology.orchestra.run.smithi092.stdout:generic/299 [not run] require 172.21.15.92:6789:/scratch to be valid block disk 2024-09-11T00:55:58.724 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/299 2024-09-11T00:55:58.724 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/299 2024-09-11T00:55:58.724 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:55:58.726 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:55:58.744 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:55:58.745 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/300) 2024-09-11T00:55:58.935 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:55:58.939 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:55:58.940 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:55:58.941 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:55:58.941 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:55:59.199 INFO:teuthology.orchestra.run.smithi092.stdout:generic/300 [not run] require 172.21.15.92:6789:/scratch to be valid block disk 2024-09-11T00:55:59.204 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/300 2024-09-11T00:55:59.204 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/300 2024-09-11T00:55:59.204 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:55:59.206 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:55:59.225 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:55:59.225 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/301) 2024-09-11T00:55:59.399 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:55:59.403 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:55:59.403 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:55:59.404 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:55:59.404 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:55:59.780 INFO:teuthology.orchestra.run.smithi092.stdout:generic/301 [not run] Reflink not supported by scratch filesystem type: ceph 2024-09-11T00:55:59.788 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/301 2024-09-11T00:55:59.788 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/301 2024-09-11T00:55:59.788 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:55:59.799 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:56:00.065 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:56:00.065 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/302) 2024-09-11T00:56:00.258 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:56:00.262 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:56:00.262 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:56:00.263 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:56:00.263 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:56:00.652 INFO:teuthology.orchestra.run.smithi092.stdout:generic/302 [not run] Reflink not supported by scratch filesystem type: ceph 2024-09-11T00:56:00.660 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/302 2024-09-11T00:56:00.661 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/302 2024-09-11T00:56:00.661 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:56:00.667 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:56:00.940 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:56:00.941 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/303) 2024-09-11T00:56:01.128 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:56:01.132 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:56:01.132 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:56:01.138 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:56:01.138 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:56:01.383 INFO:teuthology.orchestra.run.smithi092.stdout:generic/303 [not run] Reflink not supported by test filesystem type: ceph 2024-09-11T00:56:01.387 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/303 2024-09-11T00:56:01.387 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/303 2024-09-11T00:56:01.388 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:56:01.390 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:56:01.451 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:56:01.451 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/304) 2024-09-11T00:56:01.858 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:56:01.862 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:56:01.863 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:56:01.864 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:56:01.864 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:56:02.102 INFO:teuthology.orchestra.run.smithi092.stdout:generic/304 [not run] Dedupe not supported by test filesystem type: ceph 2024-09-11T00:56:02.106 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/304 2024-09-11T00:56:02.106 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/304 2024-09-11T00:56:02.106 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:56:02.108 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:56:02.179 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:56:02.179 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/305) 2024-09-11T00:56:02.612 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:56:02.615 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:56:02.616 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:56:02.617 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:56:02.617 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:56:02.976 INFO:teuthology.orchestra.run.smithi092.stdout:generic/305 [not run] Reflink not supported by scratch filesystem type: ceph 2024-09-11T00:56:02.990 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/305 2024-09-11T00:56:02.990 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/305 2024-09-11T00:56:02.990 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:56:02.992 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:56:03.286 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:56:03.286 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/306) 2024-09-11T00:56:03.477 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:56:03.481 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:56:03.481 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:56:03.482 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:56:03.482 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:56:04.020 INFO:teuthology.orchestra.run.smithi092.stdout:generic/306 1s 2024-09-11T00:56:04.036 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/306 2024-09-11T00:56:04.036 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:56:04.040 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:56:04.307 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:56:04.307 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/307) 2024-09-11T00:56:04.765 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:56:04.769 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:56:04.769 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:56:04.770 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:56:04.770 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:56:06.276 INFO:teuthology.orchestra.run.smithi092.stdout:generic/307 2s 2024-09-11T00:56:06.282 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/307 2024-09-11T00:56:06.282 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:56:06.284 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:56:06.292 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:56:06.293 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/308) 2024-09-11T00:56:06.472 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:56:06.476 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:56:06.476 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:56:06.477 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:56:06.477 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:56:06.721 INFO:teuthology.orchestra.run.smithi092.stdout:generic/308 0s 2024-09-11T00:56:06.727 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/308 2024-09-11T00:56:06.727 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:56:06.729 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:56:06.751 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:56:06.751 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/309) 2024-09-11T00:56:06.928 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:56:06.931 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:56:06.932 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:56:06.933 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:56:06.933 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:56:08.225 INFO:teuthology.orchestra.run.smithi092.stdout:generic/309 1s 2024-09-11T00:56:08.231 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/309 2024-09-11T00:56:08.231 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:56:08.233 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:56:08.292 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:56:08.292 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/310) 2024-09-11T00:56:08.704 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:56:08.708 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:56:08.708 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:56:08.709 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:56:08.709 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:57:06.534 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T00:57:06.537 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T00:57:27.120 INFO:teuthology.orchestra.run.smithi092.stdout:generic/310 79s 2024-09-11T00:57:27.145 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/310 2024-09-11T00:57:27.145 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:57:27.155 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:57:27.326 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:57:27.326 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/311) 2024-09-11T00:57:27.693 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:57:27.697 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:57:27.697 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:57:27.698 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:57:27.698 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:57:27.994 INFO:teuthology.orchestra.run.smithi092.stdout:generic/311 [not run] require 172.21.15.92:6789:/scratch to be valid block disk 2024-09-11T00:57:27.999 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/311 2024-09-11T00:57:27.999 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/311 2024-09-11T00:57:27.999 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:57:28.001 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:57:28.013 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:57:28.013 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/312) 2024-09-11T00:57:28.196 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:57:28.200 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:57:28.200 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:57:28.201 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:57:28.201 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:57:28.402 INFO:teuthology.orchestra.run.smithi092.stdout:generic/312 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-09-11T00:57:28.407 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/312 2024-09-11T00:57:28.407 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/312 2024-09-11T00:57:28.407 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:57:28.409 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:57:28.423 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:57:28.423 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/313) 2024-09-11T00:57:28.599 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:57:28.603 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:57:28.603 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:57:28.604 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:57:28.604 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:57:32.851 INFO:teuthology.orchestra.run.smithi092.stdout:generic/313 4s 2024-09-11T00:57:32.859 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/313 2024-09-11T00:57:32.859 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:57:32.862 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:57:32.880 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:57:32.880 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/314) 2024-09-11T00:57:33.087 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:57:33.091 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:57:33.091 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:57:33.093 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:57:33.093 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:57:33.639 INFO:teuthology.orchestra.run.smithi092.stdout:generic/314 0s 2024-09-11T00:57:33.645 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/314 2024-09-11T00:57:33.645 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:57:33.647 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:57:33.663 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:57:33.664 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/315) 2024-09-11T00:57:33.836 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:57:33.840 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:57:33.840 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:57:33.841 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:57:33.841 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:57:34.061 INFO:teuthology.orchestra.run.smithi092.stdout:generic/315 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2024-09-11T00:57:34.065 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/315 2024-09-11T00:57:34.065 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/315 2024-09-11T00:57:34.066 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:57:34.068 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:57:34.083 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:57:34.083 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/316) 2024-09-11T00:57:34.257 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:57:34.261 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:57:34.261 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:57:34.262 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:57:34.262 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:57:34.593 INFO:teuthology.orchestra.run.smithi092.stdout:generic/316 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2024-09-11T00:57:34.598 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/316 2024-09-11T00:57:34.598 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/316 2024-09-11T00:57:34.598 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:57:34.600 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:57:34.656 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:57:34.656 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/317) 2024-09-11T00:57:35.037 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:57:35.041 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:57:35.041 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:57:35.042 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:57:35.042 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:57:35.972 INFO:teuthology.orchestra.run.smithi092.stdout:generic/317 0s 2024-09-11T00:57:35.979 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/317 2024-09-11T00:57:35.979 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:57:35.981 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:57:35.991 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:57:35.991 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/318) 2024-09-11T00:57:36.171 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:57:36.175 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:57:36.175 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:57:36.176 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:57:36.176 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:57:36.677 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T00:57:36.680 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T00:57:36.684 INFO:teuthology.orchestra.run.smithi092.stdout:generic/318 0s 2024-09-11T00:57:36.691 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/318 2024-09-11T00:57:36.691 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:57:36.693 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:57:36.702 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:57:36.702 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/319) 2024-09-11T00:57:36.933 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:57:36.937 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:57:36.937 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:57:36.938 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:57:36.938 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:57:37.266 INFO:teuthology.orchestra.run.smithi092.stdout:generic/319 0s 2024-09-11T00:57:37.272 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/319 2024-09-11T00:57:37.273 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:57:37.275 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:57:37.284 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:57:37.284 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/320) 2024-09-11T00:57:37.464 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:57:37.468 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:57:37.468 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:57:37.469 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:57:37.469 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:57:37.689 INFO:teuthology.orchestra.run.smithi092.stdout:generic/320 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2024-09-11T00:57:37.696 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/320 2024-09-11T00:57:37.696 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/320 2024-09-11T00:57:37.696 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:57:37.697 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:57:37.709 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:57:37.709 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/321) 2024-09-11T00:57:37.884 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:57:37.887 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:57:37.888 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:57:37.889 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:57:37.889 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:57:38.108 INFO:teuthology.orchestra.run.smithi092.stdout:generic/321 [not run] require 172.21.15.92:6789:/scratch to be valid block disk 2024-09-11T00:57:38.113 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/321 2024-09-11T00:57:38.113 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/321 2024-09-11T00:57:38.113 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:57:38.116 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:57:38.128 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:57:38.128 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/322) 2024-09-11T00:57:38.313 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:57:38.317 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:57:38.317 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:57:38.318 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:57:38.318 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:57:38.535 INFO:teuthology.orchestra.run.smithi092.stdout:generic/322 [not run] require 172.21.15.92:6789:/scratch to be valid block disk 2024-09-11T00:57:38.539 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/322 2024-09-11T00:57:38.540 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/322 2024-09-11T00:57:38.540 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:57:38.542 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:57:38.554 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:57:38.554 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/323) 2024-09-11T00:57:38.733 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:57:38.737 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:57:38.737 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:57:38.738 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:57:38.738 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:58:06.745 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T00:58:06.748 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T00:58:37.195 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T00:58:37.198 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T00:58:37.226 INFO:tasks.ceph.osd.6.smithi145.stderr:2024-09-11T00:58:37.224+0000 7f12741b6640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 47403) UID: 0 2024-09-11T00:58:37.226 INFO:tasks.ceph.osd.5.smithi145.stderr:2024-09-11T00:58:37.224+0000 7f3a08302640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 47403) UID: 0 2024-09-11T00:58:37.227 INFO:tasks.ceph.osd.7.smithi145.stderr:2024-09-11T00:58:37.224+0000 7f246f6c7640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 47403) UID: 0 2024-09-11T00:58:37.227 INFO:tasks.ceph.osd.4.smithi145.stderr:2024-09-11T00:58:37.224+0000 7f87e7126640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 47403) UID: 0 2024-09-11T00:59:39.459 INFO:teuthology.orchestra.run.smithi092.stdout:generic/323 121s 2024-09-11T00:59:39.464 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/323 2024-09-11T00:59:39.464 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:59:39.467 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:59:39.518 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:59:39.518 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/324) 2024-09-11T00:59:39.918 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:59:39.922 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:59:39.922 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:59:39.923 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:59:39.923 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:59:40.140 INFO:teuthology.orchestra.run.smithi092.stdout:generic/324 [not run] defragmentation not supported for fstype "ceph" 2024-09-11T00:59:40.145 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/324 2024-09-11T00:59:40.145 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/324 2024-09-11T00:59:40.148 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:59:40.148 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:59:40.161 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:59:40.161 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/325) 2024-09-11T00:59:40.341 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:59:40.344 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:59:40.345 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:59:40.346 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:59:40.346 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:59:40.565 INFO:teuthology.orchestra.run.smithi092.stdout:generic/325 [not run] require 172.21.15.92:6789:/scratch to be valid block disk 2024-09-11T00:59:40.570 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/325 2024-09-11T00:59:40.570 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/325 2024-09-11T00:59:40.570 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:59:40.573 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:59:40.586 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:59:40.586 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/326) 2024-09-11T00:59:40.764 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:59:40.768 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:59:40.769 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:59:40.769 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:59:40.770 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:59:41.120 INFO:teuthology.orchestra.run.smithi092.stdout:generic/326 [not run] Reflink not supported by scratch filesystem type: ceph 2024-09-11T00:59:41.127 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/326 2024-09-11T00:59:41.127 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/326 2024-09-11T00:59:41.127 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:59:41.132 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:59:41.296 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:59:41.296 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/327) 2024-09-11T00:59:41.543 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:59:41.547 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:59:41.548 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:59:41.549 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:59:41.549 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:59:41.918 INFO:teuthology.orchestra.run.smithi092.stdout:generic/327 [not run] Reflink not supported by scratch filesystem type: ceph 2024-09-11T00:59:41.925 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/327 2024-09-11T00:59:41.925 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/327 2024-09-11T00:59:41.926 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:59:41.932 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:59:42.034 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:59:42.035 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/328) 2024-09-11T00:59:42.305 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:59:42.309 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:59:42.309 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:59:42.310 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:59:42.310 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:59:42.684 INFO:teuthology.orchestra.run.smithi092.stdout:generic/328 [not run] Reflink not supported by scratch filesystem type: ceph 2024-09-11T00:59:42.692 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/328 2024-09-11T00:59:42.693 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/328 2024-09-11T00:59:42.693 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:59:42.697 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:59:42.810 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:59:42.810 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/329) 2024-09-11T00:59:43.082 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:59:43.086 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:59:43.086 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:59:43.087 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:59:43.088 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:59:43.477 INFO:teuthology.orchestra.run.smithi092.stdout:generic/329 [not run] Reflink not supported by scratch filesystem type: ceph 2024-09-11T00:59:43.487 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/329 2024-09-11T00:59:43.487 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/329 2024-09-11T00:59:43.487 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:59:43.489 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:59:43.537 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:59:43.537 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/330) 2024-09-11T00:59:43.840 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:59:43.844 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:59:43.844 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:59:43.845 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:59:43.845 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:59:44.183 INFO:teuthology.orchestra.run.smithi092.stdout:generic/330 [not run] Reflink not supported by scratch filesystem type: ceph 2024-09-11T00:59:44.190 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/330 2024-09-11T00:59:44.190 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/330 2024-09-11T00:59:44.190 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:59:44.194 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:59:44.252 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:59:44.253 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/331) 2024-09-11T00:59:44.582 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:59:44.586 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:59:44.586 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:59:44.587 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:59:44.587 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:59:44.951 INFO:teuthology.orchestra.run.smithi092.stdout:generic/331 [not run] Reflink not supported by scratch filesystem type: ceph 2024-09-11T00:59:44.959 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/331 2024-09-11T00:59:44.959 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/331 2024-09-11T00:59:44.960 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:59:44.963 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:59:45.025 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:59:45.025 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/332) 2024-09-11T00:59:45.332 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:59:45.336 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:59:45.337 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:59:45.337 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:59:45.337 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:59:45.701 INFO:teuthology.orchestra.run.smithi092.stdout:generic/332 [not run] Reflink not supported by scratch filesystem type: ceph 2024-09-11T00:59:45.708 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/332 2024-09-11T00:59:45.708 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/332 2024-09-11T00:59:45.708 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:59:45.718 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:59:45.853 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:59:45.854 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/333) 2024-09-11T00:59:46.097 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:59:46.101 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:59:46.101 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:59:46.102 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:59:46.103 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:59:46.461 INFO:teuthology.orchestra.run.smithi092.stdout:generic/333 [not run] Reflink not supported by scratch filesystem type: ceph 2024-09-11T00:59:46.478 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/333 2024-09-11T00:59:46.478 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/333 2024-09-11T00:59:46.478 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:59:46.482 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:59:46.546 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:59:46.547 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/334) 2024-09-11T00:59:46.844 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:59:46.848 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:59:46.848 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:59:46.849 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:59:46.849 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:59:47.197 INFO:teuthology.orchestra.run.smithi092.stdout:generic/334 [not run] Reflink not supported by scratch filesystem type: ceph 2024-09-11T00:59:47.207 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/334 2024-09-11T00:59:47.207 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/334 2024-09-11T00:59:47.207 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:59:47.211 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:59:47.284 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:59:47.284 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/335) 2024-09-11T00:59:47.587 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:59:47.591 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:59:47.591 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:59:47.592 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:59:47.592 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:59:47.811 INFO:teuthology.orchestra.run.smithi092.stdout:generic/335 [not run] require 172.21.15.92:6789:/scratch to be valid block disk 2024-09-11T00:59:47.817 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/335 2024-09-11T00:59:47.817 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/335 2024-09-11T00:59:47.817 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:59:47.818 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:59:47.830 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:59:47.831 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/336) 2024-09-11T00:59:48.010 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:59:48.014 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:59:48.015 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:59:48.015 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:59:48.016 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:59:48.246 INFO:teuthology.orchestra.run.smithi092.stdout:generic/336 [not run] require 172.21.15.92:6789:/scratch to be valid block disk 2024-09-11T00:59:48.251 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/336 2024-09-11T00:59:48.252 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/336 2024-09-11T00:59:48.252 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:59:48.254 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:59:48.270 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:59:48.270 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/337) 2024-09-11T00:59:48.447 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:59:48.452 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:59:48.452 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:59:48.452 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:59:48.452 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:59:48.798 INFO:teuthology.orchestra.run.smithi092.stdout:generic/337 0s 2024-09-11T00:59:48.805 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/337 2024-09-11T00:59:48.805 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:59:48.808 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:59:48.816 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:59:48.816 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/338) 2024-09-11T00:59:48.991 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:59:48.995 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:59:48.995 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:59:48.996 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:59:48.996 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:59:49.224 INFO:teuthology.orchestra.run.smithi092.stdout:generic/338 [not run] require 172.21.15.92:6789:/scratch to be valid block disk 2024-09-11T00:59:49.228 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/338 2024-09-11T00:59:49.229 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/338 2024-09-11T00:59:49.229 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T00:59:49.231 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T00:59:49.244 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T00:59:49.244 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/339) 2024-09-11T00:59:49.418 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T00:59:49.422 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T00:59:49.422 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T00:59:49.423 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T00:59:49.423 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T01:00:37.495 INFO:teuthology.orchestra.run.smithi092.stdout:generic/339 48s 2024-09-11T01:00:37.553 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/339 2024-09-11T01:00:37.553 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T01:00:37.557 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T01:00:37.571 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T01:00:37.572 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/340) 2024-09-11T01:00:37.951 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T01:00:37.956 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T01:00:37.956 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T01:00:37.957 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T01:00:37.957 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T01:00:40.261 INFO:teuthology.orchestra.run.smithi092.stdout:generic/340 2s 2024-09-11T01:00:40.323 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/340 2024-09-11T01:00:40.323 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T01:00:40.330 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T01:00:40.350 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T01:00:40.350 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/341) 2024-09-11T01:00:40.694 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T01:00:40.699 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T01:00:40.699 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T01:00:40.701 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T01:00:40.701 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T01:00:41.006 INFO:teuthology.orchestra.run.smithi092.stdout:generic/341 [not run] require 172.21.15.92:6789:/scratch to be valid block disk 2024-09-11T01:00:41.012 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/341 2024-09-11T01:00:41.012 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/341 2024-09-11T01:00:41.012 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T01:00:41.015 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T01:00:41.033 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T01:00:41.033 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/342) 2024-09-11T01:00:41.230 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T01:00:41.234 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T01:00:41.234 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T01:00:41.235 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T01:00:41.235 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T01:00:41.449 INFO:teuthology.orchestra.run.smithi092.stdout:generic/342 [not run] require 172.21.15.92:6789:/scratch to be valid block disk 2024-09-11T01:00:41.454 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/342 2024-09-11T01:00:41.454 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/342 2024-09-11T01:00:41.454 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T01:00:41.456 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T01:00:41.468 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T01:00:41.468 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/343) 2024-09-11T01:00:41.640 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T01:00:41.643 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T01:00:41.644 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T01:00:41.645 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T01:00:41.645 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T01:00:41.864 INFO:teuthology.orchestra.run.smithi092.stdout:generic/343 [not run] require 172.21.15.92:6789:/scratch to be valid block disk 2024-09-11T01:00:41.869 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/343 2024-09-11T01:00:41.869 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/343 2024-09-11T01:00:41.869 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T01:00:41.871 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T01:00:41.887 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T01:00:41.887 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/344) 2024-09-11T01:00:42.064 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T01:00:42.068 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T01:00:42.068 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T01:00:42.069 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T01:00:42.069 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T01:00:46.169 INFO:teuthology.orchestra.run.smithi092.stdout:generic/344 4s 2024-09-11T01:00:46.191 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/344 2024-09-11T01:00:46.191 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T01:00:46.194 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T01:00:46.223 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T01:00:46.224 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/345) 2024-09-11T01:00:46.734 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T01:00:46.740 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T01:00:46.741 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T01:00:46.742 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T01:00:46.742 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T01:00:51.583 INFO:teuthology.orchestra.run.smithi092.stdout:generic/345 5s 2024-09-11T01:00:51.605 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/345 2024-09-11T01:00:51.605 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T01:00:51.610 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T01:00:51.627 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T01:00:51.627 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/346) 2024-09-11T01:00:52.062 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T01:00:52.066 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T01:00:52.067 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T01:00:52.067 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T01:00:52.068 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T01:00:54.561 INFO:teuthology.orchestra.run.smithi092.stdout:generic/346 2s 2024-09-11T01:00:54.576 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/346 2024-09-11T01:00:54.577 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T01:00:54.587 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T01:00:54.606 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T01:00:54.606 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/347) 2024-09-11T01:00:54.952 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T01:00:54.955 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T01:00:54.956 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T01:00:54.957 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T01:00:54.957 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T01:00:55.210 INFO:teuthology.orchestra.run.smithi092.stdout:generic/347 [not run] require 172.21.15.92:6789:/scratch to be valid block disk 2024-09-11T01:00:55.215 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/347 2024-09-11T01:00:55.215 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/347 2024-09-11T01:00:55.215 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T01:00:55.217 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T01:00:55.229 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T01:00:55.230 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/348) 2024-09-11T01:00:55.428 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T01:00:55.432 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T01:00:55.432 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T01:00:55.434 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T01:00:55.434 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T01:00:55.734 INFO:teuthology.orchestra.run.smithi092.stdout:generic/348 [not run] require 172.21.15.92:6789:/scratch to be valid block disk 2024-09-11T01:00:55.742 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/348 2024-09-11T01:00:55.742 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/348 2024-09-11T01:00:55.742 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T01:00:55.744 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T01:00:55.779 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T01:00:55.779 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/349) 2024-09-11T01:00:55.990 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T01:00:55.993 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T01:00:55.994 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T01:00:55.995 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T01:00:55.995 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T01:00:56.499 INFO:teuthology.orchestra.run.smithi092.stdout:generic/349 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2024-09-11T01:00:56.504 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/349 2024-09-11T01:00:56.504 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/349 2024-09-11T01:00:56.504 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T01:00:56.507 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T01:00:56.523 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T01:00:56.523 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/350) 2024-09-11T01:00:56.695 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T01:00:56.699 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T01:00:56.699 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T01:00:56.700 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T01:00:56.700 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T01:00:57.305 INFO:teuthology.orchestra.run.smithi092.stdout:generic/350 1s 2024-09-11T01:00:57.311 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/350 2024-09-11T01:00:57.311 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T01:00:57.314 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T01:00:57.322 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T01:00:57.322 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/351) 2024-09-11T01:00:57.504 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T01:00:57.508 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T01:00:57.509 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T01:00:57.510 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T01:00:57.510 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T01:00:57.748 INFO:teuthology.orchestra.run.smithi092.stdout:generic/351 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-09-11T01:00:57.753 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/351 2024-09-11T01:00:57.753 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/351 2024-09-11T01:00:57.753 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T01:00:57.755 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T01:00:57.770 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T01:00:57.770 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/352) 2024-09-11T01:00:57.949 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T01:00:57.953 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T01:00:57.953 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T01:00:57.954 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T01:00:57.955 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T01:00:58.297 INFO:teuthology.orchestra.run.smithi092.stdout:generic/352 [not run] Reflink not supported by scratch filesystem type: ceph 2024-09-11T01:00:58.313 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/352 2024-09-11T01:00:58.313 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/352 2024-09-11T01:00:58.313 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T01:00:58.320 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T01:00:58.725 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T01:00:58.725 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/353) 2024-09-11T01:00:58.899 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T01:00:58.903 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T01:00:58.903 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T01:00:58.904 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T01:00:58.904 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T01:00:59.269 INFO:teuthology.orchestra.run.smithi092.stdout:generic/353 [not run] Reflink not supported by scratch filesystem type: ceph 2024-09-11T01:00:59.285 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/353 2024-09-11T01:00:59.285 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/353 2024-09-11T01:00:59.285 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T01:00:59.293 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T01:00:59.684 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T01:00:59.684 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/354) 2024-09-11T01:00:59.866 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T01:00:59.870 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T01:00:59.870 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T01:00:59.871 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T01:00:59.871 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T01:01:03.972 INFO:teuthology.orchestra.run.smithi092.stdout:generic/354 4s 2024-09-11T01:01:03.991 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/354 2024-09-11T01:01:03.991 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T01:01:04.001 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T01:01:04.029 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T01:01:04.030 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/355) 2024-09-11T01:01:04.440 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T01:01:04.445 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T01:01:04.446 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T01:01:04.447 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T01:01:04.447 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T01:01:05.214 INFO:teuthology.orchestra.run.smithi092.stdout:generic/355 1s 2024-09-11T01:01:05.224 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/355 2024-09-11T01:01:05.224 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T01:01:05.226 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T01:01:05.274 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T01:01:05.275 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/356) 2024-09-11T01:01:05.837 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T01:01:05.841 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T01:01:05.841 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T01:01:05.842 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T01:01:05.842 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T01:01:06.174 INFO:teuthology.orchestra.run.smithi092.stdout:generic/356 [not run] swapfiles are not supported 2024-09-11T01:01:06.179 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/356 2024-09-11T01:01:06.179 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/356 2024-09-11T01:01:06.179 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T01:01:06.182 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T01:01:06.195 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T01:01:06.195 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/357) 2024-09-11T01:01:06.375 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T01:01:06.379 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T01:01:06.380 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T01:01:06.381 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T01:01:06.381 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T01:01:06.708 INFO:teuthology.orchestra.run.smithi092.stdout:generic/357 [not run] swapfiles are not supported 2024-09-11T01:01:06.713 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/357 2024-09-11T01:01:06.713 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/357 2024-09-11T01:01:06.713 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T01:01:06.716 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T01:01:06.728 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T01:01:06.729 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/358) 2024-09-11T01:01:06.908 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T01:01:06.912 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T01:01:06.912 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T01:01:06.913 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T01:01:06.913 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T01:01:07.298 INFO:teuthology.orchestra.run.smithi092.stdout:generic/358 [not run] Reflink not supported by scratch filesystem type: ceph 2024-09-11T01:01:07.309 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/358 2024-09-11T01:01:07.309 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/358 2024-09-11T01:01:07.309 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T01:01:07.317 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T01:01:07.682 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T01:01:07.682 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/359) 2024-09-11T01:01:07.860 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T01:01:07.864 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T01:01:07.864 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T01:01:07.865 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T01:01:07.865 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T01:01:08.249 INFO:teuthology.orchestra.run.smithi092.stdout:generic/359 [not run] Reflink not supported by scratch filesystem type: ceph 2024-09-11T01:01:08.263 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/359 2024-09-11T01:01:08.263 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/359 2024-09-11T01:01:08.263 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T01:01:08.268 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T01:01:08.636 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T01:01:08.637 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/360) 2024-09-11T01:01:08.822 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T01:01:08.826 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T01:01:08.827 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T01:01:08.828 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T01:01:08.828 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T01:01:09.071 INFO:teuthology.orchestra.run.smithi092.stdout:generic/360 1s 2024-09-11T01:01:09.077 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/360 2024-09-11T01:01:09.077 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T01:01:09.079 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T01:01:09.096 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T01:01:09.096 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/361) 2024-09-11T01:01:09.284 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T01:01:09.288 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T01:01:09.289 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T01:01:09.289 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T01:01:09.289 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T01:01:09.510 INFO:teuthology.orchestra.run.smithi092.stdout:generic/361 [not run] require 172.21.15.92:6789:/scratch to be valid block disk 2024-09-11T01:01:09.515 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/361 2024-09-11T01:01:09.515 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/361 2024-09-11T01:01:09.515 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T01:01:09.518 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T01:01:09.531 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T01:01:09.531 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/362) 2024-09-11T01:01:09.715 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T01:01:09.719 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T01:01:09.719 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T01:01:09.720 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T01:01:09.720 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T01:01:09.996 INFO:teuthology.orchestra.run.smithi092.stdout:generic/362 0s 2024-09-11T01:01:10.002 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/362 2024-09-11T01:01:10.002 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T01:01:10.005 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T01:01:10.053 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T01:01:10.053 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/371) 2024-09-11T01:01:10.552 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T01:01:10.557 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T01:01:10.557 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T01:01:10.558 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T01:01:10.558 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T01:01:10.777 INFO:teuthology.orchestra.run.smithi092.stdout:generic/371 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-09-11T01:01:10.782 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/371 2024-09-11T01:01:10.782 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/371 2024-09-11T01:01:10.782 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T01:01:10.785 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T01:01:10.799 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T01:01:10.800 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/372) 2024-09-11T01:01:10.978 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T01:01:10.981 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T01:01:10.982 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T01:01:10.983 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T01:01:10.983 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T01:01:11.343 INFO:teuthology.orchestra.run.smithi092.stdout:generic/372 [not run] Reflink not supported by scratch filesystem type: ceph 2024-09-11T01:01:11.350 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/372 2024-09-11T01:01:11.350 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/372 2024-09-11T01:01:11.350 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T01:01:11.358 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T01:01:11.730 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T01:01:11.730 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/373) 2024-09-11T01:01:11.906 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T01:01:11.910 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T01:01:11.911 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T01:01:11.912 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T01:01:11.912 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T01:01:12.252 INFO:teuthology.orchestra.run.smithi092.stdout:generic/373 [not run] Reflink not supported by scratch filesystem type: ceph 2024-09-11T01:01:12.267 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/373 2024-09-11T01:01:12.267 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/373 2024-09-11T01:01:12.267 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T01:01:12.277 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T01:01:12.689 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T01:01:12.689 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/374) 2024-09-11T01:01:12.866 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T01:01:12.870 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T01:01:12.870 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T01:01:12.871 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T01:01:12.871 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T01:01:13.178 INFO:teuthology.orchestra.run.smithi092.stdout:generic/374 [not run] Dedupe not supported by scratch filesystem type: ceph 2024-09-11T01:01:13.237 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/374 2024-09-11T01:01:13.237 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/374 2024-09-11T01:01:13.237 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T01:01:13.242 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T01:01:13.646 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T01:01:13.646 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/375) 2024-09-11T01:01:13.823 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T01:01:13.827 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T01:01:13.827 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T01:01:13.828 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T01:01:13.829 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T01:01:14.109 INFO:teuthology.orchestra.run.smithi092.stdout:generic/375 1s 2024-09-11T01:01:14.115 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/375 2024-09-11T01:01:14.115 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T01:01:14.117 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T01:01:14.186 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T01:01:14.187 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/376) 2024-09-11T01:01:14.639 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T01:01:14.643 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T01:01:14.643 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T01:01:14.644 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T01:01:14.645 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T01:01:14.866 INFO:teuthology.orchestra.run.smithi092.stdout:generic/376 [not run] require 172.21.15.92:6789:/scratch to be valid block disk 2024-09-11T01:01:14.871 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/376 2024-09-11T01:01:14.871 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/376 2024-09-11T01:01:14.871 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T01:01:14.874 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T01:01:14.886 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T01:01:14.886 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/377) 2024-09-11T01:01:15.063 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T01:01:15.068 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T01:01:15.068 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T01:01:15.068 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T01:01:15.068 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T01:01:15.397 INFO:teuthology.orchestra.run.smithi092.stdout:generic/377 0s 2024-09-11T01:01:15.403 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/377 2024-09-11T01:01:15.403 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T01:01:15.405 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T01:01:15.414 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T01:01:15.414 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/378) 2024-09-11T01:01:15.608 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T01:01:15.611 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T01:01:15.612 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T01:01:15.613 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T01:01:15.613 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T01:01:16.024 INFO:teuthology.orchestra.run.smithi092.stdout:generic/378 1s 2024-09-11T01:01:16.030 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/378 2024-09-11T01:01:16.031 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T01:01:16.033 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T01:01:16.099 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T01:01:16.099 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/379) 2024-09-11T01:01:16.570 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T01:01:16.574 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T01:01:16.574 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T01:01:16.575 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T01:01:16.575 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T01:01:16.785 INFO:teuthology.orchestra.run.smithi092.stdout:generic/379 [not run] disk quotas not supported by this filesystem type: ceph 2024-09-11T01:01:16.790 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/379 2024-09-11T01:01:16.790 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/379 2024-09-11T01:01:16.790 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T01:01:16.792 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T01:01:16.804 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T01:01:16.804 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/380) 2024-09-11T01:01:16.985 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T01:01:16.989 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T01:01:16.989 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T01:01:16.990 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T01:01:16.990 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T01:01:17.200 INFO:teuthology.orchestra.run.smithi092.stdout:generic/380 [not run] disk quotas not supported by this filesystem type: ceph 2024-09-11T01:01:17.205 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/380 2024-09-11T01:01:17.205 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/380 2024-09-11T01:01:17.205 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T01:01:17.208 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T01:01:17.231 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T01:01:17.232 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/381) 2024-09-11T01:01:17.408 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T01:01:17.412 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T01:01:17.413 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T01:01:17.414 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T01:01:17.414 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T01:01:17.621 INFO:teuthology.orchestra.run.smithi092.stdout:generic/381 [not run] disk quotas not supported by this filesystem type: ceph 2024-09-11T01:01:17.626 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/381 2024-09-11T01:01:17.626 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/381 2024-09-11T01:01:17.626 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T01:01:17.628 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T01:01:17.640 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T01:01:17.640 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/382) 2024-09-11T01:01:17.820 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T01:01:17.824 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T01:01:17.824 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T01:01:17.825 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T01:01:17.826 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T01:01:18.034 INFO:teuthology.orchestra.run.smithi092.stdout:generic/382 [not run] disk quotas not supported by this filesystem type: ceph 2024-09-11T01:01:18.039 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/382 2024-09-11T01:01:18.039 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/382 2024-09-11T01:01:18.039 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T01:01:18.041 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T01:01:18.053 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T01:01:18.054 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/383) 2024-09-11T01:01:18.225 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T01:01:18.229 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T01:01:18.229 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T01:01:18.230 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T01:01:18.230 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T01:01:18.440 INFO:teuthology.orchestra.run.smithi092.stdout:generic/383 [not run] disk quotas not supported by this filesystem type: ceph 2024-09-11T01:01:18.445 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/383 2024-09-11T01:01:18.445 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/383 2024-09-11T01:01:18.445 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T01:01:18.447 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T01:01:18.460 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T01:01:18.460 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/384) 2024-09-11T01:01:18.645 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T01:01:18.649 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T01:01:18.650 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T01:01:18.651 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T01:01:18.651 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T01:01:18.859 INFO:teuthology.orchestra.run.smithi092.stdout:generic/384 [not run] disk quotas not supported by this filesystem type: ceph 2024-09-11T01:01:18.864 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/384 2024-09-11T01:01:18.864 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/384 2024-09-11T01:01:18.864 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T01:01:18.866 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T01:01:18.893 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T01:01:18.894 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/385) 2024-09-11T01:01:19.073 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T01:01:19.077 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T01:01:19.077 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T01:01:19.078 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T01:01:19.078 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T01:01:19.290 INFO:teuthology.orchestra.run.smithi092.stdout:generic/385 [not run] disk quotas not supported by this filesystem type: ceph 2024-09-11T01:01:19.295 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/385 2024-09-11T01:01:19.295 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/385 2024-09-11T01:01:19.295 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T01:01:19.297 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T01:01:19.310 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T01:01:19.310 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/386) 2024-09-11T01:01:19.496 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T01:01:19.500 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T01:01:19.502 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T01:01:19.502 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T01:01:19.503 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T01:01:19.701 INFO:teuthology.orchestra.run.smithi092.stdout:generic/386 [not run] disk quotas not supported by this filesystem type: ceph 2024-09-11T01:01:19.706 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/386 2024-09-11T01:01:19.707 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/386 2024-09-11T01:01:19.707 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T01:01:19.709 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T01:01:19.721 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T01:01:19.721 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/387) 2024-09-11T01:01:19.904 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T01:01:19.908 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T01:01:19.909 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T01:01:19.909 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T01:01:19.909 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T01:01:20.256 INFO:teuthology.orchestra.run.smithi092.stdout:generic/387 [not run] Reflink not supported by scratch filesystem type: ceph 2024-09-11T01:01:20.266 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/387 2024-09-11T01:01:20.266 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/387 2024-09-11T01:01:20.266 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T01:01:20.277 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T01:01:20.662 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T01:01:20.662 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/388) 2024-09-11T01:01:20.839 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T01:01:20.843 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T01:01:20.843 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T01:01:20.844 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T01:01:20.844 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T01:01:21.068 INFO:teuthology.orchestra.run.smithi092.stdout:generic/388 [not run] require 172.21.15.92:6789:/scratch to be local device 2024-09-11T01:01:21.073 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/388 2024-09-11T01:01:21.073 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/388 2024-09-11T01:01:21.073 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T01:01:21.076 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T01:01:21.088 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T01:01:21.089 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/389) 2024-09-11T01:01:21.265 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T01:01:21.268 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T01:01:21.269 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T01:01:21.270 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T01:01:21.270 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T01:01:21.483 INFO:teuthology.orchestra.run.smithi092.stdout:generic/389 [not run] O_TMPFILE is not supported 2024-09-11T01:01:21.488 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/389 2024-09-11T01:01:21.488 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/389 2024-09-11T01:01:21.488 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T01:01:21.490 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T01:01:21.504 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T01:01:21.504 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/390) 2024-09-11T01:01:21.686 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T01:01:21.691 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T01:01:21.691 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T01:01:21.692 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T01:01:21.692 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T01:01:21.943 INFO:teuthology.orchestra.run.smithi092.stdout:generic/390 [not run] ceph does not support freezing 2024-09-11T01:01:21.948 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/390 2024-09-11T01:01:21.948 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/390 2024-09-11T01:01:21.948 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T01:01:21.950 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T01:01:21.963 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T01:01:21.963 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/391) 2024-09-11T01:01:22.146 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T01:01:22.150 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T01:01:22.150 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T01:01:22.151 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T01:01:22.151 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T01:01:22.372 INFO:teuthology.orchestra.run.smithi092.stdout:generic/391 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-09-11T01:01:22.377 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/391 2024-09-11T01:01:22.377 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/391 2024-09-11T01:01:22.377 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T01:01:22.380 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T01:01:22.405 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T01:01:22.405 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/392) 2024-09-11T01:01:22.595 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T01:01:22.599 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T01:01:22.599 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T01:01:22.600 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T01:01:22.600 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T01:01:22.878 INFO:teuthology.orchestra.run.smithi092.stdout:generic/392 [not run] ceph does not support shutdown 2024-09-11T01:01:22.886 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/392 2024-09-11T01:01:22.887 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/392 2024-09-11T01:01:22.887 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T01:01:22.889 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T01:01:22.915 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T01:01:22.915 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/393) 2024-09-11T01:01:23.096 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T01:01:23.100 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T01:01:23.100 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T01:01:23.101 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T01:01:23.101 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T01:01:23.695 INFO:teuthology.orchestra.run.smithi092.stdout:generic/393 0s 2024-09-11T01:01:23.702 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/393 2024-09-11T01:01:23.702 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T01:01:23.704 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T01:01:23.713 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T01:01:23.713 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/394) 2024-09-11T01:01:23.891 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T01:01:23.895 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T01:01:23.895 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T01:01:23.896 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T01:01:23.896 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T01:01:24.138 INFO:teuthology.orchestra.run.smithi092.stdout:generic/394 1s 2024-09-11T01:01:24.144 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/394 2024-09-11T01:01:24.145 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T01:01:24.147 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T01:01:24.208 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T01:01:24.208 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/395) 2024-09-11T01:01:24.700 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T01:01:24.702 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T01:01:24.703 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T01:01:24.704 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T01:01:24.704 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T01:01:25.113 INFO:teuthology.orchestra.run.smithi092.stdout:generic/395 [not run] kernel does not support ceph encryption 2024-09-11T01:01:25.131 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/395 2024-09-11T01:01:25.131 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/395 2024-09-11T01:01:25.132 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T01:01:25.134 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T01:01:25.149 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T01:01:25.150 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/396) 2024-09-11T01:01:25.377 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T01:01:25.383 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T01:01:25.383 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T01:01:25.386 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T01:01:25.386 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T01:01:25.805 INFO:teuthology.orchestra.run.smithi092.stdout:generic/396 [not run] kernel does not support ceph encryption 2024-09-11T01:01:25.817 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/396 2024-09-11T01:01:25.817 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/396 2024-09-11T01:01:25.818 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T01:01:25.819 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T01:01:25.833 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T01:01:25.833 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/397) 2024-09-11T01:01:26.022 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T01:01:26.026 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T01:01:26.026 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T01:01:26.027 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T01:01:26.027 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T01:01:26.357 INFO:teuthology.orchestra.run.smithi092.stdout:generic/397 [not run] kernel does not support ceph encryption 2024-09-11T01:01:26.366 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/397 2024-09-11T01:01:26.366 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/397 2024-09-11T01:01:26.366 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T01:01:26.368 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T01:01:26.392 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T01:01:26.392 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/398) 2024-09-11T01:01:26.571 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T01:01:26.576 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T01:01:26.576 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T01:01:26.577 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T01:01:26.577 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T01:01:26.901 INFO:teuthology.orchestra.run.smithi092.stdout:generic/398 [not run] kernel does not support ceph encryption 2024-09-11T01:01:26.909 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/398 2024-09-11T01:01:26.910 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/398 2024-09-11T01:01:26.910 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T01:01:26.912 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T01:01:26.940 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T01:01:26.941 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/399) 2024-09-11T01:01:27.127 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T01:01:27.131 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T01:01:27.131 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T01:01:27.132 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T01:01:27.132 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T01:01:27.452 INFO:teuthology.orchestra.run.smithi092.stdout:generic/399 [not run] kernel does not support ceph encryption 2024-09-11T01:01:27.476 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/399 2024-09-11T01:01:27.477 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/399 2024-09-11T01:01:27.477 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T01:01:27.479 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T01:01:27.491 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T01:01:27.492 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/400) 2024-09-11T01:01:27.675 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T01:01:27.679 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T01:01:27.679 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T01:01:27.680 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T01:01:27.680 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T01:01:27.882 INFO:teuthology.orchestra.run.smithi092.stdout:generic/400 [not run] disk quotas not supported by this filesystem type: ceph 2024-09-11T01:01:27.887 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/400 2024-09-11T01:01:27.887 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/400 2024-09-11T01:01:27.888 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T01:01:27.889 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T01:01:27.912 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T01:01:27.913 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/401) 2024-09-11T01:01:28.098 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T01:01:28.102 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T01:01:28.102 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T01:01:28.103 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T01:01:28.103 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T01:01:28.510 INFO:teuthology.orchestra.run.smithi092.stdout:generic/401 0s 2024-09-11T01:01:28.524 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/401 2024-09-11T01:01:28.524 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T01:01:28.529 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T01:01:28.549 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T01:01:28.550 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/402) 2024-09-11T01:01:28.910 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T01:01:28.914 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T01:01:28.915 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T01:01:28.916 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T01:01:28.916 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T01:01:29.213 INFO:teuthology.orchestra.run.smithi092.stdout:generic/402 [not run] filesystem ceph timestamp bounds are unknown 2024-09-11T01:01:29.221 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/402 2024-09-11T01:01:29.221 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/402 2024-09-11T01:01:29.221 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T01:01:29.223 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T01:01:29.235 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T01:01:29.236 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/403) 2024-09-11T01:01:29.419 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T01:01:29.423 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T01:01:29.423 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T01:01:29.424 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T01:01:29.424 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T01:01:29.881 INFO:teuthology.orchestra.run.smithi092.stdout:generic/403 0s 2024-09-11T01:01:29.887 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/403 2024-09-11T01:01:29.887 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T01:01:29.890 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T01:01:29.898 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T01:01:29.898 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/404) 2024-09-11T01:01:30.076 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T01:01:30.080 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T01:01:30.080 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T01:01:30.081 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T01:01:30.081 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T01:01:30.302 INFO:teuthology.orchestra.run.smithi092.stdout:generic/404 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-09-11T01:01:30.307 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/404 2024-09-11T01:01:30.307 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/404 2024-09-11T01:01:30.307 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T01:01:30.309 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T01:01:30.325 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T01:01:30.325 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/405) 2024-09-11T01:01:30.506 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T01:01:30.510 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T01:01:30.511 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T01:01:30.512 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T01:01:30.512 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T01:01:30.756 INFO:teuthology.orchestra.run.smithi092.stdout:generic/405 [not run] require 172.21.15.92:6789:/scratch to be valid block disk 2024-09-11T01:01:30.761 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/405 2024-09-11T01:01:30.761 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/405 2024-09-11T01:01:30.761 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T01:01:30.764 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T01:01:30.776 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T01:01:30.776 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/406) 2024-09-11T01:01:30.963 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T01:01:30.967 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T01:01:30.967 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T01:01:30.968 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T01:01:30.969 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T01:01:32.541 INFO:teuthology.orchestra.run.smithi092.stdout:generic/406 1s 2024-09-11T01:01:32.547 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/406 2024-09-11T01:01:32.547 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T01:01:32.549 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T01:01:32.558 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T01:01:32.559 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/407) 2024-09-11T01:01:32.737 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T01:01:32.741 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T01:01:32.741 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T01:01:32.742 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T01:01:32.742 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T01:01:32.987 INFO:teuthology.orchestra.run.smithi092.stdout:generic/407 [not run] Reflink not supported by test filesystem type: ceph 2024-09-11T01:01:32.992 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/407 2024-09-11T01:01:32.992 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/407 2024-09-11T01:01:32.992 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T01:01:32.995 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T01:01:33.056 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T01:01:33.057 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/408) 2024-09-11T01:01:33.487 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T01:01:33.492 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T01:01:33.492 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T01:01:33.493 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T01:01:33.493 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T01:01:33.742 INFO:teuthology.orchestra.run.smithi092.stdout:generic/408 [not run] Dedupe not supported by test filesystem type: ceph 2024-09-11T01:01:33.747 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/408 2024-09-11T01:01:33.747 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/408 2024-09-11T01:01:33.747 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T01:01:33.749 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T01:01:33.811 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T01:01:33.811 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/409) 2024-09-11T01:01:34.208 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T01:01:34.213 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T01:01:34.213 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T01:01:34.213 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T01:01:34.213 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T01:01:34.424 INFO:teuthology.orchestra.run.smithi092.stdout:generic/409 [not run] require 172.21.15.92:6789:/scratch to be local device 2024-09-11T01:01:34.428 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/409 2024-09-11T01:01:34.428 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/409 2024-09-11T01:01:34.429 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T01:01:34.431 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T01:01:34.443 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T01:01:34.444 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/410) 2024-09-11T01:01:34.621 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T01:01:34.625 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T01:01:34.626 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T01:01:34.627 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T01:01:34.627 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T01:01:34.840 INFO:teuthology.orchestra.run.smithi092.stdout:generic/410 [not run] require 172.21.15.92:6789:/scratch to be local device 2024-09-11T01:01:34.844 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/410 2024-09-11T01:01:34.844 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/410 2024-09-11T01:01:34.845 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T01:01:34.847 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T01:01:34.859 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T01:01:34.859 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/411) 2024-09-11T01:01:35.045 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T01:01:35.049 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T01:01:35.049 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T01:01:35.050 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T01:01:35.050 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T01:01:35.267 INFO:teuthology.orchestra.run.smithi092.stdout:generic/411 [not run] require 172.21.15.92:6789:/scratch to be local device 2024-09-11T01:01:35.271 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/411 2024-09-11T01:01:35.272 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/411 2024-09-11T01:01:35.272 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T01:01:35.274 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T01:01:35.286 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T01:01:35.286 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/412) 2024-09-11T01:01:35.466 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T01:01:35.470 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T01:01:35.470 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T01:01:35.471 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T01:01:35.471 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T01:01:35.919 INFO:teuthology.orchestra.run.smithi092.stdout:generic/412 0s 2024-09-11T01:01:35.937 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/412 2024-09-11T01:01:35.937 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T01:01:35.939 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T01:01:35.948 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T01:01:35.948 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/413) 2024-09-11T01:01:36.128 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T01:01:36.132 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T01:01:36.133 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T01:01:36.134 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T01:01:36.134 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T01:01:36.412 INFO:teuthology.orchestra.run.smithi092.stdout:generic/413 [not run] mount 172.21.15.92:6789:/scratch with dax failed 2024-09-11T01:01:36.417 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/413 2024-09-11T01:01:36.417 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/413 2024-09-11T01:01:36.417 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T01:01:36.419 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T01:01:36.433 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T01:01:36.433 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/414) 2024-09-11T01:01:36.612 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T01:01:36.616 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T01:01:36.617 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T01:01:36.618 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T01:01:36.618 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T01:01:36.963 INFO:teuthology.orchestra.run.smithi092.stdout:generic/414 [not run] Reflink not supported by scratch filesystem type: ceph 2024-09-11T01:01:36.981 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/414 2024-09-11T01:01:36.985 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/414 2024-09-11T01:01:36.985 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T01:01:36.988 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T01:01:37.339 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T01:01:37.339 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/415) 2024-09-11T01:01:37.515 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T01:01:37.519 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T01:01:37.519 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T01:01:37.520 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T01:01:37.521 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T01:01:37.874 INFO:teuthology.orchestra.run.smithi092.stdout:generic/415 [not run] Reflink not supported by scratch filesystem type: ceph 2024-09-11T01:01:37.890 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/415 2024-09-11T01:01:37.891 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/415 2024-09-11T01:01:37.891 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T01:01:37.899 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T01:01:38.238 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T01:01:38.238 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/416) 2024-09-11T01:01:38.421 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T01:01:38.424 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T01:01:38.425 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T01:01:38.426 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T01:01:38.426 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T01:01:38.656 INFO:teuthology.orchestra.run.smithi092.stdout:generic/416 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2024-09-11T01:01:38.661 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/416 2024-09-11T01:01:38.662 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/416 2024-09-11T01:01:38.662 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T01:01:38.664 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T01:01:38.677 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T01:01:38.678 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/417) 2024-09-11T01:01:38.856 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T01:01:38.860 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T01:01:38.860 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T01:01:38.861 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T01:01:38.861 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T01:01:39.139 INFO:teuthology.orchestra.run.smithi092.stdout:generic/417 [not run] ceph does not support shutdown 2024-09-11T01:01:39.148 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/417 2024-09-11T01:01:39.148 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/417 2024-09-11T01:01:39.148 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T01:01:39.150 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T01:01:39.177 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T01:01:39.178 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/418) 2024-09-11T01:01:39.359 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T01:01:39.363 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T01:01:39.363 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T01:01:39.364 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T01:01:39.365 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T01:01:39.611 INFO:teuthology.orchestra.run.smithi092.stdout:generic/418 [not run] require 172.21.15.92:6789:/test to be valid block disk 2024-09-11T01:01:39.616 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/418 2024-09-11T01:01:39.616 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/418 2024-09-11T01:01:39.616 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T01:01:39.619 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T01:01:39.634 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T01:01:39.634 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/419) 2024-09-11T01:01:39.818 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T01:01:39.822 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T01:01:39.822 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T01:01:39.823 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T01:01:39.823 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T01:01:40.148 INFO:teuthology.orchestra.run.smithi092.stdout:generic/419 [not run] kernel does not support ceph encryption 2024-09-11T01:01:40.189 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/419 2024-09-11T01:01:40.190 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/419 2024-09-11T01:01:40.190 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T01:01:40.190 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T01:01:40.190 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T01:01:40.190 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/420) 2024-09-11T01:01:40.369 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T01:01:40.372 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T01:01:40.373 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T01:01:40.374 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T01:01:40.374 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T01:01:40.704 INFO:teuthology.orchestra.run.smithi092.stdout:generic/420 0s 2024-09-11T01:01:40.710 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/420 2024-09-11T01:01:40.710 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T01:01:40.713 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T01:01:40.770 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T01:01:40.771 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/421) 2024-09-11T01:01:41.170 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T01:01:41.174 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T01:01:41.174 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T01:01:41.175 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T01:01:41.175 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T01:01:41.504 INFO:teuthology.orchestra.run.smithi092.stdout:generic/421 [not run] kernel does not support ceph encryption 2024-09-11T01:01:41.513 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/421 2024-09-11T01:01:41.513 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/421 2024-09-11T01:01:41.513 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T01:01:41.516 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T01:01:41.527 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T01:01:41.528 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/422) 2024-09-11T01:01:41.710 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T01:01:41.714 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T01:01:41.715 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T01:01:41.715 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T01:01:41.715 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T01:01:41.940 INFO:teuthology.orchestra.run.smithi092.stdout:generic/422 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2024-09-11T01:01:41.945 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/422 2024-09-11T01:01:41.945 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/422 2024-09-11T01:01:41.945 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T01:01:41.947 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T01:01:41.963 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T01:01:41.963 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/423) 2024-09-11T01:01:42.139 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T01:01:42.143 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T01:01:42.143 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T01:01:42.144 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T01:01:42.144 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T01:01:42.454 INFO:teuthology.orchestra.run.smithi092.stdout:generic/423 0s 2024-09-11T01:01:42.460 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/423 2024-09-11T01:01:42.460 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T01:01:42.462 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T01:01:42.531 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T01:01:42.531 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/424) 2024-09-11T01:01:42.918 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T01:01:42.922 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T01:01:42.922 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T01:01:42.923 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T01:01:42.923 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T01:01:43.156 INFO:teuthology.orchestra.run.smithi092.stdout:generic/424 [not run] file system doesn't support any of /bin/chattr +a/+c/+d/+i 2024-09-11T01:01:43.160 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/424 2024-09-11T01:01:43.161 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/424 2024-09-11T01:01:43.161 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T01:01:43.163 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T01:01:43.179 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T01:01:43.179 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/425) 2024-09-11T01:01:43.357 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T01:01:43.361 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T01:01:43.361 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T01:01:43.362 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T01:01:43.363 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T01:01:43.614 INFO:teuthology.orchestra.run.smithi092.stdout:generic/425 [not run] xfs_io fiemap -a failed (old kernel/wrong fs?) 2024-09-11T01:01:43.619 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/425 2024-09-11T01:01:43.619 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/425 2024-09-11T01:01:43.619 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T01:01:43.621 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T01:01:43.699 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T01:01:43.699 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/426) 2024-09-11T01:01:44.068 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T01:01:44.072 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T01:01:44.072 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T01:01:44.073 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T01:01:44.073 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T01:02:02.852 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T01:02:02.855 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T01:02:04.639 INFO:tasks.ceph.mds.c.smithi092.stderr:2024-09-11T01:02:04.637+0000 7f6970484640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 350197) UID: 0 2024-09-11T01:02:04.639 INFO:tasks.ceph.mds.a.smithi092.stderr:2024-09-11T01:02:04.637+0000 7fab43790640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 350197) UID: 0 2024-09-11T01:02:15.753 INFO:teuthology.orchestra.run.smithi092.stdout:generic/426 31s 2024-09-11T01:02:15.957 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/426 2024-09-11T01:02:15.957 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T01:02:15.959 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T01:02:16.290 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T01:02:16.291 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/427) 2024-09-11T01:02:18.717 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T01:02:18.722 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T01:02:18.722 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T01:02:18.723 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T01:02:18.723 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T01:02:19.455 INFO:teuthology.orchestra.run.smithi092.stdout:generic/427 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2024-09-11T01:02:19.460 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/427 2024-09-11T01:02:19.460 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/427 2024-09-11T01:02:19.460 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T01:02:19.462 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T01:02:19.478 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T01:02:19.478 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/428) 2024-09-11T01:02:19.653 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T01:02:19.656 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T01:02:19.657 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T01:02:19.658 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T01:02:19.658 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T01:02:19.925 INFO:teuthology.orchestra.run.smithi092.stdout:generic/428 0s 2024-09-11T01:02:19.939 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/428 2024-09-11T01:02:19.939 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T01:02:19.941 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T01:02:19.960 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T01:02:19.960 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/429) 2024-09-11T01:02:20.150 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T01:02:20.153 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T01:02:20.154 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T01:02:20.155 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T01:02:20.155 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T01:02:20.478 INFO:teuthology.orchestra.run.smithi092.stdout:generic/429 [not run] kernel does not support ceph encryption 2024-09-11T01:02:20.487 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/429 2024-09-11T01:02:20.487 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/429 2024-09-11T01:02:20.487 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T01:02:20.489 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T01:02:20.502 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T01:02:20.502 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/430) 2024-09-11T01:02:20.700 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T01:02:20.704 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T01:02:20.704 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T01:02:20.705 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T01:02:20.705 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T01:02:21.062 INFO:teuthology.orchestra.run.smithi092.stdout:generic/430 1s 2024-09-11T01:02:21.068 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/430 2024-09-11T01:02:21.068 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T01:02:21.071 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T01:02:21.132 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T01:02:21.133 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/431) 2024-09-11T01:02:21.571 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T01:02:21.575 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T01:02:21.575 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T01:02:21.576 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T01:02:21.576 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T01:02:21.873 INFO:teuthology.orchestra.run.smithi092.stdout:generic/431 0s 2024-09-11T01:02:21.880 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/431 2024-09-11T01:02:21.880 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T01:02:21.882 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T01:02:21.948 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T01:02:21.948 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/432) 2024-09-11T01:02:22.348 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T01:02:22.352 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T01:02:22.353 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T01:02:22.354 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T01:02:22.354 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T01:02:22.652 INFO:teuthology.orchestra.run.smithi092.stdout:generic/432 0s 2024-09-11T01:02:22.658 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/432 2024-09-11T01:02:22.658 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T01:02:22.660 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T01:02:22.731 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T01:02:22.731 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/433) 2024-09-11T01:02:23.192 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T01:02:23.196 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T01:02:23.196 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T01:02:23.197 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T01:02:23.198 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T01:02:23.480 INFO:teuthology.orchestra.run.smithi092.stdout:generic/433 0s 2024-09-11T01:02:23.486 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/433 2024-09-11T01:02:23.486 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T01:02:23.489 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T01:02:23.568 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T01:02:23.568 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/434) 2024-09-11T01:02:23.995 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T01:02:23.999 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T01:02:23.999 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T01:02:24.000 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T01:02:24.000 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T01:02:24.309 INFO:teuthology.orchestra.run.smithi092.stdout:generic/434 0s 2024-09-11T01:02:24.316 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/434 2024-09-11T01:02:24.316 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T01:02:24.318 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T01:02:24.384 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T01:02:24.385 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/435) 2024-09-11T01:02:24.840 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T01:02:24.844 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T01:02:24.844 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T01:02:24.845 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T01:02:24.845 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T01:02:25.168 INFO:teuthology.orchestra.run.smithi092.stdout:generic/435 [not run] kernel does not support ceph encryption 2024-09-11T01:02:25.176 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/435 2024-09-11T01:02:25.176 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/435 2024-09-11T01:02:25.176 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T01:02:25.178 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T01:02:25.191 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T01:02:25.191 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/436) 2024-09-11T01:02:25.374 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T01:02:25.378 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T01:02:25.378 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T01:02:25.379 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T01:02:25.379 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T01:02:25.874 INFO:teuthology.orchestra.run.smithi092.stdout:generic/436 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-09-11T01:02:25.879 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/436 2024-09-11T01:02:25.879 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/436 2024-09-11T01:02:25.879 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T01:02:25.882 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T01:02:25.942 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T01:02:25.942 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/437) 2024-09-11T01:02:26.381 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T01:02:26.385 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T01:02:26.385 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T01:02:26.386 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T01:02:26.386 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T01:02:27.233 INFO:teuthology.orchestra.run.smithi092.stdout:generic/437 1s 2024-09-11T01:02:27.239 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/437 2024-09-11T01:02:27.239 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T01:02:27.242 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T01:02:27.260 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T01:02:27.260 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/438) 2024-09-11T01:02:27.440 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T01:02:27.444 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T01:02:27.444 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T01:02:27.445 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T01:02:27.446 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T01:03:34.794 INFO:teuthology.orchestra.run.smithi092.stdout:generic/438 67s 2024-09-11T01:03:34.799 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/438 2024-09-11T01:03:34.800 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T01:03:34.802 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T01:03:34.820 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T01:03:34.822 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/439) 2024-09-11T01:03:35.006 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T01:03:35.010 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T01:03:35.011 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T01:03:35.011 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T01:03:35.011 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T01:03:35.897 INFO:teuthology.orchestra.run.smithi092.stdout:generic/439 0s 2024-09-11T01:03:35.903 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/439 2024-09-11T01:03:35.903 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T01:03:35.905 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T01:03:35.919 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T01:03:35.919 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/440) 2024-09-11T01:03:36.126 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T01:03:36.130 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T01:03:36.130 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T01:03:36.131 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T01:03:36.131 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T01:03:36.466 INFO:teuthology.orchestra.run.smithi092.stdout:generic/440 [not run] kernel does not support ceph encryption 2024-09-11T01:03:36.476 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/440 2024-09-11T01:03:36.476 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/440 2024-09-11T01:03:36.476 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T01:03:36.478 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T01:03:36.491 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T01:03:36.492 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/441) 2024-09-11T01:03:36.676 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T01:03:36.679 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T01:03:36.680 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T01:03:36.681 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T01:03:36.681 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T01:03:37.019 INFO:teuthology.orchestra.run.smithi092.stdout:generic/441 [not run] require 172.21.15.92:6789:/scratch to be valid block disk 2024-09-11T01:03:37.023 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/441 2024-09-11T01:03:37.024 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/441 2024-09-11T01:03:37.024 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T01:03:37.026 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T01:03:37.043 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T01:03:37.044 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/442) 2024-09-11T01:03:37.228 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T01:03:37.232 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T01:03:37.232 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T01:03:37.233 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T01:03:37.233 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T01:03:37.483 INFO:teuthology.orchestra.run.smithi092.stdout:generic/442 [not run] require 172.21.15.92:6789:/scratch to be valid block disk 2024-09-11T01:03:37.487 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/442 2024-09-11T01:03:37.487 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/442 2024-09-11T01:03:37.487 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T01:03:37.490 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T01:03:37.503 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T01:03:37.503 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/443) 2024-09-11T01:03:37.685 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T01:03:37.689 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T01:03:37.689 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T01:03:37.690 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T01:03:37.690 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T01:03:37.944 INFO:teuthology.orchestra.run.smithi092.stdout:generic/443 0s 2024-09-11T01:03:37.950 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/443 2024-09-11T01:03:37.950 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T01:03:37.952 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T01:03:37.974 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T01:03:37.974 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/444) 2024-09-11T01:03:38.150 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T01:03:38.154 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T01:03:38.155 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T01:03:38.156 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T01:03:38.156 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T01:03:38.459 INFO:teuthology.orchestra.run.smithi092.stdout:generic/444 0s 2024-09-11T01:03:38.466 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/444 2024-09-11T01:03:38.466 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T01:03:38.468 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T01:03:38.491 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T01:03:38.491 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/445) 2024-09-11T01:03:38.668 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T01:03:38.672 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T01:03:38.672 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T01:03:38.673 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T01:03:38.673 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T01:03:39.240 INFO:teuthology.orchestra.run.smithi092.stdout:generic/445 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-09-11T01:03:39.245 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/445 2024-09-11T01:03:39.245 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/445 2024-09-11T01:03:39.245 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T01:03:39.247 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T01:03:39.289 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T01:03:39.289 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/446) 2024-09-11T01:03:39.713 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T01:03:39.717 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T01:03:39.717 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T01:03:39.718 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T01:03:39.718 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T01:03:54.942 INFO:teuthology.orchestra.run.smithi092.stdout:generic/446 15s 2024-09-11T01:03:54.954 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/446 2024-09-11T01:03:54.954 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T01:03:54.956 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T01:03:54.984 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T01:03:54.984 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/447) 2024-09-11T01:03:55.376 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T01:03:55.380 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T01:03:55.380 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T01:03:55.381 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T01:03:55.381 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T01:03:55.752 INFO:teuthology.orchestra.run.smithi092.stdout:generic/447 [not run] Reflink not supported by scratch filesystem type: ceph 2024-09-11T01:03:55.766 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/447 2024-09-11T01:03:55.766 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/447 2024-09-11T01:03:55.766 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T01:03:55.769 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T01:03:56.040 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T01:03:56.040 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/448) 2024-09-11T01:03:56.254 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T01:03:56.258 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T01:03:56.259 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T01:03:56.260 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T01:03:56.260 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T01:03:57.185 INFO:teuthology.orchestra.run.smithi092.stdout:generic/448 1s 2024-09-11T01:03:57.191 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/448 2024-09-11T01:03:57.191 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T01:03:57.194 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T01:03:57.241 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T01:03:57.241 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/449) 2024-09-11T01:03:57.690 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T01:03:57.693 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T01:03:57.693 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T01:03:57.694 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T01:03:57.694 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T01:03:57.964 INFO:teuthology.orchestra.run.smithi092.stdout:generic/449 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2024-09-11T01:03:57.968 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/449 2024-09-11T01:03:57.968 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/449 2024-09-11T01:03:57.969 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T01:03:57.971 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T01:03:58.029 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T01:03:58.030 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/450) 2024-09-11T01:03:58.476 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T01:03:58.480 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T01:03:58.481 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T01:03:58.481 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T01:03:58.481 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T01:03:59.105 INFO:teuthology.orchestra.run.smithi092.stdout:generic/450 1s 2024-09-11T01:03:59.112 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/450 2024-09-11T01:03:59.112 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T01:03:59.115 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T01:03:59.161 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T01:03:59.162 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/451) 2024-09-11T01:03:59.598 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T01:03:59.602 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T01:03:59.602 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T01:03:59.603 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T01:03:59.603 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T01:04:29.931 INFO:teuthology.orchestra.run.smithi092.stdout:generic/451 30s 2024-09-11T01:04:29.938 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/451 2024-09-11T01:04:29.938 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T01:04:29.940 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T01:04:29.991 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T01:04:29.991 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/452) 2024-09-11T01:04:30.440 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T01:04:30.443 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T01:04:30.444 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T01:04:30.445 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T01:04:30.445 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T01:04:30.834 INFO:teuthology.orchestra.run.smithi092.stdout:generic/452 0s 2024-09-11T01:04:30.840 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/452 2024-09-11T01:04:30.841 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T01:04:30.843 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T01:04:30.851 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T01:04:30.851 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/453) 2024-09-11T01:04:31.035 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T01:04:31.039 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T01:04:31.039 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T01:04:31.040 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T01:04:31.040 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T01:04:31.262 INFO:teuthology.orchestra.run.smithi092.stdout:generic/453 [not run] ceph does not allow unrestricted byte streams for names 2024-09-11T01:04:31.267 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/453 2024-09-11T01:04:31.267 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/453 2024-09-11T01:04:31.267 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T01:04:31.269 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T01:04:31.283 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T01:04:31.283 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/454) 2024-09-11T01:04:31.466 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T01:04:31.470 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T01:04:31.470 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T01:04:31.471 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T01:04:31.471 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T01:04:31.698 INFO:teuthology.orchestra.run.smithi092.stdout:generic/454 [not run] ceph does not allow unrestricted byte streams for names 2024-09-11T01:04:31.703 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/454 2024-09-11T01:04:31.703 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/454 2024-09-11T01:04:31.703 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T01:04:31.706 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T01:04:31.725 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T01:04:31.726 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/455) 2024-09-11T01:04:31.906 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T01:04:31.910 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T01:04:31.910 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T01:04:31.911 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T01:04:31.911 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T01:04:32.207 INFO:teuthology.orchestra.run.smithi092.stdout:generic/455 [not run] This test requires a valid $LOGWRITES_DEV 2024-09-11T01:04:32.212 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/455 2024-09-11T01:04:32.212 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/455 2024-09-11T01:04:32.212 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T01:04:32.216 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T01:04:32.228 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T01:04:32.228 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/456) 2024-09-11T01:04:32.405 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T01:04:32.409 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T01:04:32.409 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T01:04:32.410 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T01:04:32.410 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T01:04:32.649 INFO:teuthology.orchestra.run.smithi092.stdout:generic/456 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-09-11T01:04:32.654 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/456 2024-09-11T01:04:32.654 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/456 2024-09-11T01:04:32.654 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T01:04:32.656 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T01:04:32.674 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T01:04:32.674 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/457) 2024-09-11T01:04:32.852 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T01:04:32.856 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T01:04:32.857 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T01:04:32.858 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T01:04:32.858 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T01:04:33.359 INFO:teuthology.orchestra.run.smithi092.stdout:generic/457 [not run] Reflink not supported by scratch filesystem type: ceph 2024-09-11T01:04:33.370 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/457 2024-09-11T01:04:33.370 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/457 2024-09-11T01:04:33.370 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T01:04:33.386 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T01:04:33.571 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T01:04:33.571 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/458) 2024-09-11T01:04:33.765 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T01:04:33.769 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T01:04:33.769 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T01:04:33.770 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T01:04:33.770 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T01:04:34.128 INFO:teuthology.orchestra.run.smithi092.stdout:generic/458 [not run] Reflink not supported by scratch filesystem type: ceph 2024-09-11T01:04:34.136 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/458 2024-09-11T01:04:34.137 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/458 2024-09-11T01:04:34.139 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T01:04:34.146 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T01:04:34.464 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T01:04:34.465 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/459) 2024-09-11T01:04:34.642 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T01:04:34.645 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T01:04:34.646 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T01:04:34.647 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T01:04:34.647 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T01:04:36.291 INFO:teuthology.orchestra.run.smithi092.stdout:generic/459 [not run] require 172.21.15.92:6789:/scratch to be valid block disk 2024-09-11T01:04:36.297 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/459 2024-09-11T01:04:36.297 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/459 2024-09-11T01:04:36.297 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T01:04:36.300 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T01:04:36.320 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T01:04:36.320 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/460) 2024-09-11T01:04:36.517 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T01:04:36.521 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T01:04:36.522 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T01:04:36.522 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T01:04:36.522 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T01:04:38.279 INFO:teuthology.orchestra.run.smithi092.stdout:generic/460 2s 2024-09-11T01:04:38.285 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/460 2024-09-11T01:04:38.285 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T01:04:38.287 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T01:04:38.297 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T01:04:38.297 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/461) 2024-09-11T01:04:38.478 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T01:04:38.482 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T01:04:38.482 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T01:04:38.483 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T01:04:38.483 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T01:04:38.792 INFO:teuthology.orchestra.run.smithi092.stdout:generic/461 [not run] ceph does not support shutdown 2024-09-11T01:04:38.797 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/461 2024-09-11T01:04:38.797 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/461 2024-09-11T01:04:38.798 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T01:04:38.799 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T01:04:38.813 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T01:04:38.813 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/462) 2024-09-11T01:04:39.111 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T01:04:39.121 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T01:04:39.121 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T01:04:39.122 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T01:04:39.122 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T01:04:39.425 INFO:teuthology.orchestra.run.smithi092.stdout:generic/462 [not run] mount 172.21.15.92:6789:/scratch with dax failed 2024-09-11T01:04:39.430 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/462 2024-09-11T01:04:39.431 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/462 2024-09-11T01:04:39.431 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T01:04:39.433 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T01:04:39.459 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T01:04:39.460 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/463) 2024-09-11T01:04:39.638 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T01:04:39.642 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T01:04:39.642 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T01:04:39.643 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T01:04:39.644 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T01:04:39.902 INFO:teuthology.orchestra.run.smithi092.stdout:generic/463 [not run] Reflink not supported by test filesystem type: ceph 2024-09-11T01:04:39.907 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/463 2024-09-11T01:04:39.907 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/463 2024-09-11T01:04:39.907 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T01:04:39.909 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T01:04:39.970 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T01:04:39.970 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/464) 2024-09-11T01:04:40.412 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T01:04:40.416 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T01:04:40.417 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T01:04:40.418 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T01:04:40.418 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T01:05:36.217 INFO:teuthology.orchestra.run.smithi092.stdout:generic/464 56s 2024-09-11T01:05:36.223 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/464 2024-09-11T01:05:36.223 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T01:05:36.226 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T01:05:36.235 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T01:05:36.235 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/465) 2024-09-11T01:05:36.416 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T01:05:36.420 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T01:05:36.420 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T01:05:36.421 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T01:05:36.421 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T01:05:40.544 INFO:teuthology.orchestra.run.smithi092.stdout:generic/465 4s 2024-09-11T01:05:40.560 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/465 2024-09-11T01:05:40.560 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T01:05:40.564 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T01:05:40.588 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T01:05:40.588 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/466) 2024-09-11T01:05:40.930 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T01:05:40.934 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T01:05:40.935 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T01:05:40.936 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T01:05:40.936 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T01:05:41.166 INFO:teuthology.orchestra.run.smithi092.stdout:generic/466 [not run] require 172.21.15.92:6789:/scratch to be valid block disk 2024-09-11T01:05:41.171 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/466 2024-09-11T01:05:41.171 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/466 2024-09-11T01:05:41.172 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T01:05:41.174 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T01:05:41.187 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T01:05:41.188 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/467) 2024-09-11T01:05:41.366 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T01:05:41.370 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T01:05:41.370 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T01:05:41.371 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T01:05:41.371 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T01:05:47.852 INFO:teuthology.orchestra.run.smithi092.stdout:generic/467 6s 2024-09-11T01:05:47.926 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/467 2024-09-11T01:05:47.927 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T01:05:47.935 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T01:05:48.109 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T01:05:48.109 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/468) 2024-09-11T01:05:49.194 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T01:05:49.198 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T01:05:49.199 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T01:05:49.199 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T01:05:49.199 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T01:05:49.543 INFO:teuthology.orchestra.run.smithi092.stdout:generic/468 [not run] ceph does not support shutdown 2024-09-11T01:05:49.552 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/468 2024-09-11T01:05:49.552 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/468 2024-09-11T01:05:49.552 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T01:05:49.554 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T01:05:49.568 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T01:05:49.569 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/469) 2024-09-11T01:05:49.744 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T01:05:49.748 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T01:05:49.749 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T01:05:49.750 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T01:05:49.750 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T01:05:49.986 INFO:teuthology.orchestra.run.smithi092.stdout:generic/469 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2024-09-11T01:05:49.991 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/469 2024-09-11T01:05:49.991 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/469 2024-09-11T01:05:49.991 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T01:05:49.994 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T01:05:50.012 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T01:05:50.012 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/470) 2024-09-11T01:05:50.199 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T01:05:50.203 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T01:05:50.203 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T01:05:50.204 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T01:05:50.204 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T01:05:50.462 INFO:teuthology.orchestra.run.smithi092.stdout:generic/470 [not run] This test requires a valid $LOGWRITES_DEV 2024-09-11T01:05:50.466 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/470 2024-09-11T01:05:50.467 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/470 2024-09-11T01:05:50.467 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T01:05:50.469 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T01:05:50.482 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T01:05:50.483 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/471) 2024-09-11T01:05:50.662 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T01:05:50.666 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T01:05:50.666 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T01:05:50.667 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T01:05:50.667 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T01:05:51.645 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T01:05:51.647 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T01:06:21.783 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T01:06:21.786 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T01:06:36.490 INFO:teuthology.orchestra.run.smithi092.stdout:generic/471 46s 2024-09-11T01:06:36.500 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/471 2024-09-11T01:06:36.501 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T01:06:36.503 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T01:06:36.664 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T01:06:36.665 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/472) 2024-09-11T01:06:37.142 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T01:06:37.148 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T01:06:37.149 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T01:06:37.150 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T01:06:37.150 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T01:06:37.827 INFO:teuthology.orchestra.run.smithi092.stdout:generic/472 [not run] swapfiles are not supported 2024-09-11T01:06:37.832 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/472 2024-09-11T01:06:37.832 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/472 2024-09-11T01:06:37.833 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T01:06:37.835 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T01:06:37.850 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T01:06:37.850 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/473) 2024-09-11T01:06:38.025 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T01:06:38.029 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T01:06:38.029 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T01:06:38.030 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T01:06:38.031 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T01:06:38.284 INFO:teuthology.orchestra.run.smithi092.stdout:generic/473 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2024-09-11T01:06:38.289 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/473 2024-09-11T01:06:38.289 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/473 2024-09-11T01:06:38.289 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T01:06:38.291 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T01:06:38.308 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T01:06:38.308 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/474) 2024-09-11T01:06:38.485 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T01:06:38.490 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T01:06:38.490 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T01:06:38.490 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T01:06:38.491 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T01:06:38.790 INFO:teuthology.orchestra.run.smithi092.stdout:generic/474 [not run] ceph does not support shutdown 2024-09-11T01:06:38.799 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/474 2024-09-11T01:06:38.799 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/474 2024-09-11T01:06:38.799 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T01:06:38.801 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T01:06:38.814 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T01:06:38.814 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/475) 2024-09-11T01:06:38.996 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T01:06:38.999 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T01:06:38.999 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T01:06:39.000 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T01:06:39.000 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T01:06:39.247 INFO:teuthology.orchestra.run.smithi092.stdout:generic/475 [not run] require 172.21.15.92:6789:/scratch to be valid block disk 2024-09-11T01:06:39.252 INFO:teuthology.orchestra.run.smithi092.stdout:Ran: generic/475 2024-09-11T01:06:39.252 INFO:teuthology.orchestra.run.smithi092.stdout:Not run: generic/475 2024-09-11T01:06:39.252 INFO:teuthology.orchestra.run.smithi092.stdout:Passed all 1 tests 2024-09-11T01:06:39.254 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T01:06:39.267 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-11T01:06:39.267 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/tmp.YVIfjesBePxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/476) 2024-09-11T01:06:39.444 INFO:teuthology.orchestra.run.smithi092.stdout:FSTYP -- ceph 2024-09-11T01:06:39.448 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM -- Linux/x86_64 smithi092 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 2024-09-11T01:06:39.448 INFO:teuthology.orchestra.run.smithi092.stdout:MKFS_OPTIONS -- 172.21.15.92:6789:/scratch 2024-09-11T01:06:39.449 INFO:teuthology.orchestra.run.smithi092.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCd4OBmdyhLNxAACGCX3DIWarOLGrRdT8R8yg== -o context=system_u:object_r:root_t:s0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch 2024-09-11T01:06:39.449 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-11T01:06:52.006 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T01:06:52.010 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T01:07:22.116 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T01:07:22.120 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T01:07:52.589 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T01:07:52.598 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T01:08:23.145 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T01:08:23.151 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T01:08:53.286 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T01:08:53.289 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T01:09:23.396 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T01:09:23.400 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T01:09:53.493 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T01:09:53.496 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T01:09:53.550 INFO:tasks.ceph.osd.2.smithi092.stderr:2024-09-11T01:09:53.548+0000 7f645a187640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 551934) UID: 0 2024-09-11T01:09:53.551 INFO:tasks.ceph.osd.1.smithi092.stderr:2024-09-11T01:09:53.548+0000 7f1c30424640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 551934) UID: 0 2024-09-11T01:09:53.551 INFO:tasks.ceph.osd.0.smithi092.stderr:2024-09-11T01:09:53.549+0000 7f828912d640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 551934) UID: 0 2024-09-11T01:09:53.551 INFO:tasks.ceph.osd.3.smithi092.stderr:2024-09-11T01:09:53.549+0000 7fc700ebf640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 551934) UID: 0 2024-09-11T01:16:00.085 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T01:16:00.088 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T01:16:00.168 INFO:tasks.ceph.osd.7.smithi145.stderr:2024-09-11T01:16:00.167+0000 7f246f6c7640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 48916) UID: 0 2024-09-11T01:16:00.170 INFO:tasks.ceph.osd.4.smithi145.stderr:2024-09-11T01:16:00.168+0000 7f87e7126640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 48916) UID: 0 2024-09-11T01:16:00.172 INFO:tasks.ceph.osd.6.smithi145.stderr:2024-09-11T01:16:00.167+0000 7f12741b6640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 48916) UID: 0 2024-09-11T01:16:00.176 INFO:tasks.ceph.osd.5.smithi145.stderr:2024-09-11T01:16:00.172+0000 7f3a08302640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 48916) UID: 0 2024-09-11T01:16:00.207 INFO:tasks.ceph.osd.3.smithi092.stderr:2024-09-11T01:16:00.202+0000 7fc700ebf640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 552061) UID: 0 2024-09-11T01:16:00.208 INFO:tasks.ceph.osd.2.smithi092.stderr:2024-09-11T01:16:00.204+0000 7f645a187640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 552061) UID: 0 2024-09-11T01:16:00.210 INFO:tasks.ceph.osd.1.smithi092.stderr:2024-09-11T01:16:00.204+0000 7f1c30424640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 552061) UID: 0 2024-09-11T01:16:00.232 INFO:tasks.ceph.osd.0.smithi092.stderr:2024-09-11T01:16:00.202+0000 7f828912d640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 552061) UID: 0 2024-09-11T01:28:35.304 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T01:28:35.308 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T01:28:35.372 INFO:tasks.ceph.osd.6.smithi145.stderr:2024-09-11T01:28:35.370+0000 7f12741b6640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 49025) UID: 0 2024-09-11T01:28:35.374 INFO:tasks.ceph.osd.5.smithi145.stderr:2024-09-11T01:28:35.370+0000 7f3a08302640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 49025) UID: 0 2024-09-11T01:28:35.375 INFO:tasks.ceph.osd.4.smithi145.stderr:2024-09-11T01:28:35.373+0000 7f87e7126640 -1 Fail to open '/proc/49025/cmdline' error = (2) No such file or directory 2024-09-11T01:28:35.375 INFO:tasks.ceph.osd.4.smithi145.stderr:2024-09-11T01:28:35.373+0000 7f87e7126640 -1 received signal: Hangup from (PID: 49025) UID: 0 2024-09-11T01:28:35.382 INFO:tasks.ceph.osd.7.smithi145.stderr:2024-09-11T01:28:35.370+0000 7f246f6c7640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 49025) UID: 0 2024-09-11T01:28:35.404 INFO:tasks.ceph.mds.c.smithi092.stderr:2024-09-11T01:28:35.402+0000 7f6970484640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 552150) UID: 0 2024-09-11T01:28:35.405 INFO:tasks.ceph.mds.a.smithi092.stderr:2024-09-11T01:28:35.403+0000 7fab43790640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 552150) UID: 0 2024-09-11T01:32:42.977 INFO:teuthology.orchestra.run.smithi145.stderr:error: Compressing program wrote following message to stderr when compressing log /var/log/ceph/ceph-osd.4.log.1: 2024-09-11T01:32:42.978 INFO:teuthology.orchestra.run.smithi145.stderr:gzip: stdin: file size changed while zipping 2024-09-11T01:38:28.614 INFO:tasks.ceph.osd.1.smithi092.stderr:2024-09-11T01:38:28.611+0000 7f1c30424640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 552237) UID: 0 2024-09-11T01:38:28.615 INFO:tasks.ceph.osd.3.smithi092.stderr:2024-09-11T01:38:28.611+0000 7fc700ebf640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 552237) UID: 0 2024-09-11T01:38:28.615 INFO:tasks.ceph.osd.2.smithi092.stderr:2024-09-11T01:38:28.611+0000 7f645a187640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 552237) UID: 0 2024-09-11T01:38:28.615 INFO:tasks.ceph.osd.0.smithi092.stderr:2024-09-11T01:38:28.613+0000 7f828912d640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 552237) UID: 0 2024-09-11T01:46:25.538 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T01:46:25.547 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T01:46:25.605 INFO:tasks.ceph.mds.c.smithi092.stderr:2024-09-11T01:46:25.603+0000 7f6970484640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 552347) UID: 0 2024-09-11T01:46:25.605 INFO:tasks.ceph.mds.a.smithi092.stderr:2024-09-11T01:46:25.603+0000 7fab43790640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 552347) UID: 0 2024-09-11T01:46:25.612 INFO:tasks.ceph.osd.7.smithi145.stderr:2024-09-11T01:46:25.611+0000 7f246f6c7640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 49187) UID: 0 2024-09-11T01:46:25.612 INFO:tasks.ceph.osd.4.smithi145.stderr:2024-09-11T01:46:25.611+0000 7f87e7126640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 49187) UID: 0 2024-09-11T01:46:25.614 INFO:tasks.ceph.osd.6.smithi145.stderr:2024-09-11T01:46:25.611+0000 7f12741b6640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 49187) UID: 0 2024-09-11T01:46:25.624 INFO:tasks.ceph.osd.5.smithi145.stderr:2024-09-11T01:46:25.611+0000 7f3a08302640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 49187) UID: 0 2024-09-11T01:51:27.660 INFO:teuthology.orchestra.run.smithi145.stderr:error: Compressing program wrote following message to stderr when compressing log /var/log/ceph/ceph-osd.5.log.1: 2024-09-11T01:51:27.660 INFO:teuthology.orchestra.run.smithi145.stderr:gzip: stdin: file size changed while zipping 2024-09-11T01:52:16.789 INFO:tasks.ceph.osd.5.smithi145.stderr:2024-09-11T01:52:16.786+0000 7f39fe90b640 -1 bdev(0x5558008d4c00 /var/lib/ceph/osd/ceph-5/block) _aio_thread got r=-28 ((28) No space left on device) 2024-09-11T01:52:16.804 INFO:tasks.ceph.osd.5.smithi145.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4854-g8f219c47/rpm/el9/BUILD/ceph-19.3.0-4854-g8f219c47/src/blk/kernel/KernelDevice.cc: In function 'void KernelDevice::_aio_thread()' thread 7f39fe90b640 time 2024-09-11T01:52:16.802388+0000 2024-09-11T01:52:16.804 INFO:tasks.ceph.osd.5.smithi145.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4854-g8f219c47/rpm/el9/BUILD/ceph-19.3.0-4854-g8f219c47/src/blk/kernel/KernelDevice.cc: 664: ceph_abort_msg("Unexpected IO error. This may suggest a hardware issue. Please check your kernel log!") 2024-09-11T01:52:16.804 INFO:tasks.ceph.osd.5.smithi145.stderr: ceph version 19.3.0-4854-g8f219c47 (8f219c476cb4f26fc5719c661c0323719a45cb30) squid (dev) 2024-09-11T01:52:16.804 INFO:tasks.ceph.osd.5.smithi145.stderr: 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xc6) [0x5557fc1cfdbb] 2024-09-11T01:52:16.805 INFO:tasks.ceph.osd.5.smithi145.stderr: 2: (KernelDevice::_aio_thread()+0x11e0) [0x5557fcbdb210] 2024-09-11T01:52:16.805 INFO:tasks.ceph.osd.5.smithi145.stderr: 3: ceph-osd(+0xe1b381) [0x5557fcbdb381] 2024-09-11T01:52:16.805 INFO:tasks.ceph.osd.5.smithi145.stderr: 4: /lib64/libc.so.6(+0x89c52) [0x7f3a0b889c52] 2024-09-11T01:52:16.805 INFO:tasks.ceph.osd.5.smithi145.stderr: 5: /lib64/libc.so.6(+0x10ec80) [0x7f3a0b90ec80] 2024-09-11T01:52:16.807 INFO:tasks.ceph.osd.5.smithi145.stderr:*** Caught signal (Aborted) ** 2024-09-11T01:52:16.807 INFO:tasks.ceph.osd.5.smithi145.stderr: in thread 7f39fe90b640 thread_name:bstore_aio 2024-09-11T01:52:16.808 INFO:tasks.ceph.osd.5.smithi145.stderr: ceph version 19.3.0-4854-g8f219c47 (8f219c476cb4f26fc5719c661c0323719a45cb30) squid (dev) 2024-09-11T01:52:16.808 INFO:tasks.ceph.osd.5.smithi145.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f3a0b83e6f0] 2024-09-11T01:52:16.808 INFO:tasks.ceph.osd.5.smithi145.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f3a0b88b99c] 2024-09-11T01:52:16.808 INFO:tasks.ceph.osd.5.smithi145.stderr: 3: raise() 2024-09-11T01:52:16.809 INFO:tasks.ceph.osd.5.smithi145.stderr: 4: abort() 2024-09-11T01:52:16.809 INFO:tasks.ceph.osd.5.smithi145.stderr: 5: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0x187) [0x5557fc1cfe7c] 2024-09-11T01:52:16.809 INFO:tasks.ceph.osd.5.smithi145.stderr: 6: (KernelDevice::_aio_thread()+0x11e0) [0x5557fcbdb210] 2024-09-11T01:52:16.809 INFO:tasks.ceph.osd.5.smithi145.stderr: 7: ceph-osd(+0xe1b381) [0x5557fcbdb381] 2024-09-11T01:52:16.809 INFO:tasks.ceph.osd.5.smithi145.stderr: 8: /lib64/libc.so.6(+0x89c52) [0x7f3a0b889c52] 2024-09-11T01:52:16.809 INFO:tasks.ceph.osd.5.smithi145.stderr: 9: /lib64/libc.so.6(+0x10ec80) [0x7f3a0b90ec80] 2024-09-11T01:52:16.809 INFO:tasks.ceph.osd.5.smithi145.stderr:2024-09-11T01:52:16.805+0000 7f39fe90b640 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4854-g8f219c47/rpm/el9/BUILD/ceph-19.3.0-4854-g8f219c47/src/blk/kernel/KernelDevice.cc: In function 'void KernelDevice::_aio_thread()' thread 7f39fe90b640 time 2024-09-11T01:52:16.802388+0000 2024-09-11T01:52:16.810 INFO:tasks.ceph.osd.5.smithi145.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4854-g8f219c47/rpm/el9/BUILD/ceph-19.3.0-4854-g8f219c47/src/blk/kernel/KernelDevice.cc: 664: ceph_abort_msg("Unexpected IO error. This may suggest a hardware issue. Please check your kernel log!") 2024-09-11T01:52:16.810 INFO:tasks.ceph.osd.5.smithi145.stderr: 2024-09-11T01:52:16.810 INFO:tasks.ceph.osd.5.smithi145.stderr: ceph version 19.3.0-4854-g8f219c47 (8f219c476cb4f26fc5719c661c0323719a45cb30) squid (dev) 2024-09-11T01:52:16.810 INFO:tasks.ceph.osd.5.smithi145.stderr: 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xc6) [0x5557fc1cfdbb] 2024-09-11T01:52:16.810 INFO:tasks.ceph.osd.5.smithi145.stderr: 2: (KernelDevice::_aio_thread()+0x11e0) [0x5557fcbdb210] 2024-09-11T01:52:16.810 INFO:tasks.ceph.osd.5.smithi145.stderr: 3: ceph-osd(+0xe1b381) [0x5557fcbdb381] 2024-09-11T01:52:16.810 INFO:tasks.ceph.osd.5.smithi145.stderr: 4: /lib64/libc.so.6(+0x89c52) [0x7f3a0b889c52] 2024-09-11T01:52:16.810 INFO:tasks.ceph.osd.5.smithi145.stderr: 5: /lib64/libc.so.6(+0x10ec80) [0x7f3a0b90ec80] 2024-09-11T01:52:16.810 INFO:tasks.ceph.osd.5.smithi145.stderr: 2024-09-11T01:52:16.810 INFO:tasks.ceph.osd.5.smithi145.stderr:2024-09-11T01:52:16.806+0000 7f39fe90b640 -1 *** Caught signal (Aborted) ** 2024-09-11T01:52:16.810 INFO:tasks.ceph.osd.5.smithi145.stderr: in thread 7f39fe90b640 thread_name:bstore_aio 2024-09-11T01:52:16.810 INFO:tasks.ceph.osd.5.smithi145.stderr: 2024-09-11T01:52:16.810 INFO:tasks.ceph.osd.5.smithi145.stderr: ceph version 19.3.0-4854-g8f219c47 (8f219c476cb4f26fc5719c661c0323719a45cb30) squid (dev) 2024-09-11T01:52:16.811 INFO:tasks.ceph.osd.5.smithi145.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f3a0b83e6f0] 2024-09-11T01:52:16.811 INFO:tasks.ceph.osd.5.smithi145.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f3a0b88b99c] 2024-09-11T01:52:16.811 INFO:tasks.ceph.osd.5.smithi145.stderr: 3: raise() 2024-09-11T01:52:16.811 INFO:tasks.ceph.osd.5.smithi145.stderr: 4: abort() 2024-09-11T01:52:16.811 INFO:tasks.ceph.osd.5.smithi145.stderr: 5: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0x187) [0x5557fc1cfe7c] 2024-09-11T01:52:16.811 INFO:tasks.ceph.osd.5.smithi145.stderr: 6: (KernelDevice::_aio_thread()+0x11e0) [0x5557fcbdb210] 2024-09-11T01:52:16.811 INFO:tasks.ceph.osd.5.smithi145.stderr: 7: ceph-osd(+0xe1b381) [0x5557fcbdb381] 2024-09-11T01:52:16.811 INFO:tasks.ceph.osd.5.smithi145.stderr: 8: /lib64/libc.so.6(+0x89c52) [0x7f3a0b889c52] 2024-09-11T01:52:16.811 INFO:tasks.ceph.osd.5.smithi145.stderr: 9: /lib64/libc.so.6(+0x10ec80) [0x7f3a0b90ec80] 2024-09-11T01:52:16.811 INFO:tasks.ceph.osd.5.smithi145.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-11T01:52:16.811 INFO:tasks.ceph.osd.5.smithi145.stderr: 2024-09-11T01:52:16.870 INFO:tasks.ceph.osd.5.smithi145.stderr: -635> 2024-09-11T01:52:16.786+0000 7f39fe90b640 -1 bdev(0x5558008d4c00 /var/lib/ceph/osd/ceph-5/block) _aio_thread got r=-28 ((28) No space left on device) 2024-09-11T01:52:16.871 INFO:tasks.ceph.osd.5.smithi145.stderr: -58> 2024-09-11T01:52:16.805+0000 7f39fe90b640 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4854-g8f219c47/rpm/el9/BUILD/ceph-19.3.0-4854-g8f219c47/src/blk/kernel/KernelDevice.cc: In function 'void KernelDevice::_aio_thread()' thread 7f39fe90b640 time 2024-09-11T01:52:16.802388+0000 2024-09-11T01:52:16.871 INFO:tasks.ceph.osd.5.smithi145.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4854-g8f219c47/rpm/el9/BUILD/ceph-19.3.0-4854-g8f219c47/src/blk/kernel/KernelDevice.cc: 664: ceph_abort_msg("Unexpected IO error. This may suggest a hardware issue. Please check your kernel log!") 2024-09-11T01:52:16.871 INFO:tasks.ceph.osd.5.smithi145.stderr: 2024-09-11T01:52:16.871 INFO:tasks.ceph.osd.5.smithi145.stderr: ceph version 19.3.0-4854-g8f219c47 (8f219c476cb4f26fc5719c661c0323719a45cb30) squid (dev) 2024-09-11T01:52:16.871 INFO:tasks.ceph.osd.5.smithi145.stderr: 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xc6) [0x5557fc1cfdbb] 2024-09-11T01:52:16.871 INFO:tasks.ceph.osd.5.smithi145.stderr: 2: (KernelDevice::_aio_thread()+0x11e0) [0x5557fcbdb210] 2024-09-11T01:52:16.871 INFO:tasks.ceph.osd.5.smithi145.stderr: 3: ceph-osd(+0xe1b381) [0x5557fcbdb381] 2024-09-11T01:52:16.871 INFO:tasks.ceph.osd.5.smithi145.stderr: 4: /lib64/libc.so.6(+0x89c52) [0x7f3a0b889c52] 2024-09-11T01:52:16.871 INFO:tasks.ceph.osd.5.smithi145.stderr: 5: /lib64/libc.so.6(+0x10ec80) [0x7f3a0b90ec80] 2024-09-11T01:52:16.872 INFO:tasks.ceph.osd.5.smithi145.stderr: 2024-09-11T01:52:16.872 INFO:tasks.ceph.osd.5.smithi145.stderr: -1> 2024-09-11T01:52:16.806+0000 7f39fe90b640 -1 *** Caught signal (Aborted) ** 2024-09-11T01:52:16.872 INFO:tasks.ceph.osd.5.smithi145.stderr: in thread 7f39fe90b640 thread_name:bstore_aio 2024-09-11T01:52:16.872 INFO:tasks.ceph.osd.5.smithi145.stderr: 2024-09-11T01:52:16.872 INFO:tasks.ceph.osd.5.smithi145.stderr: ceph version 19.3.0-4854-g8f219c47 (8f219c476cb4f26fc5719c661c0323719a45cb30) squid (dev) 2024-09-11T01:52:16.872 INFO:tasks.ceph.osd.5.smithi145.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f3a0b83e6f0] 2024-09-11T01:52:16.872 INFO:tasks.ceph.osd.5.smithi145.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f3a0b88b99c] 2024-09-11T01:52:16.872 INFO:tasks.ceph.osd.5.smithi145.stderr: 3: raise() 2024-09-11T01:52:16.872 INFO:tasks.ceph.osd.5.smithi145.stderr: 4: abort() 2024-09-11T01:52:16.872 INFO:tasks.ceph.osd.5.smithi145.stderr: 5: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0x187) [0x5557fc1cfe7c] 2024-09-11T01:52:16.872 INFO:tasks.ceph.osd.5.smithi145.stderr: 6: (KernelDevice::_aio_thread()+0x11e0) [0x5557fcbdb210] 2024-09-11T01:52:16.872 INFO:tasks.ceph.osd.5.smithi145.stderr: 7: ceph-osd(+0xe1b381) [0x5557fcbdb381] 2024-09-11T01:52:16.872 INFO:tasks.ceph.osd.5.smithi145.stderr: 8: /lib64/libc.so.6(+0x89c52) [0x7f3a0b889c52] 2024-09-11T01:52:16.872 INFO:tasks.ceph.osd.5.smithi145.stderr: 9: /lib64/libc.so.6(+0x10ec80) [0x7f3a0b90ec80] 2024-09-11T01:52:16.873 INFO:tasks.ceph.osd.5.smithi145.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-11T01:52:16.873 INFO:tasks.ceph.osd.5.smithi145.stderr: 2024-09-11T01:52:16.885 INFO:tasks.ceph.osd.5.smithi145.stderr: -1636> 2024-09-11T01:52:16.786+0000 7f39fe90b640 -1 bdev(0x5558008d4c00 /var/lib/ceph/osd/ceph-5/block) _aio_thread got r=-28 ((28) No space left on device) 2024-09-11T01:52:16.886 INFO:tasks.ceph.osd.5.smithi145.stderr: -1059> 2024-09-11T01:52:16.805+0000 7f39fe90b640 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4854-g8f219c47/rpm/el9/BUILD/ceph-19.3.0-4854-g8f219c47/src/blk/kernel/KernelDevice.cc: In function 'void KernelDevice::_aio_thread()' thread 7f39fe90b640 time 2024-09-11T01:52:16.802388+0000 2024-09-11T01:52:16.886 INFO:tasks.ceph.osd.5.smithi145.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4854-g8f219c47/rpm/el9/BUILD/ceph-19.3.0-4854-g8f219c47/src/blk/kernel/KernelDevice.cc: 664: ceph_abort_msg("Unexpected IO error. This may suggest a hardware issue. Please check your kernel log!") 2024-09-11T01:52:16.886 INFO:tasks.ceph.osd.5.smithi145.stderr: 2024-09-11T01:52:16.886 INFO:tasks.ceph.osd.5.smithi145.stderr: ceph version 19.3.0-4854-g8f219c47 (8f219c476cb4f26fc5719c661c0323719a45cb30) squid (dev) 2024-09-11T01:52:16.886 INFO:tasks.ceph.osd.5.smithi145.stderr: 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xc6) [0x5557fc1cfdbb] 2024-09-11T01:52:16.886 INFO:tasks.ceph.osd.5.smithi145.stderr: 2: (KernelDevice::_aio_thread()+0x11e0) [0x5557fcbdb210] 2024-09-11T01:52:16.887 INFO:tasks.ceph.osd.5.smithi145.stderr: 3: ceph-osd(+0xe1b381) [0x5557fcbdb381] 2024-09-11T01:52:16.887 INFO:tasks.ceph.osd.5.smithi145.stderr: 4: /lib64/libc.so.6(+0x89c52) [0x7f3a0b889c52] 2024-09-11T01:52:16.887 INFO:tasks.ceph.osd.5.smithi145.stderr: 5: /lib64/libc.so.6(+0x10ec80) [0x7f3a0b90ec80] 2024-09-11T01:52:16.887 INFO:tasks.ceph.osd.5.smithi145.stderr: 2024-09-11T01:52:16.887 INFO:tasks.ceph.osd.5.smithi145.stderr: -1002> 2024-09-11T01:52:16.806+0000 7f39fe90b640 -1 *** Caught signal (Aborted) ** 2024-09-11T01:52:16.887 INFO:tasks.ceph.osd.5.smithi145.stderr: in thread 7f39fe90b640 thread_name:bstore_aio 2024-09-11T01:52:16.887 INFO:tasks.ceph.osd.5.smithi145.stderr: 2024-09-11T01:52:16.887 INFO:tasks.ceph.osd.5.smithi145.stderr: ceph version 19.3.0-4854-g8f219c47 (8f219c476cb4f26fc5719c661c0323719a45cb30) squid (dev) 2024-09-11T01:52:16.887 INFO:tasks.ceph.osd.5.smithi145.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f3a0b83e6f0] 2024-09-11T01:52:16.887 INFO:tasks.ceph.osd.5.smithi145.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f3a0b88b99c] 2024-09-11T01:52:16.887 INFO:tasks.ceph.osd.5.smithi145.stderr: 3: raise() 2024-09-11T01:52:16.887 INFO:tasks.ceph.osd.5.smithi145.stderr: 4: abort() 2024-09-11T01:52:16.887 INFO:tasks.ceph.osd.5.smithi145.stderr: 5: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0x187) [0x5557fc1cfe7c] 2024-09-11T01:52:16.888 INFO:tasks.ceph.osd.5.smithi145.stderr: 6: (KernelDevice::_aio_thread()+0x11e0) [0x5557fcbdb210] 2024-09-11T01:52:16.888 INFO:tasks.ceph.osd.5.smithi145.stderr: 7: ceph-osd(+0xe1b381) [0x5557fcbdb381] 2024-09-11T01:52:16.888 INFO:tasks.ceph.osd.5.smithi145.stderr: 8: /lib64/libc.so.6(+0x89c52) [0x7f3a0b889c52] 2024-09-11T01:52:16.888 INFO:tasks.ceph.osd.5.smithi145.stderr: 9: /lib64/libc.so.6(+0x10ec80) [0x7f3a0b90ec80] 2024-09-11T01:52:16.888 INFO:tasks.ceph.osd.5.smithi145.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-11T01:52:16.888 INFO:tasks.ceph.osd.5.smithi145.stderr: 2024-09-11T01:52:17.115 INFO:tasks.ceph.osd.5.smithi145.stderr:daemon-helper: command failed with exit status 5 2024-09-11T01:52:21.628 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~0s 2024-09-11T01:52:28.241 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~7s 2024-09-11T01:52:34.854 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~13s 2024-09-11T01:52:41.468 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~20s 2024-09-11T01:52:48.087 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~26s 2024-09-11T01:52:54.700 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~33s 2024-09-11T01:53:01.314 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~40s 2024-09-11T01:53:07.927 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~46s 2024-09-11T01:53:14.540 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~53s 2024-09-11T01:53:21.153 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~60s 2024-09-11T01:53:27.766 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~66s 2024-09-11T01:53:34.378 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~73s 2024-09-11T01:53:40.991 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~79s 2024-09-11T01:53:47.602 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~86s 2024-09-11T01:53:54.213 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~93s 2024-09-11T01:54:00.824 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~99s 2024-09-11T01:54:07.434 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~106s 2024-09-11T01:54:14.047 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~112s 2024-09-11T01:54:20.660 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~119s 2024-09-11T01:54:27.273 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~126s 2024-09-11T01:54:33.884 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~132s 2024-09-11T01:54:40.494 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~139s 2024-09-11T01:54:47.105 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~145s 2024-09-11T01:54:53.715 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~152s 2024-09-11T01:55:00.325 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~159s 2024-09-11T01:55:06.935 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~165s 2024-09-11T01:55:13.546 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~172s 2024-09-11T01:55:20.157 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~179s 2024-09-11T01:55:26.767 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~185s 2024-09-11T01:55:27.950 INFO:tasks.ceph.osd.1.smithi092.stderr:2024-09-11T01:55:27.948+0000 7f1c30424640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 552437) UID: 0 2024-09-11T01:55:27.951 INFO:tasks.ceph.osd.0.smithi092.stderr:2024-09-11T01:55:27.948+0000 7f828912d640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 552437) UID: 0 2024-09-11T01:55:27.954 INFO:tasks.ceph.osd.2.smithi092.stderr:2024-09-11T01:55:27.946+0000 7f645a187640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 552437) UID: 0 2024-09-11T01:55:27.960 INFO:tasks.ceph.osd.3.smithi092.stderr:2024-09-11T01:55:27.951+0000 7fc700ebf640 -1 Fail to open '/proc/552437/cmdline' error = (2) No such file or directory 2024-09-11T01:55:27.960 INFO:tasks.ceph.osd.3.smithi092.stderr:2024-09-11T01:55:27.951+0000 7fc700ebf640 -1 received signal: Hangup from (PID: 552437) UID: 0 2024-09-11T01:55:33.381 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~192s 2024-09-11T01:55:39.994 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~198s 2024-09-11T01:55:46.606 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~205s 2024-09-11T01:55:53.219 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~212s 2024-09-11T01:55:59.832 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~218s 2024-09-11T01:56:06.443 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~225s 2024-09-11T01:56:13.056 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~231s 2024-09-11T01:56:19.669 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~238s 2024-09-11T01:56:26.283 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~245s 2024-09-11T01:56:32.895 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~251s 2024-09-11T01:56:39.506 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~258s 2024-09-11T01:56:46.120 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~264s 2024-09-11T01:56:52.732 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~271s 2024-09-11T01:56:59.346 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~278s 2024-09-11T01:57:05.959 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~284s 2024-09-11T01:57:12.570 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~291s 2024-09-11T01:57:19.183 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~298s 2024-09-11T01:57:25.797 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~304s 2024-09-11T01:57:25.797 INFO:tasks.daemonwatchdog.daemon_watchdog:BARK! unmounting mounts and killing all daemons 2024-09-11T01:57:25.797 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2024-09-11T01:57:25.798 DEBUG:teuthology.orchestra.run.smithi092:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T01:57:25.888 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2024-09-11T01:57:25.888 DEBUG:teuthology.orchestra.run.smithi092:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T01:57:25.989 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-11T01:57:28.919 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T01:57:28.917+0000 7f3234d6b640 1 -- 172.21.15.92:0/3396926479 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3230073430 msgr2=0x7f323015e960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:57:28.919 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T01:57:28.917+0000 7f3234d6b640 1 --2- 172.21.15.92:0/3396926479 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3230073430 0x7f323015e960 secure :-1 s=READY pgs=2153 cs=0 l=1 rev1=1 crypto rx=0x7f3220005fd0 tx=0x7f322002a5d0 comp rx=0 tx=0).stop 2024-09-11T01:57:28.919 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T01:57:28.917+0000 7f3234d6b640 1 -- 172.21.15.92:0/3396926479 shutdown_connections 2024-09-11T01:57:28.919 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T01:57:28.917+0000 7f3234d6b640 1 --2- 172.21.15.92:0/3396926479 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3230073430 0x7f323015e960 unknown :-1 s=CLOSED pgs=2153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:57:28.920 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T01:57:28.917+0000 7f3234d6b640 1 -- 172.21.15.92:0/3396926479 >> 172.21.15.92:0/3396926479 conn(0x7f32300b16f0 msgr2=0x7f32300b1b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:57:28.920 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T01:57:28.917+0000 7f3234d6b640 1 -- 172.21.15.92:0/3396926479 shutdown_connections 2024-09-11T01:57:28.920 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T01:57:28.917+0000 7f3234d6b640 1 -- 172.21.15.92:0/3396926479 wait complete. 2024-09-11T01:57:28.977 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T01:57:28.976+0000 7f3234d6b640 1 Processor -- start 2024-09-11T01:57:28.979 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T01:57:28.976+0000 7f3234d6b640 1 -- start start 2024-09-11T01:57:28.979 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T01:57:28.977+0000 7f3234d6b640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3230073430 0x7f32300a9480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:57:28.979 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T01:57:28.977+0000 7f3234d6b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f32300aead0 0x7f32301f89c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:57:28.980 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T01:57:28.977+0000 7f3234d6b640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f323015b580 0x7f32301fb720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:57:28.980 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T01:57:28.977+0000 7f3234d6b640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f32300b3280 con 0x7f32300aead0 2024-09-11T01:57:28.980 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T01:57:28.977+0000 7f3234d6b640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f32300b3100 con 0x7f323015b580 2024-09-11T01:57:28.980 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T01:57:28.977+0000 7f3234d6b640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f32300b3400 con 0x7f3230073430 2024-09-11T01:57:28.980 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T01:57:28.978+0000 7f322effd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f32300aead0 0x7f32301f89c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:57:28.980 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T01:57:28.978+0000 7f322effd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f32300aead0 0x7f32301f89c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:56480/0 (socket says 172.21.15.92:56480) 2024-09-11T01:57:28.980 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T01:57:28.978+0000 7f322effd640 1 -- 172.21.15.92:0/271493755 learned_addr learned my addr 172.21.15.92:0/271493755 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-11T01:57:28.981 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T01:57:28.978+0000 7f322f7fe640 1 --2- 172.21.15.92:0/271493755 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3230073430 0x7f32300a9480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:57:28.981 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T01:57:28.979+0000 7f322effd640 1 -- 172.21.15.92:0/271493755 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3230073430 msgr2=0x7f32300a9480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:57:28.981 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T01:57:28.979+0000 7f322effd640 1 --2- 172.21.15.92:0/271493755 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3230073430 0x7f32300a9480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:57:28.982 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T01:57:28.979+0000 7f322effd640 1 -- 172.21.15.92:0/271493755 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f323015b580 msgr2=0x7f32301fb720 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-11T01:57:28.982 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T01:57:28.979+0000 7f322effd640 1 --2- 172.21.15.92:0/271493755 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f323015b580 0x7f32301fb720 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:57:28.982 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T01:57:28.979+0000 7f322effd640 1 -- 172.21.15.92:0/271493755 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3230146ba0 con 0x7f32300aead0 2024-09-11T01:57:28.982 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T01:57:28.980+0000 7f322f7fe640 1 --2- 172.21.15.92:0/271493755 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3230073430 0x7f32300a9480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T01:57:28.982 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T01:57:28.980+0000 7f322effd640 1 --2- 172.21.15.92:0/271493755 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f32300aead0 0x7f32301f89c0 secure :-1 s=READY pgs=2154 cs=0 l=1 rev1=1 crypto rx=0x7f3220009850 tx=0x7f32200038a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:57:28.984 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T01:57:28.981+0000 7f3217fff640 1 -- 172.21.15.92:0/271493755 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f322003f070 con 0x7f32300aead0 2024-09-11T01:57:28.984 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T01:57:28.981+0000 7f3234d6b640 1 -- 172.21.15.92:0/271493755 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32300a9a60 con 0x7f32300aead0 2024-09-11T01:57:28.984 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T01:57:28.982+0000 7f3234d6b640 1 -- 172.21.15.92:0/271493755 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32300aa020 con 0x7f32300aead0 2024-09-11T01:57:28.984 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T01:57:28.982+0000 7f3217fff640 1 -- 172.21.15.92:0/271493755 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f32200047a0 con 0x7f32300aead0 2024-09-11T01:57:28.984 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T01:57:28.982+0000 7f3217fff640 1 -- 172.21.15.92:0/271493755 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3220035030 con 0x7f32300aead0 2024-09-11T01:57:28.988 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T01:57:28.986+0000 7f3217fff640 1 -- 172.21.15.92:0/271493755 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f3220004bb0 con 0x7f32300aead0 2024-09-11T01:57:28.991 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T01:57:28.989+0000 7f3217fff640 1 --2- 172.21.15.92:0/271493755 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f321c078040 0x7f321c07a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:57:28.991 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T01:57:28.989+0000 7f3217fff640 1 -- 172.21.15.92:0/271493755 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 6130+0+0 (secure 0 0 0) 0x7f32200bae50 con 0x7f32300aead0 2024-09-11T01:57:28.991 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T01:57:28.990+0000 7f322f7fe640 1 --2- 172.21.15.92:0/271493755 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f321c078040 0x7f321c07a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:57:28.992 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T01:57:28.991+0000 7f322f7fe640 1 --2- 172.21.15.92:0/271493755 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f321c078040 0x7f321c07a500 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f3224006fd0 tx=0x7f3224009060 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:57:29.083 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T01:57:29.081+0000 7f3234d6b640 1 -- 172.21.15.92:0/271493755 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3210005290 con 0x7f32300aead0 2024-09-11T01:57:29.096 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T01:57:29.094+0000 7f3217fff640 1 -- 172.21.15.92:0/271493755 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f3220083130 con 0x7f32300aead0 2024-09-11T01:57:29.415 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T01:57:29.413+0000 7f3234d6b640 1 -- 172.21.15.92:0/271493755 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f3210005580 con 0x7f32300aead0 2024-09-11T01:57:29.415 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T01:57:29.414+0000 7f3217fff640 1 -- 172.21.15.92:0/271493755 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v43) ==== 80+0+0 (secure 0 0 0) 0x7f3220087b60 con 0x7f32300aead0 2024-09-11T01:57:29.416 INFO:teuthology.orchestra.run.smithi092.stderr:listed 0 entries 2024-09-11T01:57:29.419 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T01:57:29.417+0000 7f3234d6b640 1 -- 172.21.15.92:0/271493755 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f321c078040 msgr2=0x7f321c07a500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:57:29.419 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T01:57:29.417+0000 7f3234d6b640 1 --2- 172.21.15.92:0/271493755 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f321c078040 0x7f321c07a500 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f3224006fd0 tx=0x7f3224009060 comp rx=0 tx=0).stop 2024-09-11T01:57:29.419 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T01:57:29.417+0000 7f3234d6b640 1 -- 172.21.15.92:0/271493755 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f32300aead0 msgr2=0x7f32301f89c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:57:29.419 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T01:57:29.417+0000 7f3234d6b640 1 --2- 172.21.15.92:0/271493755 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f32300aead0 0x7f32301f89c0 secure :-1 s=READY pgs=2154 cs=0 l=1 rev1=1 crypto rx=0x7f3220009850 tx=0x7f32200038a0 comp rx=0 tx=0).stop 2024-09-11T01:57:29.419 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T01:57:29.417+0000 7f3234d6b640 1 -- 172.21.15.92:0/271493755 shutdown_connections 2024-09-11T01:57:29.419 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T01:57:29.417+0000 7f3234d6b640 1 --2- 172.21.15.92:0/271493755 >> [v2:172.21.15.145:6800/325490785,v1:172.21.15.145:6801/325490785] conn(0x7f321c078040 0x7f321c07a500 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:57:29.419 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T01:57:29.417+0000 7f3234d6b640 1 --2- 172.21.15.92:0/271493755 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f323015b580 0x7f32301fb720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:57:29.419 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T01:57:29.417+0000 7f3234d6b640 1 --2- 172.21.15.92:0/271493755 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f32300aead0 0x7f32301f89c0 unknown :-1 s=CLOSED pgs=2154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:57:29.420 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T01:57:29.417+0000 7f3234d6b640 1 --2- 172.21.15.92:0/271493755 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3230073430 0x7f32300a9480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:57:29.420 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T01:57:29.417+0000 7f3234d6b640 1 -- 172.21.15.92:0/271493755 >> 172.21.15.92:0/271493755 conn(0x7f32300b16f0 msgr2=0x7f323006ffd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:57:29.420 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T01:57:29.417+0000 7f3234d6b640 1 -- 172.21.15.92:0/271493755 shutdown_connections 2024-09-11T01:57:29.420 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-11T01:57:29.417+0000 7f3234d6b640 1 -- 172.21.15.92:0/271493755 wait complete. 2024-09-11T01:57:29.431 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-11T01:57:29.431 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T01:57:29.432 DEBUG:teuthology.orchestra.run.smithi092:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2024-09-11T01:57:29.461 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi092.front.sepia.ceph.com 2024-09-11T01:57:29.462 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T01:57:29.462 DEBUG:teuthology.orchestra.run.smithi092:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-11T01:57:29.748 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2024-09-11T01:57:29.749 DEBUG:teuthology.orchestra.run.smithi092:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T01:57:29.767 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056024,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3387 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 172.21.15.92:6789:/test /tmp/tmp.NWxQF6Pu3itest ceph rw,context=system_u:object_r:root_t:s0,relatime,name=admin,secret=,fsid=47039cb3-5d2a-46bf-9066-8055b5dfc583,acl 0 0 172.21.15.92:6789:/scratch /tmp/tmp.uDPYbHx6DKscratch ceph rw,context=system_u:object_r:root_t:s0,relatime,name=admin,secret=,fsid=47039cb3-5d2a-46bf-9066-8055b5dfc583,acl 0 0 2024-09-11T01:57:29.768 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi092.front.sepia.ceph.com 2024-09-11T01:57:29.768 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T01:57:29.768 DEBUG:teuthology.orchestra.run.smithi092:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-09-11T01:57:29.826 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T01:57:29.827 INFO:teuthology.orchestra.run.smithi092.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2024-09-11T01:57:29.827 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2024-09-11T01:57:29.827 DEBUG:teuthology.orchestra.run.smithi145:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T01:57:29.860 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056014,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17566 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248720k,nr_inodes=812180,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-11T01:57:29.860 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi145.front.sepia.ceph.com 2024-09-11T01:57:29.860 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T01:57:29.861 DEBUG:teuthology.orchestra.run.smithi145:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-11T01:57:29.924 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T01:57:29.924 INFO:teuthology.orchestra.run.smithi145.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2024-09-11T01:57:29.924 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2024-09-11T01:57:29.924 DEBUG:teuthology.orchestra.run.smithi145:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T01:57:29.980 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056014,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17566 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248720k,nr_inodes=812180,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-11T01:57:29.980 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi145.front.sepia.ceph.com 2024-09-11T01:57:29.981 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T01:57:29.981 DEBUG:teuthology.orchestra.run.smithi145:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-09-11T01:57:30.035 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T01:57:30.036 INFO:teuthology.orchestra.run.smithi145.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2024-09-11T01:57:31.649 INFO:tasks.ceph.osd.0:Sent signal 15 2024-09-11T01:57:31.650 INFO:tasks.ceph.osd.1:Sent signal 15 2024-09-11T01:57:31.650 INFO:tasks.ceph.osd.2:Sent signal 15 2024-09-11T01:57:31.650 INFO:tasks.ceph.osd.3:Sent signal 15 2024-09-11T01:57:31.650 INFO:tasks.ceph.osd.4:Sent signal 15 2024-09-11T01:57:31.651 INFO:tasks.ceph.osd.6:Sent signal 15 2024-09-11T01:57:31.651 INFO:tasks.ceph.osd.7:Sent signal 15 2024-09-11T01:57:31.651 INFO:tasks.ceph.mds.a:Sent signal 15 2024-09-11T01:57:31.651 INFO:tasks.ceph.mds.c:Sent signal 15 2024-09-11T01:57:31.651 INFO:tasks.ceph.mds.b:Sent signal 15 2024-09-11T01:57:31.652 INFO:tasks.ceph.mds.d:Sent signal 15 2024-09-11T01:57:31.652 INFO:tasks.ceph.mon.a:Sent signal 15 2024-09-11T01:57:31.652 INFO:tasks.ceph.mon.b:Sent signal 15 2024-09-11T01:57:31.652 INFO:tasks.ceph.mon.c:Sent signal 15 2024-09-11T01:57:31.652 INFO:tasks.ceph.mgr.y:Sent signal 15 2024-09-11T01:57:31.653 INFO:tasks.ceph.mgr.x:Sent signal 15 2024-09-11T01:57:31.653 INFO:tasks.ceph.osd.4.smithi145.stderr:2024-09-11T01:57:31.650+0000 7f87e7126640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 36978) UID: 0 2024-09-11T01:57:31.654 INFO:tasks.ceph.osd.4.smithi145.stderr:2024-09-11T01:57:31.650+0000 7f87e7126640 -1 osd.4 43 *** Got signal Terminated *** 2024-09-11T01:57:31.654 INFO:tasks.ceph.osd.4.smithi145.stderr:2024-09-11T01:57:31.650+0000 7f87e7126640 -1 osd.4 43 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-11T01:57:31.654 INFO:tasks.ceph.osd.1.smithi092.stderr:2024-09-11T01:57:31.649+0000 7f1c30424640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 37048) UID: 0 2024-09-11T01:57:31.654 INFO:tasks.ceph.osd.1.smithi092.stderr:2024-09-11T01:57:31.649+0000 7f1c30424640 -1 osd.1 43 *** Got signal Terminated *** 2024-09-11T01:57:31.654 INFO:tasks.ceph.osd.1.smithi092.stderr:2024-09-11T01:57:31.649+0000 7f1c30424640 -1 osd.1 43 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-11T01:57:31.655 INFO:tasks.ceph.osd.6.smithi145.stderr:2024-09-11T01:57:31.650+0000 7f12741b6640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 36982) UID: 0 2024-09-11T01:57:31.655 INFO:tasks.ceph.osd.6.smithi145.stderr:2024-09-11T01:57:31.650+0000 7f12741b6640 -1 osd.6 43 *** Got signal Terminated *** 2024-09-11T01:57:31.655 INFO:tasks.ceph.osd.6.smithi145.stderr:2024-09-11T01:57:31.650+0000 7f12741b6640 -1 osd.6 43 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-11T01:57:31.655 INFO:tasks.ceph.osd.0.smithi092.stderr:2024-09-11T01:57:31.650+0000 7f828912d640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 37044) UID: 0 2024-09-11T01:57:31.655 INFO:tasks.ceph.osd.0.smithi092.stderr:2024-09-11T01:57:31.650+0000 7f828912d640 -1 osd.0 43 *** Got signal Terminated *** 2024-09-11T01:57:31.655 INFO:tasks.ceph.osd.0.smithi092.stderr:2024-09-11T01:57:31.650+0000 7f828912d640 -1 osd.0 43 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-11T01:57:31.656 INFO:tasks.ceph.mds.a.smithi092.stderr:2024-09-11T01:57:31.650+0000 7fab43790640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mds -f --cluster ceph -i a (PID: 48246) UID: 0 2024-09-11T01:57:31.656 INFO:tasks.ceph.mds.a.smithi092.stderr:2024-09-11T01:57:31.650+0000 7fab43790640 -1 mds.a *** got signal Terminated *** 2024-09-11T01:57:31.656 INFO:tasks.ceph.osd.7.smithi145.stderr:2024-09-11T01:57:31.650+0000 7f246f6c7640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 36983) UID: 0 2024-09-11T01:57:31.656 INFO:tasks.ceph.osd.7.smithi145.stderr:2024-09-11T01:57:31.650+0000 7f246f6c7640 -1 osd.7 43 *** Got signal Terminated *** 2024-09-11T01:57:31.656 INFO:tasks.ceph.osd.7.smithi145.stderr:2024-09-11T01:57:31.650+0000 7f246f6c7640 -1 osd.7 43 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-11T01:57:31.656 INFO:tasks.ceph.mds.c.smithi092.stderr:2024-09-11T01:57:31.650+0000 7f6970484640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mds -f --cluster ceph -i c (PID: 48248) UID: 0 2024-09-11T01:57:31.657 INFO:tasks.ceph.mds.c.smithi092.stderr:2024-09-11T01:57:31.650+0000 7f6970484640 -1 mds.c *** got signal Terminated *** 2024-09-11T01:57:31.657 INFO:tasks.ceph.mds.b.smithi145.stderr:2024-09-11T01:57:31.651+0000 7f8b340a3640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mds -f --cluster ceph -i b (PID: 43087) UID: 0 2024-09-11T01:57:31.657 INFO:tasks.ceph.mds.b.smithi145.stderr:2024-09-11T01:57:31.651+0000 7f8b340a3640 -1 mds.b *** got signal Terminated *** 2024-09-11T01:57:31.657 INFO:tasks.ceph.mds.d.smithi145.stderr:2024-09-11T01:57:31.651+0000 7f0ce93cd640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mds -f --cluster ceph -i d (PID: 43088) UID: 0 2024-09-11T01:57:31.657 INFO:tasks.ceph.mds.d.smithi145.stderr:2024-09-11T01:57:31.651+0000 7f0ce93cd640 -1 mds.d *** got signal Terminated *** 2024-09-11T01:57:31.658 INFO:tasks.ceph.mon.a.smithi092.stderr:2024-09-11T01:57:31.651+0000 7fd1cc868640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mon -f --cluster ceph -i a (PID: 36044) UID: 0 2024-09-11T01:57:31.658 INFO:tasks.ceph.mon.a.smithi092.stderr:2024-09-11T01:57:31.651+0000 7fd1cc868640 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2024-09-11T01:57:31.658 INFO:tasks.ceph.mon.a.smithi092.stderr:2024-09-11T01:57:31.652+0000 7fd1c705d640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-11T01:57:31.658 INFO:tasks.ceph.mon.b.smithi145.stderr:2024-09-11T01:57:31.651+0000 7f89fc335640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mon -f --cluster ceph -i b (PID: 36397) UID: 0 2024-09-11T01:57:31.658 INFO:tasks.ceph.mon.b.smithi145.stderr:2024-09-11T01:57:31.651+0000 7f89fc335640 -1 mon.b@1(peon) e1 *** Got Signal Terminated *** 2024-09-11T01:57:31.659 INFO:tasks.ceph.mon.c.smithi145.stderr:2024-09-11T01:57:31.652+0000 7fd44c1bc640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mon -f --cluster ceph -i c (PID: 36399) UID: 0 2024-09-11T01:57:31.659 INFO:tasks.ceph.mon.c.smithi145.stderr:2024-09-11T01:57:31.652+0000 7fd44c1bc640 -1 mon.c@2(peon) e1 *** Got Signal Terminated *** 2024-09-11T01:57:31.659 INFO:tasks.ceph.mgr.x.smithi145.stderr:2024-09-11T01:57:31.652+0000 7fd5dd173640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mgr -f --cluster ceph -i x (PID: 36402) UID: 0 2024-09-11T01:57:31.659 INFO:tasks.ceph.osd.2.smithi092.stderr:2024-09-11T01:57:31.651+0000 7f645a187640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 37056) UID: 0 2024-09-11T01:57:31.659 INFO:tasks.ceph.osd.2.smithi092.stderr:2024-09-11T01:57:31.651+0000 7f645a187640 -1 osd.2 43 *** Got signal Terminated *** 2024-09-11T01:57:31.660 INFO:tasks.ceph.osd.2.smithi092.stderr:2024-09-11T01:57:31.651+0000 7f645a187640 -1 osd.2 43 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-11T01:57:31.669 INFO:tasks.ceph.osd.3.smithi092.stderr:2024-09-11T01:57:31.649+0000 7fc700ebf640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 37062) UID: 0 2024-09-11T01:57:31.669 INFO:tasks.ceph.osd.3.smithi092.stderr:2024-09-11T01:57:31.649+0000 7fc700ebf640 -1 osd.3 43 *** Got signal Terminated *** 2024-09-11T01:57:31.669 INFO:tasks.ceph.osd.3.smithi092.stderr:2024-09-11T01:57:31.649+0000 7fc700ebf640 -1 osd.3 43 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-11T01:57:31.857 INFO:tasks.ceph.mgr.y.smithi092.stderr:daemon-helper: command crashed with signal 15 2024-09-11T02:07:04.968 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T02:07:04.972 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T02:07:05.006 INFO:teuthology.orchestra.run.smithi092.stderr:ceph-mds: no process found 2024-09-11T02:07:05.007 INFO:teuthology.orchestra.run.smithi145.stderr:ceph-osd: no process found 2024-09-11T02:12:39.041 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T02:12:39.045 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T02:13:09.165 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T02:13:09.169 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T02:13:39.292 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T02:13:39.296 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T02:14:09.631 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T02:14:09.635 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T02:14:39.699 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T02:14:39.703 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T02:15:09.830 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T02:15:09.834 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T02:15:39.890 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T02:15:39.894 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T02:16:09.960 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T02:16:09.964 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T02:16:40.081 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T02:16:40.084 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T02:17:10.193 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T02:17:10.196 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T02:17:40.314 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T02:17:40.320 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T02:18:10.383 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T02:18:10.386 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T02:18:40.513 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T02:18:40.516 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T02:19:10.602 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T02:19:10.606 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T02:19:40.744 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T02:19:40.748 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T02:20:10.805 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T02:20:10.808 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T02:20:40.935 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T02:20:40.938 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T02:21:11.004 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T02:21:11.008 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T02:21:41.067 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T02:21:41.070 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T02:22:11.155 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T02:22:11.158 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T02:22:41.307 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T02:22:41.311 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T02:23:11.452 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T02:23:11.456 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T02:23:41.514 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T02:23:41.517 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T02:24:11.860 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T02:24:11.863 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T02:24:41.994 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T02:24:41.998 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T02:25:12.190 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T02:25:12.194 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T02:25:42.261 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T02:25:42.264 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T02:26:12.544 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T02:26:12.548 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T02:26:42.606 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T02:26:42.609 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T02:27:12.675 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T02:27:12.679 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T02:27:42.809 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T02:27:42.813 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T02:28:12.938 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T02:28:12.941 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T02:28:43.001 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T02:28:43.005 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T02:29:13.128 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T02:29:13.132 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T02:29:43.198 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T02:29:43.202 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T02:30:13.259 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T02:30:13.263 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T02:30:43.372 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T02:30:43.375 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T02:31:13.518 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T02:31:13.521 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T02:31:43.646 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T02:31:43.650 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T02:32:13.750 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T02:32:13.754 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T02:32:43.820 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T02:32:43.823 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T02:33:13.986 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T02:33:13.990 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T02:33:44.136 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T02:33:44.140 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T02:34:14.200 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T02:34:14.204 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T02:34:44.329 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T02:34:44.333 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T02:35:14.481 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T02:35:14.484 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T02:35:44.676 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T02:35:44.680 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T02:36:14.779 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T02:36:14.783 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T02:36:44.923 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T02:36:44.926 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T02:37:15.185 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T02:37:15.189 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T02:37:45.388 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T02:37:45.392 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T02:38:15.565 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T02:38:15.569 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T02:38:45.822 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T02:38:45.826 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T02:39:16.046 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T02:39:16.049 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T02:39:46.342 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T02:39:46.346 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T02:40:16.619 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T02:40:16.623 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T02:40:46.761 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T02:40:46.765 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T02:41:16.842 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T02:41:16.845 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T02:41:46.976 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T02:41:46.980 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T02:42:17.148 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T02:42:17.151 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T02:42:47.292 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T02:42:47.296 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T02:43:17.371 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T02:43:17.374 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T02:43:47.515 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T02:43:47.518 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T02:44:17.634 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T02:44:17.638 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T02:44:47.857 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T02:44:47.860 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T02:45:17.926 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T02:45:17.930 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T02:45:48.088 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T02:45:48.091 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T02:46:18.217 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T02:46:18.221 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T02:46:48.446 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T02:46:48.449 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T02:47:18.570 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T02:47:18.574 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T02:47:48.911 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T02:47:48.915 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T02:48:19.042 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T02:48:19.046 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T02:48:49.177 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T02:48:49.181 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T02:49:19.306 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T02:49:19.310 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T02:49:49.450 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T02:49:49.454 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T02:50:19.570 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T02:50:19.573 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T02:50:49.714 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T02:50:49.718 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T02:51:19.968 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T02:51:19.971 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T02:51:50.179 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T02:51:50.183 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T02:52:20.524 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T02:52:20.528 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T02:52:50.868 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T02:52:50.872 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T02:53:21.222 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T02:53:21.225 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T02:53:51.286 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T02:53:51.290 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T02:54:21.356 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T02:54:21.360 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T02:54:51.485 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T02:54:51.489 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T02:55:21.560 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T02:55:21.564 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T02:55:51.642 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T02:55:51.645 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T02:56:21.787 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T02:56:21.791 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T02:56:51.853 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T02:56:51.857 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T02:57:22.136 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T02:57:22.143 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T02:57:52.283 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T02:57:52.287 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T02:58:22.393 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T02:58:22.397 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T02:58:52.548 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T02:58:52.552 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T02:59:22.750 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T02:59:22.753 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T02:59:52.869 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T02:59:52.873 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T03:00:23.014 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T03:00:23.017 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T03:00:53.168 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T03:00:53.171 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T03:01:23.348 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T03:01:23.352 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T03:01:53.418 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T03:01:53.421 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T03:02:23.601 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T03:02:23.604 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T03:02:53.920 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T03:02:53.924 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T03:03:24.055 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T03:03:24.058 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T03:03:54.193 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T03:03:54.196 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T03:04:24.354 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T03:04:24.357 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T03:04:54.493 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T03:04:54.497 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T03:05:24.659 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T03:05:24.663 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T03:05:54.781 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T03:05:54.785 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T03:06:24.949 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T03:06:24.953 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T03:06:55.059 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T03:06:55.063 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T03:07:25.321 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T03:07:25.325 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T03:07:55.665 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T03:07:55.669 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T03:08:25.768 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T03:08:25.772 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T03:08:55.910 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T03:08:55.913 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T03:09:26.039 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T03:09:26.043 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T03:09:56.102 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T03:09:56.105 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T03:10:26.254 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T03:10:26.257 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T03:10:56.541 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T03:10:56.545 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T03:11:26.605 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T03:11:26.608 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T03:11:56.664 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T03:11:56.668 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T03:12:26.834 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T03:12:26.838 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T03:12:56.912 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T03:12:56.915 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T03:13:27.067 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T03:13:27.071 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T03:13:57.208 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T03:13:57.212 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T03:14:27.357 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T03:14:27.360 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T03:14:57.569 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T03:14:57.573 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T03:15:27.683 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T03:15:27.687 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T03:15:57.836 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T03:15:57.839 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T03:16:27.981 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T03:16:27.985 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T03:16:58.083 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T03:16:58.087 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T03:17:28.220 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T03:17:28.223 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T03:17:58.390 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T03:17:58.393 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T03:18:28.451 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T03:18:28.455 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T03:18:58.722 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T03:18:58.726 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T03:19:28.849 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T03:19:28.852 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T03:19:58.994 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T03:19:58.998 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T03:20:29.141 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T03:20:29.145 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T03:20:59.266 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T03:20:59.270 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T03:21:29.415 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T03:21:29.420 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T03:21:59.480 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T03:21:59.484 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T03:22:29.622 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T03:22:29.625 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T03:22:59.983 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T03:22:59.987 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T03:23:30.139 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T03:23:30.142 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T03:24:00.325 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T03:24:00.328 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T03:24:30.444 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T03:24:30.450 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T03:25:00.798 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T03:25:00.801 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T03:25:30.867 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T03:25:30.871 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T03:26:00.981 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T03:26:00.984 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T03:26:31.107 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T03:26:31.110 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T03:27:01.418 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T03:27:01.421 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T03:27:31.638 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T03:27:31.641 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T03:28:01.707 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T03:28:01.711 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T03:28:32.031 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T03:28:32.034 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T03:29:02.105 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T03:29:02.109 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T03:29:32.174 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T03:29:32.178 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T03:30:02.308 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T03:30:02.313 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T03:30:32.489 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T03:30:32.493 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T03:31:02.624 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T03:31:02.628 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T03:31:32.783 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T03:31:32.787 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T03:32:02.857 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T03:32:02.860 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T03:32:33.018 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T03:32:33.022 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T03:33:03.154 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T03:33:03.157 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T03:33:33.308 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T03:33:33.312 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T03:34:03.387 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T03:34:03.391 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T03:34:33.524 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T03:34:33.528 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T03:35:03.640 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T03:35:03.644 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T03:35:33.790 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T03:35:33.793 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T03:36:03.926 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T03:36:03.929 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T03:36:34.090 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T03:36:34.094 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T03:37:04.218 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T03:37:04.222 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T03:37:34.371 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T03:37:34.374 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T03:38:04.732 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T03:38:04.735 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T03:38:34.879 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T03:38:34.883 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T03:39:05.235 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T03:39:05.239 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T03:39:35.375 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T03:39:35.378 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T03:40:05.511 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T03:40:05.514 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T03:40:35.639 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T03:40:35.643 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T03:41:05.845 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T03:41:05.849 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T03:41:35.987 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T03:41:35.990 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T03:42:06.223 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T03:42:06.227 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T03:42:36.551 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T03:42:36.554 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T03:43:06.634 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T03:43:06.638 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T03:43:36.705 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T03:43:36.708 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T03:44:06.874 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T03:44:06.877 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T03:44:36.947 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T03:44:36.951 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T03:45:07.082 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T03:45:07.085 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T03:45:37.169 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T03:45:37.172 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T03:46:07.338 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T03:46:07.341 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T03:46:37.466 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T03:46:37.470 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T03:47:07.588 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T03:47:07.592 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T03:47:37.730 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T03:47:37.734 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T03:48:07.892 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T03:48:07.895 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T03:48:38.045 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T03:48:38.048 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T03:49:08.173 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T03:49:08.176 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T03:49:38.238 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T03:49:38.242 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T03:50:08.601 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T03:50:08.604 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T03:50:38.731 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T03:50:38.735 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T03:51:08.849 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T03:51:08.853 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T03:51:38.988 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T03:51:38.991 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T03:52:09.158 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T03:52:09.161 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T03:52:39.219 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T03:52:39.223 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T03:53:09.296 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T03:53:09.300 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T03:53:39.650 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T03:53:39.653 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T03:54:09.714 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T03:54:09.717 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T03:54:39.781 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T03:54:39.785 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T03:55:09.925 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T03:55:09.929 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T03:55:40.027 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T03:55:40.031 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T03:56:10.097 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T03:56:10.101 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T03:56:40.262 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T03:56:40.266 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T03:57:10.525 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T03:57:10.528 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T03:57:40.807 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T03:57:40.810 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T03:58:10.959 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T03:58:10.964 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T03:58:41.079 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T03:58:41.083 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T03:59:11.149 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T03:59:11.152 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T03:59:41.242 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T03:59:41.247 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T04:00:11.596 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T04:00:11.599 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T04:00:41.666 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T04:00:41.670 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T04:01:11.761 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T04:01:11.766 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T04:01:41.838 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T04:01:41.843 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T04:02:12.035 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T04:02:12.038 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T04:02:42.110 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T04:02:42.114 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T04:03:12.468 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T04:03:12.471 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T04:03:42.534 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T04:03:42.538 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T04:04:12.882 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T04:04:12.887 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T04:04:42.953 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T04:04:42.956 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T04:05:13.082 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T04:05:13.085 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T04:05:43.203 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T04:05:43.206 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T04:06:13.405 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T04:06:13.409 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T04:06:43.476 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T04:06:43.480 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T04:07:13.695 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T04:07:13.699 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T04:07:43.832 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T04:07:43.837 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T04:08:13.994 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T04:08:13.997 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T04:08:44.080 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T04:08:44.083 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T04:09:14.426 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T04:09:14.430 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T04:09:44.493 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T04:09:44.497 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T04:10:14.637 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T04:10:14.641 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T04:10:44.816 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T04:10:44.820 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T04:11:14.977 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T04:11:14.981 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T04:11:45.130 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T04:11:45.134 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T04:12:15.258 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T04:12:15.262 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T04:12:45.395 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T04:12:45.399 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T04:13:15.588 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T04:13:15.591 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T04:13:45.658 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T04:13:45.662 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T04:14:15.803 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T04:14:15.808 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T04:14:45.873 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T04:14:45.877 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T04:15:16.019 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T04:15:16.023 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T04:15:46.170 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T04:15:46.174 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T04:16:16.310 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T04:16:16.314 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T04:16:46.385 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T04:16:46.388 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T04:17:16.517 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T04:17:16.521 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T04:17:46.591 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T04:17:46.594 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T04:18:16.724 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T04:18:16.728 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T04:18:46.906 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T04:18:46.909 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T04:19:17.033 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T04:19:17.037 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T04:19:47.143 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T04:19:47.146 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T04:20:17.274 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T04:20:17.277 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T04:20:47.402 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T04:20:47.405 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T04:21:17.530 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T04:21:17.533 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T04:21:47.660 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T04:21:47.663 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T04:22:17.771 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T04:22:17.775 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T04:22:48.064 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T04:22:48.068 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T04:23:18.195 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T04:23:18.198 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T04:23:48.261 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T04:23:48.265 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T04:24:18.521 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T04:24:18.525 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T04:24:48.667 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T04:24:48.670 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T04:25:18.827 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T04:25:18.830 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T04:25:48.972 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T04:25:48.976 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T04:26:19.126 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T04:26:19.130 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T04:26:49.320 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T04:26:49.323 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T04:27:19.607 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T04:27:19.611 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T04:27:49.945 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T04:27:49.950 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T04:28:20.165 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T04:28:20.168 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T04:28:50.317 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T04:28:50.320 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T04:29:20.595 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T04:29:20.599 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T04:29:50.933 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T04:29:50.936 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T04:30:21.259 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T04:30:21.263 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T04:30:51.381 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T04:30:51.384 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T04:31:21.451 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T04:31:21.455 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T04:31:51.518 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T04:31:51.522 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T04:32:21.604 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T04:32:21.608 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T04:32:51.921 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T04:32:51.924 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T04:33:22.002 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T04:33:22.005 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T04:33:52.072 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T04:33:52.076 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T04:34:22.206 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T04:34:22.209 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T04:34:52.336 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T04:34:52.340 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T04:35:22.481 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T04:35:22.484 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T04:35:52.549 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T04:35:52.553 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T04:36:22.620 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T04:36:22.624 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T04:36:52.773 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T04:36:52.777 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T04:37:22.909 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T04:37:22.913 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T04:37:53.061 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T04:37:53.065 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T04:38:23.173 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T04:38:23.176 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T04:38:53.327 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T04:38:53.330 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T04:39:23.691 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T04:39:23.695 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T04:39:53.823 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T04:39:53.827 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T04:40:23.956 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T04:40:23.960 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T04:40:54.096 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T04:40:54.100 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T04:41:24.323 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T04:41:24.327 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T04:41:54.394 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T04:41:54.398 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T04:42:24.645 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T04:42:24.648 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T04:42:54.766 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T04:42:54.770 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T04:43:24.910 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T04:43:24.914 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T04:43:55.164 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T04:43:55.168 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T04:44:25.310 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T04:44:25.314 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T04:44:55.637 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T04:44:55.640 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T04:45:25.898 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T04:45:25.902 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T04:45:56.033 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T04:45:56.036 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T04:46:26.166 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T04:46:26.169 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T04:46:56.239 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T04:46:56.243 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T04:47:26.389 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T04:47:26.393 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T04:47:56.479 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T04:47:56.482 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T04:48:26.645 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T04:48:26.648 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T04:48:56.775 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T04:48:56.779 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T04:49:26.904 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T04:49:26.908 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T04:49:57.083 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T04:49:57.087 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T04:50:27.243 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T04:50:27.246 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T04:50:57.326 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T04:50:57.330 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T04:51:27.467 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T04:51:27.471 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T04:51:57.600 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T04:51:57.604 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T04:52:27.771 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T04:52:27.775 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T04:52:57.915 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T04:52:57.919 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T04:53:28.033 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T04:53:28.036 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T04:53:58.171 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T04:53:58.174 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T04:54:28.336 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T04:54:28.340 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T04:54:58.468 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T04:54:58.472 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T04:55:28.596 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T04:55:28.599 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T04:55:58.666 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T04:55:58.669 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T04:56:28.735 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T04:56:28.738 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T04:56:58.888 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T04:56:58.891 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T04:57:29.016 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T04:57:29.020 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T04:57:59.357 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T04:57:59.360 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T04:58:29.505 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T04:58:29.509 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T04:58:59.641 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T04:58:59.644 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T04:59:29.744 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T04:59:29.748 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T04:59:59.838 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T04:59:59.842 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T05:00:30.142 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T05:00:30.146 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T05:01:00.284 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T05:01:00.288 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T05:01:30.473 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T05:01:30.481 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T05:02:00.750 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T05:02:00.754 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T05:02:30.820 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T05:02:30.824 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T05:03:01.003 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T05:03:01.007 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T05:03:31.094 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T05:03:31.098 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T05:04:01.232 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T05:04:01.236 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T05:04:31.306 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T05:04:31.310 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T05:05:01.464 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T05:05:01.467 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T05:05:31.692 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T05:05:31.696 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T05:06:01.764 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T05:06:01.768 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T05:06:31.851 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T05:06:31.855 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T05:07:02.003 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T05:07:02.007 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T05:07:32.292 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T05:07:32.295 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T05:08:02.361 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T05:08:02.365 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T05:08:32.505 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T05:08:32.508 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T05:09:02.659 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T05:09:02.663 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T05:09:32.812 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T05:09:32.816 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T05:10:02.891 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T05:10:02.894 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T05:10:33.037 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T05:10:33.041 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T05:11:03.115 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T05:11:03.119 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T05:11:33.247 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T05:11:33.250 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T05:12:03.400 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T05:12:03.404 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T05:12:33.552 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T05:12:33.556 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T05:13:03.638 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T05:13:03.642 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T05:13:33.924 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T05:13:33.928 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T05:14:03.995 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T05:14:03.999 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T05:14:34.199 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T05:14:34.202 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T05:15:04.342 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T05:15:04.345 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T05:15:34.461 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T05:15:34.465 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T05:16:04.592 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T05:16:04.596 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T05:16:34.742 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T05:16:34.747 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T05:17:04.846 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T05:17:04.849 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T05:17:35.020 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T05:17:35.023 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T05:18:05.159 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T05:18:05.163 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T05:18:35.229 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T05:18:35.232 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T05:19:05.450 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T05:19:05.454 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T05:19:35.591 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T05:19:35.595 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T05:20:05.671 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T05:20:05.674 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T05:20:35.808 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T05:20:35.811 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T05:21:05.934 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T05:21:05.938 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T05:21:36.081 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T05:21:36.085 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T05:22:06.391 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T05:22:06.394 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T05:22:36.693 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T05:22:36.697 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T05:23:06.913 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T05:23:06.916 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T05:23:37.029 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T05:23:37.033 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T05:24:07.093 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T05:24:07.097 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T05:24:37.219 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T05:24:37.223 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T05:25:07.316 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T05:25:07.320 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T05:25:37.385 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T05:25:37.389 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T05:26:07.455 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T05:26:07.459 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T05:26:37.591 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T05:26:37.595 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T05:27:07.719 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T05:27:07.723 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T05:27:37.798 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T05:27:37.802 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T05:28:07.993 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T05:28:07.996 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T05:28:38.137 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T05:28:38.140 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T05:29:08.298 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T05:29:08.301 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T05:29:38.466 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T05:29:38.470 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T05:30:08.624 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T05:30:08.628 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T05:30:38.989 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T05:30:38.993 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T05:31:09.142 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T05:31:09.146 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T05:31:39.295 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T05:31:39.299 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T05:32:09.364 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T05:32:09.368 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T05:32:39.501 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T05:32:39.504 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T05:33:09.654 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T05:33:09.658 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T05:33:39.982 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T05:33:39.986 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T05:34:10.052 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T05:34:10.055 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T05:34:40.358 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T05:34:40.362 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T05:35:10.426 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T05:35:10.430 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T05:35:40.593 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T05:35:40.597 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T05:36:10.734 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T05:36:10.738 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T05:36:40.870 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T05:36:40.873 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T05:37:11.001 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T05:37:11.005 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T05:37:41.154 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T05:37:41.158 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T05:38:11.248 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T05:38:11.252 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T05:38:41.501 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T05:38:41.505 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T05:39:11.572 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T05:39:11.575 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T05:39:41.700 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T05:39:41.704 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T05:40:11.767 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T05:40:11.771 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T05:40:41.857 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T05:40:41.861 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T05:41:11.927 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T05:41:11.931 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T05:41:42.102 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T05:41:42.105 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T05:42:12.234 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T05:42:12.238 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T05:42:42.441 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T05:42:42.445 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T05:43:12.736 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T05:43:12.739 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T05:43:42.830 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T05:43:42.834 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T05:44:12.965 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T05:44:12.968 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T05:44:43.053 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T05:44:43.057 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T05:45:13.189 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T05:45:13.192 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T05:45:43.342 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T05:45:43.346 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T05:46:13.494 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T05:46:13.498 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T05:46:43.564 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T05:46:43.568 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T05:47:13.720 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T05:47:13.724 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T05:47:43.854 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T05:47:43.857 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T05:48:14.002 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T05:48:14.006 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T05:48:44.142 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T05:48:44.145 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T05:49:14.263 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T05:49:14.266 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T05:49:44.416 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T05:49:44.419 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T05:50:14.552 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T05:50:14.555 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T05:50:44.680 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T05:50:44.683 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T05:51:14.807 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T05:51:14.810 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T05:51:44.878 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T05:51:44.882 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T05:52:15.029 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T05:52:15.033 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T05:52:45.224 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T05:52:45.227 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T05:53:15.328 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T05:53:15.331 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T05:53:45.640 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T05:53:45.644 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T05:54:16.000 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T05:54:16.004 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T05:54:46.287 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T05:54:46.291 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T05:55:16.401 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T05:55:16.405 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T05:55:46.472 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T05:55:46.476 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T05:56:16.634 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T05:56:16.637 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T05:56:46.706 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T05:56:46.709 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T05:57:16.888 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T05:57:16.892 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T05:57:47.236 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T05:57:47.240 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T05:58:17.306 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T05:58:17.310 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T05:58:47.376 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T05:58:47.380 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T05:59:17.513 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T05:59:17.517 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T05:59:47.677 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T05:59:47.680 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T06:00:17.830 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T06:00:17.833 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T06:00:47.980 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T06:00:47.984 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T06:01:18.086 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T06:01:18.089 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T06:01:48.219 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T06:01:48.223 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T06:02:18.418 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T06:02:18.421 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T06:02:48.721 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T06:02:48.725 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T06:03:18.852 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T06:03:18.856 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T06:03:48.995 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T06:03:48.999 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T06:04:19.135 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T06:04:19.138 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T06:04:49.295 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T06:04:49.299 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T06:05:19.407 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T06:05:19.411 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T06:05:49.528 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T06:05:49.532 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T06:06:19.597 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T06:06:19.600 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T06:06:49.733 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T06:06:49.737 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T06:07:19.886 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T06:07:19.890 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T06:07:50.024 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T06:07:50.029 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T06:08:20.168 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T06:08:20.172 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T06:08:50.313 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T06:08:50.317 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T06:09:20.441 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T06:09:20.444 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T06:09:50.552 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T06:09:50.556 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T06:10:20.764 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T06:10:20.768 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T06:10:51.117 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T06:10:51.120 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T06:11:21.420 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T06:11:21.424 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T06:11:51.581 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T06:11:51.585 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T06:12:21.817 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T06:12:21.821 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T06:12:51.892 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T06:12:51.896 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T06:13:21.962 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T06:13:21.965 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T06:13:52.026 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T06:13:52.030 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T06:14:22.094 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T06:14:22.097 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T06:14:52.166 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T06:14:52.170 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T06:15:22.236 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T06:15:22.239 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T06:15:52.314 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T06:15:52.317 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T06:16:22.384 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T06:16:22.389 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T06:16:52.513 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T06:16:52.516 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T06:17:22.581 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T06:17:22.584 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T06:17:52.734 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T06:17:52.740 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T06:18:22.814 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T06:18:22.817 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T06:18:52.935 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T06:18:52.939 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T06:19:23.004 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T06:19:23.008 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T06:19:53.071 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T06:19:53.074 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T06:20:23.140 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T06:20:23.144 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T06:20:53.278 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T06:20:53.281 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T06:21:23.419 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T06:21:23.423 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T06:21:53.764 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T06:21:53.768 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T06:22:23.914 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T06:22:23.918 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T06:22:54.088 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T06:22:54.092 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T06:23:24.225 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T06:23:24.229 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T06:23:54.420 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T06:23:54.424 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T06:24:24.564 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T06:24:24.567 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T06:24:54.794 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T06:24:54.798 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T06:25:24.953 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T06:25:24.956 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T06:25:55.097 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T06:25:55.100 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T06:26:25.233 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T06:26:25.237 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T06:26:55.344 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T06:26:55.348 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T06:27:25.606 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T06:27:25.609 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T06:27:55.834 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T06:27:55.838 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T06:28:25.937 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T06:28:25.940 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T06:28:56.165 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T06:28:56.169 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T06:29:26.327 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T06:29:26.330 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T06:29:56.447 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T06:29:56.451 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T06:30:26.699 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T06:30:26.703 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T06:30:56.952 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T06:30:56.956 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T06:31:27.073 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T06:31:27.076 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T06:31:57.436 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T06:31:57.439 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T06:32:27.511 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T06:32:27.515 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T06:32:57.617 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T06:32:57.621 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T06:33:27.717 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T06:33:27.721 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T06:33:57.866 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T06:33:57.873 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T06:34:28.004 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T06:34:28.007 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T06:34:58.257 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T06:34:58.261 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T06:35:28.329 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T06:35:28.332 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T06:35:58.399 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T06:35:58.403 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T06:36:28.500 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T06:36:28.503 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T06:36:58.571 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T06:36:58.575 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T06:37:28.743 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T06:37:28.746 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T06:37:58.887 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T06:37:58.891 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T06:38:29.031 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T06:38:29.034 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T06:38:59.175 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T06:38:59.179 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T06:39:29.320 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T06:39:29.323 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T06:39:59.465 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T06:39:59.469 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T06:40:29.535 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T06:40:29.538 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T06:40:59.858 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T06:40:59.862 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T06:41:29.990 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T06:41:29.994 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T06:42:00.294 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T06:42:00.298 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T06:42:30.446 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T06:42:30.450 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T06:43:00.575 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T06:43:00.579 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T06:43:30.892 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T06:43:30.895 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T06:44:01.023 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T06:44:01.026 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T06:44:31.176 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T06:44:31.180 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T06:45:01.328 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T06:45:01.332 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T06:45:31.581 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T06:45:31.585 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T06:46:01.719 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T06:46:01.722 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T06:46:31.855 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T06:46:31.859 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T06:47:01.983 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T06:47:01.987 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T06:47:32.128 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T06:47:32.131 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T06:48:02.264 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T06:48:02.267 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T06:48:32.417 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T06:48:32.420 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T06:49:02.789 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T06:49:02.793 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T06:49:32.908 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T06:49:32.911 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T06:50:03.121 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T06:50:03.125 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T06:50:33.263 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T06:50:33.266 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T06:51:03.537 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T06:51:03.540 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T06:51:33.651 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T06:51:33.656 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T06:52:03.832 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T06:52:03.836 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T06:52:34.067 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T06:52:34.071 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T06:53:04.420 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T06:53:04.423 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T06:53:34.697 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T06:53:34.700 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T06:54:05.049 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T06:54:05.053 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T06:54:35.228 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T06:54:35.231 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T06:55:05.398 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T06:55:05.402 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T06:55:35.634 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T06:55:35.638 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T06:56:05.938 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T06:56:05.945 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T06:56:36.249 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T06:56:36.252 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T06:57:06.419 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T06:57:06.423 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T06:57:36.723 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T06:57:36.727 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T06:58:06.949 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T06:58:06.953 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T06:58:37.219 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T06:58:37.223 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T06:59:07.387 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T06:59:07.391 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T06:59:37.492 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T06:59:37.495 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T07:00:07.619 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T07:00:07.623 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T07:00:37.731 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T07:00:37.735 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T07:01:07.884 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T07:01:07.888 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T07:01:38.029 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T07:01:38.033 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T07:02:08.194 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T07:02:08.198 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T07:02:38.338 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T07:02:38.341 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T07:03:08.404 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T07:03:08.409 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T07:03:38.524 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T07:03:38.530 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T07:04:08.827 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T07:04:08.830 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T07:04:38.971 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T07:04:38.975 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T07:05:09.040 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T07:05:09.044 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T07:05:39.185 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T07:05:39.189 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T07:06:09.350 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T07:06:09.354 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T07:06:39.492 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T07:06:39.497 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T07:07:09.644 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T07:07:09.648 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T07:07:40.005 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T07:07:40.011 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T07:08:10.077 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T07:08:10.081 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T07:08:40.214 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T07:08:40.218 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T07:09:10.352 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T07:09:10.355 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T07:09:40.597 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T07:09:40.600 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T07:10:10.720 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T07:10:10.724 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T07:10:40.814 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T07:10:40.817 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T07:11:10.949 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T07:11:10.953 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T07:11:41.095 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T07:11:41.099 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T07:12:11.231 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T07:12:11.234 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T07:12:41.376 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T07:12:41.380 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T07:13:11.504 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T07:13:11.507 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T07:13:41.700 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T07:13:41.703 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T07:14:11.826 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T07:14:11.830 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T07:14:41.962 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T07:14:41.965 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T07:15:12.098 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T07:15:12.101 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T07:15:42.271 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T07:15:42.275 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T07:16:12.354 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T07:16:12.357 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T07:16:42.647 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T07:16:42.651 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T07:17:12.783 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T07:17:12.787 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T07:17:42.904 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T07:17:42.907 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T07:18:13.023 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T07:18:13.027 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T07:18:43.260 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T07:18:43.264 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T07:19:13.388 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T07:19:13.392 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T07:19:43.541 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T07:19:43.545 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T07:20:13.685 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T07:20:13.689 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T07:20:43.830 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T07:20:43.834 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T07:21:13.979 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T07:21:13.983 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T07:21:44.120 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T07:21:44.123 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T07:22:14.272 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T07:22:14.275 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T07:22:44.383 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T07:22:44.387 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T07:23:14.527 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T07:23:14.531 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T07:23:44.673 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T07:23:44.677 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T07:24:14.751 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T07:24:14.754 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T07:24:44.935 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T07:24:44.939 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T07:25:15.081 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T07:25:15.084 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T07:25:45.218 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T07:25:45.222 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T07:26:15.338 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T07:26:15.341 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T07:26:45.502 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T07:26:45.505 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T07:27:15.574 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T07:27:15.577 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T07:27:45.696 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T07:27:45.699 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T07:28:15.834 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T07:28:15.838 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T07:28:45.976 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T07:28:45.980 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T07:29:16.112 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T07:29:16.115 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T07:29:46.257 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T07:29:46.260 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T07:30:16.368 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T07:30:16.372 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T07:30:46.506 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T07:30:46.510 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T07:31:16.668 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T07:31:16.672 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T07:31:46.814 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T07:31:46.818 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T07:32:16.954 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T07:32:16.958 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T07:32:47.108 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T07:32:47.112 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T07:33:17.237 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T07:33:17.240 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T07:33:47.378 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T07:33:47.381 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T07:34:17.450 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T07:34:17.454 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T07:34:47.585 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T07:34:47.588 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T07:35:17.881 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T07:35:17.885 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T07:35:47.943 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T07:35:47.946 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T07:36:18.038 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T07:36:18.042 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T07:36:48.357 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T07:36:48.360 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T07:37:18.501 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T07:37:18.505 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T07:37:48.645 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T07:37:48.648 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T07:38:18.777 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T07:38:18.781 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T07:38:48.918 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T07:38:48.922 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T07:39:19.034 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T07:39:19.038 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T07:39:49.107 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T07:39:49.111 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T07:40:19.244 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T07:40:19.247 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T07:40:49.396 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T07:40:49.399 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T07:41:19.525 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T07:41:19.529 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T07:41:49.644 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T07:41:49.648 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T07:42:19.780 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T07:42:19.784 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T07:42:49.950 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T07:42:49.953 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T07:43:20.094 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T07:43:20.097 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T07:43:50.290 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T07:43:50.294 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T07:44:20.442 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T07:44:20.445 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T07:44:50.587 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T07:44:50.591 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T07:45:20.911 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T07:45:20.914 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T07:45:51.051 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T07:45:51.055 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T07:46:21.212 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T07:46:21.215 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T07:46:51.341 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T07:46:51.345 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T07:47:21.524 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T07:47:21.527 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T07:47:51.638 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T07:47:51.642 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T07:48:21.757 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T07:48:21.760 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T07:48:51.901 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T07:48:51.906 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T07:49:22.037 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T07:49:22.041 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T07:49:52.182 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T07:49:52.185 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T07:50:22.254 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T07:50:22.258 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T07:50:52.397 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T07:50:52.400 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T07:51:22.540 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T07:51:22.544 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T07:51:52.682 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T07:51:52.686 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T07:52:22.746 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T07:52:22.750 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T07:52:52.815 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T07:52:52.818 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T07:53:22.909 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T07:53:22.912 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T07:53:53.068 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T07:53:53.072 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T07:54:23.220 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T07:54:23.224 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T07:54:53.562 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T07:54:53.566 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T07:55:23.715 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T07:55:23.718 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T07:55:53.784 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T07:55:53.788 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T07:56:23.931 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T07:56:23.934 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T07:56:54.027 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T07:56:54.031 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T07:57:24.172 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T07:57:24.176 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T07:57:54.309 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T07:57:54.313 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T07:58:24.445 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T07:58:24.449 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T07:58:54.593 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T07:58:54.596 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T07:59:24.736 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T07:59:24.740 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T07:59:54.881 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T07:59:54.884 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T08:00:25.033 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T08:00:25.036 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T08:00:55.170 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T08:00:55.174 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T08:01:25.288 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T08:01:25.292 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T08:01:55.425 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T08:01:55.429 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T08:02:25.566 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T08:02:25.569 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T08:02:55.723 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T08:02:55.725 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T08:03:25.831 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T08:03:25.835 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T08:03:55.970 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T08:03:55.973 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T08:04:26.089 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T08:04:26.092 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T08:04:56.226 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T08:04:56.229 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T08:05:05.687 DEBUG:teuthology.exit:Got signal 15; running 1 handler... 2024-09-11T08:05:05.688 DEBUG:teuthology.task.console_log:Killing console logger for smithi092 2024-09-11T08:05:05.689 DEBUG:teuthology.task.console_log:Killing console logger for smithi145 2024-09-11T08:05:05.689 DEBUG:teuthology.exit:Finished running handlers